A local interpretability tool has been developed to visualize and intervene in the hidden-state activity of the Llama 3.2 3B model during inference, revealing a persistent hidden dimension (dim 3039) that influences the model's commitment to its generative trajectory. Systematic tests across various prompt types and intervention conditions showed that increasing intervention magnitude led to more confident responses, though not necessarily more accurate ones. This dimension acts as a global commitment gain, affecting how strongly the model adheres to its chosen path without altering which path is selected. The findings suggest that magnitude of intervention is more impactful than direction, with significant implications for understanding model behavior and improving interpretability. This matters because it sheds light on how AI models make decisions and the factors influencing their confidence, which is crucial for developing more reliable AI systems.
