Blog

Thoughts on AI, engineering, and building innovative solutions

Controlling Model Identity through Internal Activations: A Study of MLP and Residual Hooks

January 13, 2026

Exploring how we can manipulate transformer model behavior by intervening in internal activations using MLP and residual stream hooks. This research investigates the relationship between model identity and activation patterns.

Transformers Interpretability Research

Controlling Hindi Dialects through Internal Activations: A Study of Steering Vectors in Nemotron-4

March 1, 2026

Exploring how we can manipulate a standarized hindi model behavior by intervening in internal activations using MLP and residual stream hooks. This research investigates the relationship between model identity and activation patterns.

Transformers Interpretability Research