Most Qwen3-32B Neuron Response Poles Have One Main Function, Researcher Estimates

Nick Cammarata, a Goodfire researcher and co-author of OpenAI’s 2023 neuron-interpretability paper, estimates that about 90% of Qwen3-32B’s neuron response poles serve one main function. The preliminary finding challenges the view that model internals are broadly tangled. His breakdown assigns about 7% of poles to two related functions, while 2% to 4% remain unexplained. A response pole represents either the positive or negative direction of a neuron’s activity. Cammarata cautioned that the share changes with the cutoff for weak activations, the model layers examined and the definition of a single function.

Source: TokenPost