google

/

gemma-scope-9b-pt-res

like 2

Same with layer 6 l0 36.

Hi @MrGonao , Please provide more clear context or details on this issue you are facing to understand the issue better. Thank you

Sorry, I should have been more clear. When downloading these SAEs with path_to_params = hf_hub_download( repo_id="google/gemma-scope-9b-pt-res", filename=f"layer_13/width_131k/average_l0_30"/params.npz", force_download=False, ) and then loading them using params = np.load(path_to_params) leads to the above error for SAEs of width 131k on layer 3 and 6 (at least in the specified l0s). All other layers I tried seem to be working fine.