SO Lens for Llama 8b

Context: applying second order lens from https://arxiv.org/html/2406.04341v1 to investigate what neurons are responsible for knowing the space needle is in Seattle.

Result Notebook

SO Lens Implementation Python Code