Oli Clive-Griffin

Github, o [dot] clivegriffin [at] gmail [dot] com

I'm currently working at Goodfire on Parameter Decomposition. You can follow along in our public slack channel and public research github repo.

Research / ML

• Stochastic Parameter Decomposition - Directly interpreting the weights of Neural Networks
• crosscode - A library for training Sparse Crosscoders, Transcoders, and SAEs. I now think parameter-space interpretability is more promising than activation-space.
• Detecting Successful Adversarial Prompting From SAE Activations - Won 2nd place in Apart Research and Goodfire's "Reprogramming AI Models" research sprint.
• My Application to Neel Nanda's MATS stream - Investigating use of for-loop variables in toy language models. (i.e. for (int i = 0; should predict i as the next token)

Code

• Rusp - A lisp interpreter and Bytecode Compiler/VM written in Rust (name suggestions welcome)
• Rax - A small deep learning library able to train neural networks in less than 1000 lines of dependency free Rust.
• Einchain - expressive method chaining for einsum ops
• Conway's game of life in 3D