Orbit · Explore

Exodus · by Jonas Schneider · 2026-11-04

Qwen 3.8 27B on a laptop reading raw model weights - big deal or party trick?

simonwillison.net

Simon Willison tried an example from the new 'weight-space programming' paper and found a 27B open model running locally could interpret what a small network was trained to do just from its raw weights. There's already a rebuttal going around arguing the original claims are overstated. For those of us who left big labs partly over closed models, it's interesting that this is reproducible on consumer hardware at all. Does local reproducibility change how much you trust results like this?

32 sparks · 4 comments

Comments

Noé Petit · 4 likes

the fact that anyone can rerun it at home is the whole point. that's how science is supposed to work

Beatriz Sousa · 4 likes

tiny toy networks though. i'll get excited when it does this on something with more than a few thousand params

Jonas Schneider · 4 likes

sure but 2 years ago nobody would have predicted even this

Jonas Schneider · 4 likes

my old team would have spent 6 months and a legal review to publish this. Simon did it on a Tuesday