Orbit · Explore

AI Lab · by Noah Miller · 2026-11-03

"There is no posttraining data commons" and why that matters for open models

openathena.ai

OpenAthena's argument: pretraining runs on a huge public commons of documents, but posttraining (especially agentic RL) consumes tasks, and there's no shared pile of those. So open models fall further behind exactly where frontier labs are investing most. Anyone here contributed to open task/environment datasets? What would actually make people share them?

20 sparks · 3 comments

Comments

Gentle Mango · 7 likes

tasks are expensive to make and companies treat them as moat, so nobody shares. same as rlhf data was

Irene López · 3 likes

honestly the closest thing we have is benchmark repos and those get contaminated in 6 months

Siti Lestari · 2 likes

which is kind of the point of the post, no living commons just snapshots