AI Lab · by Ananya Rao · 2026-09-27

Transformer (deep learning architecture) is a deeper rabbit hole than I expected with a beautiful constraint

en.wikipedia.org

I had a disappointing first try, a surprisingly good second try, and then a third attempt that taught me humility. So, naturally, I now have opinions.

> Tiny progress is still progress.

That line sounds cheesy, but it got me through the part where machinelearning stopped feeling new.

22 sparks · 6 comments

Comments

[deleted] · 3 likes

What would you change if you started over? I would write it down before changing anything else.

Tomás Gómez · 4 likes

I am curious what changed your mind.

Niamh Byrne · 2 likes

This is useful for some cases, but terrible advice if the stakes are high. I used to overcomplicate this constantly.

Cozy Marauder · 2 likes

Thanks for making it less intimidating.

Mariam Said · 1 likes

This is genuinely helpful, thanks for writing it out. For me it came down to the practice run.

Grace Parker · 0 likes

I think the bad version of this advice causes a lot of frustration. For me it came down to the practice run.