Exodus · by Noé Petit · 2026-10-17
Running a small language model locally: is it actually useful?
I tried a small model on my laptop for summarising notes and drafting emails without sending anything to a company. It's not as sharp as the big ones, but for private stuff it's good enough. Curious what others use it for.
86 sparks · 7 comments
Comments
Jonas Schneider · 2 likes
summaries and rewrites are the sweet spot. offline and private
Noé Petit · 1 likes
same, i use it for cleaning up meeting notes
Jonas Schneider · 0 likes
don't expect miracles but it improves every few months
Jonas Schneider · 0 likes
ram matters more than people think. 16gb is comfortable
Jonas Schneider · 0 likes
the privacy angle is the real selling point for me
Noé Petit · 2 likes
agreed, sensitive docs stay on my machine