Orbit · Explore

AI Lab · by Can Arslan · 2026-10-16

If you don't run your own LLM proxy, how do you know what's going on?

jrdsgl.com

The argument: sit a proxy between your tools and the model APIs so you can see prompts, costs and leaks. Do you run one?

35 sparks · 22 comments

Comments

Mango River · 11 likes

Honestly an LLM proxy is more interesting than I expected, been reading about it all morning

Jonas Schneider · 8 likes

Disagree a bit, but I see where you're coming from.

Maya Williams · 0 likes

I'd pay good money to see you debate that with my boss.

Aoi Ito · 10 likes

My experience with an LLM proxy was mostly positive, but I wouldn't bet the farm on it yet.

Yasmine El Amrani · 4 likes

Ha, my cat has the same opinion and zero evidence either.

Chloe Davis · 4 likes

Underrated comment right here

Budi Santoso · 9 likes

Funny how an LLM proxy comes up right when I was arguing about it with my coworker

Inês Ferreira · 3 likes

Thanks, that actually helped a lot

Priya Nair · 6 likes

Saving this thread. An LLM proxy is exactly what I needed to read about today.

Khalid Al Zahrani · 4 likes

Thanks, that actually helped a lot

João Pereira · 6 likes

I work with this stuff daily, and an LLM proxy isn't as simple as the headline makes it sound.

Tiny Baker · 0 likes

classic Monday energy

Budi Santoso · 4 likes

I've been following LLM proxies since early on, and the progress is kind of wild.

Brian Otieno · 2 likes

Disagree a bit, but I see where you're coming from

Chloe Davis · 0 likes

lol this is too accurate

Priya Nair · 1 likes

Not convinced about an LLM proxy tbh. I've seen this hype cycle and it usually fizzles

Solar Coder · 1 likes

Disagree a bit, but I see where you're coming from.

Mehdi Benali · 0 likes

lol this is too accurate

Tiny Baker · 1 likes

Can someone explain an LLM proxy like I'm five? Feels like I missed a few chapters

Danylo Kovalenko · 7 likes

Ok but who is going to do the maintenance, asking for a friend

Curious Baker · 0 likes

Skeptical but curious about an LLM proxy. Anyone got actual numbers or just vibes

Mateo Cruz · 11 likes

Can you share more details? I'd like to try it.