Hacker News

Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module

Hacker News - Thu, 06/04/2026 - 8:26pm

LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is not natively supported by vLLM. The LLMhop binary inspects the model field of the request and routes it to the correct backend service with optional handling of authentication. In addition, it contains a NixOS module to run llama.cpp, vLLM, and sglang via Quadlet/Podman and auto-register with the proxy.

Comments URL: https://news.ycombinator.com/item?id=48406517

Points: 1

# Comments: 0

Categories: Hacker News

Ask HN: Is Everyone an Engineer Now?

Hacker News - Thu, 06/04/2026 - 7:50pm

Marketing engineer for marketing people, design engineer for designers, sanitation engineer for janitors — so by that logic, cashier engineer would be next for the people who ring you up at checkout. What is up with this title inflation? Why call yourself an engineer just because you write software? To me, engineers are people who build things and take full responsibility for them — designing a bridge where thousands of lives are in your hands, building an airplane engine, filtering a city's water supply. Not pressing keys on a machine.

Comments URL: https://news.ycombinator.com/item?id=48406239

Points: 1

# Comments: 0

Categories: Hacker News

What was your "Oh Shit" moment with GenAI?

Hacker News - Thu, 06/04/2026 - 7:42pm

Most of us were amused when DALL-E and its peers went mainstream, and we were quick to point out the obvious flaws.

Then ChatGPT hit the scene and again, many of us dismissed it as a parlor trick that would never amount to much.

Using LLMs for coding initially was a only small step up from basic code completion, and a welcome farewell to Stack Overflow.

I am curious: what was the specific moment that you went from those quaint, dismissive observations to a slightly panicked, "Uh Oh" realization of what these models can do?

Comments URL: https://news.ycombinator.com/item?id=48406174

Points: 1

# Comments: 0

Categories: Hacker News

SpaceX IPO Website

Hacker News - Thu, 06/04/2026 - 7:39pm

Article URL: https://www.spacexipo.com

Comments URL: https://news.ycombinator.com/item?id=48406148

Points: 1

# Comments: 0

Categories: Hacker News

Pages