Hacker News

Article URL: https://github.com/ralsina/sheety

Comments URL: https://news.ycombinator.com/item?id=49913082

Points: 1

# Comments: 0

Article URL: https://www.foxnews.com/travel/lost-medieval-castle-found-hiding-plain-sight-professor-spots-telltale-clues

Comments URL: https://news.ycombinator.com/item?id=49913081

Points: 1

# Comments: 0

Article URL: https://halv.ai/blog/halv-swe-rebench-astra-42-pairs/

Comments URL: https://news.ycombinator.com/item?id=49913080

Points: 1

# Comments: 0

Article URL: https://frame.work/de/en/products/desktop-diy-amd-aimax400/configuration/new

Comments URL: https://news.ycombinator.com/item?id=49913047

Points: 1

# Comments: 0

Article URL: https://aaronmallen.me/writing/hanami-why-introductions

Comments URL: https://news.ycombinator.com/item?id=49913038

Points: 1

# Comments: 0

Article URL: https://edacrux.app/

Comments URL: https://news.ycombinator.com/item?id=49913036

Points: 1

# Comments: 0

Article URL: https://www.vusec.net/projects/btr/

Comments URL: https://news.ycombinator.com/item?id=49913009

Points: 1

# Comments: 0

For all burntout swe, what's a good paid part time that you are doing?

Comments URL: https://news.ycombinator.com/item?id=49913004

Points: 1

# Comments: 0

Article URL: https://thoughts.wyounas.com/p/what-does-good-ai-mean

Comments URL: https://news.ycombinator.com/item?id=49912999

Points: 1

# Comments: 0

Article URL: https://system-design-in-depth.pages.dev/

Comments URL: https://news.ycombinator.com/item?id=49912997

Points: 2

# Comments: 0

Article URL: https://veritect.vercel.app

Comments URL: https://news.ycombinator.com/item?id=49912985

Points: 2

# Comments: 0

Most backends eventually need to do something once at a specific time. Revoke a trial after 30 days. Expire an offer. Retry a payment in 30 minutes. A few months ago I was consulting for a logistics platform. Their freight bidding workflow had a lot of timed steps. Every minute a cron queries all pending records and pushes them into Kafka. It worked. But it taxes the VM, DB, and message bus alike and creates a ton of unnecessary observability data.

A durable delay queue could be a better fit. But unfortunately, there are not many reliable options for scheduling long-term events.

Back in 2014 I wrote a Go library. It was a delay queue inspired by App Engine's push queues. It ensured durability with a WAL write. It kept them in a sorted heap. At startup ran it in their production. At a throughput of a few thousand tasks/second, it worked well for them.

But, I wanted to achieve millions of timers and much higher throughput. But there was also a bug I could not find. So I shelved it.

Twelve years later, I was cleaning up some old repos. I asked Claude Code if it could find the bug. And ... it found the bug. It was meant to only append to the WAL, but somewhere along the way every task started paying for a full synced commit. My "few thousand tasks/sec" ceiling was the disk's sync rate. The next few hours were pure bliss. Ideas I had carried around for years finally made it back into code. I rewrote it with a segmented WAL and group commit. Far future timers now loaded in memory only at the onset of the horizon. Now it is not no more a built in library but can run as as stand alone service.

Dispatch runs over HTTP/2. It has retries and idempotency keys. The rusty old code suddenly runs like a supercar.

Early numbers on 1 vCPU with ext4 on virtio and 128 byte payloads. - Durable add 107,500/s with 256 writers - End to end durable dispatch 157,000/s - About 44 bytes per pending timer with disk spill - About 403 bytes when resident

Now I'm wondering if anyone actually needs it.

The alternatives I know all have trade-offs. * Cron with DB - polling means duplicates and drift * Redis queues - have persistence trade-offs. Also, far-future schedules will always occupy memory despite durability config. Low thousands throughput * EventBridge - has one-minute granularity, low thousands throughput, and is AWS-only. * SQS and Cloud Tasks - have limits and per-task costs * Temporal, Step Functions etc. - are full workflow engines. resource intensive

I'm thinking about adding HTTP/3, gRPC and Arrow. I also want smarter loading based on available memory. Later I may look at partitioning and Raft. But before I turn this into another opensource project that nobody uses. I would like to hear from people who actually deal with this.

- What do you use for delayed or scheduled work? - What bugs you about it? - Would you run a dedicated durable timer service? - Anyone dealing with millions of future/far-future timers? How do you handle them?

All answers are welcome :-)

Comments URL: https://news.ycombinator.com/item?id=49912969

Points: 1

# Comments: 0

Article URL: https://www.quantamagazine.org/surprisingly-complex-waves-reveal-the-brains-inner-workings-20260930/

Comments URL: https://news.ycombinator.com/item?id=49912955

Points: 1

# Comments: 0

Article URL: https://www.morningstar.com/news/business-wire/20260929598647/nyse-to-commence-delisting-proceedings-against-getty-images-holdings-inc-gety

Comments URL: https://news.ycombinator.com/item?id=49912930

Points: 2

# Comments: 1

Article URL: https://www.completeskeptic.com/p/lies-damned-lies-and-benchmarks

Comments URL: https://news.ycombinator.com/item?id=49912929

Points: 1

# Comments: 0

Article URL: https://cam-davis.com/blog/posts/buying-a-spam-domain

Comments URL: https://news.ycombinator.com/item?id=49912917

Points: 4

# Comments: 0

Article URL: https://www.reddit.com/r/modnews/comments/1wubgvt/continuing_our_infrastructure_updates_whats/

Comments URL: https://news.ycombinator.com/item?id=49912903

Points: 1

# Comments: 0

Article URL: https://github.com/zie1ony/jev-talks/blob/main/demo.gif

Comments URL: https://news.ycombinator.com/item?id=49912895

Points: 1

# Comments: 1

Article URL: https://martinelli.ch/back-to-the-90s-the-software-engineer-has-all-the-roles-again/

Comments URL: https://news.ycombinator.com/item?id=49912894

Points: 1

# Comments: 0

Article URL: https://tailscale.com/blog/meta-muse-ai-agent-tailscale

Comments URL: https://news.ycombinator.com/item?id=49912880

Points: 1

# Comments: 0