New top story on Hacker News: Show HN: Hatchet v1 – a task orchestration platform built on Postgres
Show HN: Hatchet v1 – a task orchestration platform built on Postgres 16 by abelanger | 2 comments on Hacker News. Hey HN - this is Alexander from Hatchet. We’re building an open-source platform for managing background tasks, using Postgres as the underlying database. Just over a year ago, we launched Hatchet as a distributed task queue built on top of Postgres with a 100% MIT license ( https://ift.tt/ehnyGEJ ). The feedback and response we got from the HN community was overwhelming. In the first month after launching, we processed about 20k tasks on the platform — today, we’re processing over 20k tasks per minute (>1 billion per month). Scaling up this quickly was difficult — every task in Hatchet corresponds to at minimum 5 Postgres transactions and we would see bursts on Hatchet Cloud instances to over 5k tasks/second, which corresponds to roughly 25k transactions/second. As it turns out, a simple Postgres queue utilizing FOR UPDATE SKIP LOCKED doesn’t cut it at this scale. Af...