Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Task throughput isn't about the queue library. Your queue library should be fast enough, after that the bottleneck is the workload your tasks are doing. That's why you need prioritized queues so your slow long-running tasks run low priority and don't block the high priority tasks that should be fast and usually affect UX. We have 9 worker servers, each server has 6 CPUs, we process over 1M tasks per day.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: