Level 80
@morawcik I’m struggling to understand what you’re asking. If you want to process jobs in a queue faster then you ask more workers so jobs can be processed concurrently. That’s the solution.
Dec 2, 2022
1
Level 27
Best way to handle a lot of tasks in queue
Hi, I'm working on website where will be a lot of tasks which can takes even 1-5s each. For now it's just around 100 per minute but it will grow fast to 1000-10000 per min. I thought about queue and multiple workers but i will need to keep and on it and run new workers (even on new servers) when there will be too many tasks in queue. Also at some point there will be "limit" for me. How I could handle it?
Please or to participate in this conversation.