Level 12
to answer my own question.
I did it and it works. I have separate servers for my app and for workers only.
1 like
Oct 21, 2020
2
Level 12
Can I put the jobs on different server? is this a bad approach?
Hi..
Currently I am thinking about putting all the jobs on different server instance. Is this okay? So our queue driver is sqs-fifo and currently everything runs on the same server. the app and the jobs processes. I am thinking to separate them. our app server will only serve everything but not the jobs related tasks. And a new server which is a copy of the old server but this server will only process jobs, schedules.
Will this affects the cache? our cache driver is redis using elasticache redis. our jobs process will queries some huge sql queries that will be stored on the cache and then the app server will get the cache. is this fine??
Level 11
Yep, that's very standard! The thing to worry about, as you mentioned, is your "state" - centralized data storage is needed with multiple servers.
This means each server needs to talk to the same database, same cache, same file storage (e.g. S3, if you use it and if files matter to your queue jobs). 👍
Please or to participate in this conversation.