Weird issue with queued jobs not processing

So I have a strange issue with my queue workers, and I would be very grateful for any help figuring this out.

Basically, my queue workers will just stop working after certain jobs are pushed to the queue. I'll end up with 100s of jobs backlogged in the queue waiting to be processed. These workers are started via Forge, and when I check the worker status I get this error: FATAL Exited too quickly (process log may have details)

I've checked the logs but they are always empty. Also, there aren't any failed jobs saved to the database.

What's really odd is that if I manually restart the worker in Forge, it will process maybe 10-20 jobs but then quite again given the same error. I can keep manually restarting the queue until all the jobs are processed.

It only stops when trying to run certain jobs. These jobs run without any errors, so I'm not sure why they are causing problems, they just seem to cause the worker to stop.

The only thing I can think of is they are causing a memory leak which stops the worker, but shouldn't supervisor restart the queue worker automatically since these are set up with Forge?

Does anyone have any ideas what causes this?

Thanks!

(edit) I should note that I'm running the worker as a daemon.