jucan's avatar
Level 1

Job of large data using redis queue_connection not working

I have this system that filters data using date range for export using queues (Laravel jobs). For small date range i.e one month the jobs are woking fine in generating the reports. My problem come with trying to get data for more than 3 months. The Job is not getting executed.

Please help

0 likes
9 replies
jucan's avatar
Level 1

@silencebringer the retry is already set to 120. Running php artisan queue:work --timeout=60 nothing shows. Just a silent terminal

jucan's avatar
Level 1

@silencebringer also horizon shows nothing ie. php artisan horizon. It only indicates Horizon started successfully and stops at that point

SilenceBringer's avatar

@jucan can you show your job and how you call it? do you use dispatch?

start the horizon and re-run your job again

jucan's avatar
Level 1

@silencebringer, yes, it using dispatch. After following your guide "[2021-05-25 15:00:58][2dee4fd1-cb79-4271-a46e-f7626a1659f3] Processing: App\Jobs\ReportGeneratingJob"

Nothing is processed, shows the job as in processing stage

Please not that fo less than a month date range all is okay. Problem come with a big date range i.e 3 months upwards

jucan's avatar
Level 1

@silencebringer this is the error for the failed job

 Illuminate\Queue\MaxAttemptsExceededException: App\Jobs\ReportGeneratingJob has been attempted too many times or run too long. The job may have previously timed out. in /var/www/quete/vendor/laravel/framework/src/Illuminate/Queue/Worker.php:713+| {"uuid":"cf9dd7f6-60b5-409a-b450-2e282f47ffcc","timeout":null,"tags":{},"id":"cf9dd7f6-60b5-409a-b450-2e282f47ffcc","backoff":null,"displayName":"App\Jobs\ReportGeneratingJob","maxTries":null,"pushedAt":"1621945772.8705","job":"Illuminate\Queue\CallQueuedHandler@call","data":{"command":"O:28:\"App\Jobs\ReportGeneratingJob\":13:{s:32:\"\u0000App\Jobs\ReportGeneratingJob\u0000id\";s:36:\"09f19472-52a5-4eb6-a582-c13fdec6c2cf\";s:39:\"\u0000App\Jobs\ReportGeneratingJob\u0000from_date\";s:10:\"2021-01-01\";s:37:\"\u0000App\Jobs\ReportGeneratingJob\u0000to_date\";s:10:\"2021-05-25\";s:3:\"job\";N;s:10:\"connection\";N;s:5:\"queue\";s:7:\"reports\";s:15:\"chainConnection\";N;s:10:\"chainQueue\";N;s:19:\"chainCatchCallbacks\";N;s:5:\"delay\";i:2;s:11:\"afterCommit\";N;s:10:\"middleware\";a:0:{}s:7:\"chained\";a:0:{}}","commandName":"App\Jobs\ReportGeneratingJob"},"retryUntil":null,"maxExceptions":null,"type":"job","attempts":2}
jucan's avatar
Level 1

@silencebringer getting the same timeout error as above\

 Illuminate\Queue\MaxAttemptsExceededException: App\Jobs\ReportGeneratingJob has been attempted too many times or run too long. The job may have previously timed out. in /var/www/quete/vendor/laravel/framework/src/Illuminate/Queue/Worker.php:713+| {"uuid":"cf9dd7f6-60b5-409a-b450-2e282f47ffcc","timeout":null,"tags":{},"id":"cf9dd7f6-60b5-409a-b450-2e282f47ffcc","backoff":null,"displayName":"App\Jobs\ReportGeneratingJob","maxTries":null,"pushedAt":"1621945772.8705","job":"Illuminate\Queue\CallQueuedHandler@call","data":{"command":"O:28:\"App\Jobs\ReportGeneratingJob\":13:{s:32:\"\u0000App\Jobs\ReportGeneratingJob\u0000id\";s:36:\"09f19472-52a5-4eb6-a582-c13fdec6c2cf\";s:39:\"\u0000App\Jobs\ReportGeneratingJob\u0000from_date\";s:10:\"2021-01-01\";s:37:\"\u0000App\Jobs\ReportGeneratingJob\u0000to_date\";s:10:\"2021-05-25\";s:3:\"job\";N;s:10:\"connection\";N;s:5:\"queue\";s:7:\"reports\";s:15:\"chainConnection\";N;s:10:\"chainQueue\";N;s:19:\"chainCatchCallbacks\";N;s:5:\"delay\";i:2;s:11:\"afterCommit\";N;s:10:\"middleware\";a:0:{}s:7:\"chained\";a:0:{}}","commandName":"App\Jobs\ReportGeneratingJob"},"retryUntil":null,"maxExceptions":null,"type":"job","attempts":2}

Please or to participate in this conversation.