What's the best approach for handling large data import?

Been discussed many times stored procedure outside of PHP directly in my SQL.

Things you need to do

• use raw sql instead of eloquent, much faster when processing large data
• fetch the total rows / 5000 per array set = total loops + 1 (it is up to you, 5000 is minimal, it is up to your query logic too, most probably to maximize the default memory allocated.)
• use for loop to do that
  • run the logic in the loop
  • unset/null the index from the 5000 set, like a russian doll
  • if you need to store the essentials for later process, you could store it as json data in your temp database table, or store it in your cache (redis)

$limit = 5000;
$loopCount = ($totalRows / $limit) + 1;
for ($i = 1; $i <= $loopCount; $i++) {
    // todo: sql query using ( ($i > 1 ?:  0) * $limit) as offset, and limit by $limit

    if (!count($queried)) continue;

    foreach ($queried as $idx => $val) {
        // ...
        unset($queried[$idx]);
    }
}