Importing large CSV files using cron jobs in Laravel

Question

I'm using Laravel 8 and I want to update billions of product prices. I added this code and it worked fine but it was not efficient and it increased the load on the server .

try {
        $priceCsvs = PriceCsv::whereStatus(PriceCsv::PENDING)->get();
        foreach ($priceCsvs as $price) {
            dump($price->name." is started");
            $csvData = fopen($price->file_url, 'r');
            $firstline = true;
            while (($data = fgetcsv($csvData, 555, ',')) !== false) {
                if (!$firstline && !empty($data)) {
                    dump($data);
                }
                $firstline = false;
            }
            fclose($csvData);
            dump($price->name." is End");
        }
   } catch (\Exception $ex) {
        dump($ex->getMessage());
   }

The point is: Is there a way to get the input from a CSV file or any other file Add sleep after 1000 timesWhat works.

Answer 1

If you are looking for a placement job, check out

Task Scheduling

Basically define some console (artisan) commands and then schedule them in a console kernel file. The scheduler is run using artisan and it is recommended to run the command (define cron job) every minute. If the kernel schedule definition is consistent with the minute the "php artisan Schedule:work" command is run, then your job will execute.