python - How to solve the problem when the browser is half stuck when exporting excel with more than 10,000 items?

Question

Business requirements sometimes require tens of thousands of items to be exported.
Can I use python to process it?? It’s too stuck.
What if I use python to process it?

Answer 1

More than 10,000 items are not a lot. You can use the third-party library PHPExcel. Or directly export csv, function: fputcsv .

Answer 2

If you want to export, just export it directly to CVS mode.

Answer 3

You don’t need to export it all at once. Export in batches

Answer 4

Time-consuming server tasks like this should not be designed as Browser->Sync->Server;
should be in the form of asynchronous tasks:

1. Browser: I want an Excel, please generate it for me first

2. Server: OK, the mission has started

3. Browser: Let me refresh it and see (you can use a long connection instead), it seems to be completed. Give me the URL (URL can be reflected in the task, no need to obtain it again), I want to download it

4. Server: http://domain.com/test.xlsx

5. Browser: Start download

Answer 5

Isn’t it enough to have more than 10,000 entries? How big is the file?

Answer 6

You can make the generation segmented... write 1000 items in 1000 items.
In addition, if php times out, you can change set_time_limit()

Answer 7

Asynchronous, all export operations should be made asynchronous

Answer 8

Written in paging, for example, refresh once every 1000 items

Answer 9

Use the script to run, php -f export.php

Answer 10

Use asynchronous or multi-process, the browser submits the task, prompting that the task is being processed, the background multi-process script slowly processes it, and when it is completed, it pushes a message to the browser to prompt the user that the export operation has been completed and can be downloaded.
Browser push message: http://www.workerman.net/web-...
Multi-process framework: http://doc3.workerman.net/ins...