How to solve the problem of not being able to upload files above 48MB when uploading video tiles using JS, PHP and Apache?

Breakthrough 48MB limit: JS, PHP and Apache video slicing upload solutions

In small project development, handling large file uploads often encounter challenges. This article will share a practical case: how to overcome the 48MB file size limit when uploading video slicing using JavaScript, PHP and Apache.

Problem: 48MB upload bottleneck

The project adopts a slice upload scheme, which theoretically supports 2GB files, 1MB per slice, and up to 2,000 pieces. However, in actual tests, after uploading more than 48MB (about 48 pieces), subsequent requests return 500 errors. Even if the slice size is resized to 10MB, the problem persists.

Code analysis and improvement

JavaScript code:

In the original code, FormData object was initialized only once, resulting in each request carrying all uploaded slice data, which ultimately exceeded Apache's fcgidmaxrequestlen limit.

The improved JavaScript code is as follows. The key is to re-instrate FormData object before each request is sent:

 function videoFileUpload() {
    const LENGTH = 1024 * 1024; // 1MB
    let start = 0;
    let end = start LENGTH;
    let blob_num = 1;
    let is_stop = 0;

    this.start = function () {
        const file = files.files[0];
        const blob = cutFile(file);
        sendFile(blob, file);
        blob_num ;
    }

    // ... (The rest of the code remains the same) ...

    function sendFile(blob, file) {
        if (is_stop === 0) {
            const xhr = new XMLHttpRequest();
            const form_data = new FormData(); // Key: Reinstand FormData every time

            const total_blob_num = Math.ceil(file.size / LENGTH);
            form_data.append('file', blob);
            form_data.append('blob_num', blob_num);
            form_data.append('total_blob_num', total_blob_num);
            form_data.append('file_name', file.name);

            xhr.open('POST', '/upload.php', false);
            // ... (The rest of the code remains the same) ...
        }
    }

    // ... (The rest of the code remains the same) ...
}

PHP code:

File merging logic in PHP code may also have memory efficiency issues. For oversized files, streaming is recommended to avoid reading all slices into memory at once. (The PHP code is omitted here because the original code does not provide obvious memory leaks or efficiency issues, and the focus of improvement is on the JS side)

Solution Summary

The core of the problem lies in the reuse of FormData objects in JavaScript code. By reinstaging the FormData object before each request, data accumulation is avoided, thus solving the 48MB upload limit. For the PHP side, if memory problems occur when processing large files, you need to further optimize the file merging logic and adopt streaming processing. This improvement solution effectively solves the problem of large file uploads and ensures the stability and reliability of video slicing uploads.

The above is the detailed content of How to solve the problem of not being able to upload files above 48MB when uploading video tiles using JS, PHP and Apache?. For more information, please follow other related articles on the PHP Chinese website!