search
HomeDatabaseMysql TutorialHow to Batch Import Multiple CSV Files into a MySQL Database?

How to Batch Import Multiple CSV Files into a MySQL Database?

Batch Import Multiple CSV Files into a MySQL Database

Importing individual CSV files into a MySQL database can be a tedious and time-consuming task, especially when dealing with a large number of files. This issue is particularly prevalent for users with limited time or access to automated tools.

The Solution: A Shell Script for Batch Import

To address this challenge, a straightforward solution is to utilize a shell script that automates the import process for multiple CSV files. Here's a sample shell script that can be used to import CSV files into a MySQL database:

#!/usr/bin/env bash
cd yourdirectory
for f in *.csv
do
        mysql -e "USE yourDatabase LOAD DATA LOCAL INFILE '"$f"'INTO TABLE yourtable"
done

Explanation

This script performs the following actions:

  1. Change directory to the folder containing the CSV files.
  2. Iterates through each CSV file with the *.csv wildcard.
  3. For each CSV file, executes the MySQL command using the LOAD DATA LOCAL INFILE statement to import the data into a specific database and table.

Usage

To use the shell script, follow these steps:

  1. Save the script to a file, such as import_csv_files.sh.
  2. Edit the script to replace "yourdirectory" with the path to the directory containing the CSV files.
  3. Replace "yourDatabase" with the name of the database you want to import the data into.
  4. Replace "yourtable" with the name of the table you want to create or update with the CSV data.
  5. Run the script by executing sh import_csv_files.sh from your terminal or command line.

This method effectively automates the import process and eliminates the need for manual operations, saving you significant time and effort.

The above is the detailed content of How to Batch Import Multiple CSV Files into a MySQL Database?. For more information, please follow other related articles on the PHP Chinese website!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
MySQL: What character sets are available for string data types?MySQL: What character sets are available for string data types?May 10, 2025 am 12:07 AM

MySQLoffersvariouscharactersetsforstringdatatypes:1)latin1forWesternEuropeanlanguages,2)utf8formultilingualsupport,3)utf8mb4forextendedUnicodeincludingemojis,4)ucs2forfixed-widthencoding,and5)asciiforbasicLatin.Choosingtherightsetensuresdataintegrity

MySQL: Streaming of BLOBS is better than storing them?MySQL: Streaming of BLOBS is better than storing them?May 10, 2025 am 12:06 AM

Streaming BLOBs is indeed better than direct storage because it reduces memory usage and improves performance. 1) By gradually reading and processing files, database bloat and performance degradation are avoided. 2) Streaming requires more complex code logic and may increase the number of I/O operations.

MySQL String Types: Storage, Performance, and Best PracticesMySQL String Types: Storage, Performance, and Best PracticesMay 10, 2025 am 12:02 AM

MySQLstringtypesimpactstorageandperformanceasfollows:1)CHARisfixed-length,alwaysusingthesamestoragespace,whichcanbefasterbutlessspace-efficient.2)VARCHARisvariable-length,morespace-efficientbutpotentiallyslower.3)TEXTisforlargetext,storedoutsiderows,

Understanding MySQL String Types: VARCHAR, TEXT, CHAR, and MoreUnderstanding MySQL String Types: VARCHAR, TEXT, CHAR, and MoreMay 10, 2025 am 12:02 AM

MySQLstringtypesincludeVARCHAR,TEXT,CHAR,ENUM,andSET.1)VARCHARisversatileforvariable-lengthstringsuptoaspecifiedlimit.2)TEXTisidealforlargetextstoragewithoutadefinedlength.3)CHARisfixed-length,suitableforconsistentdatalikecodes.4)ENUMenforcesdatainte

What are the String Data Types in MySQL?What are the String Data Types in MySQL?May 10, 2025 am 12:01 AM

MySQLoffersvariousstringdatatypes:1)CHARforfixed-lengthstrings,2)VARCHARforvariable-lengthtext,3)BINARYandVARBINARYforbinarydata,4)BLOBandTEXTforlargedata,and5)ENUMandSETforcontrolledinput.Eachtypehasspecificusesandperformancecharacteristics,sochoose

How to Grant Permissions to New MySQL UsersHow to Grant Permissions to New MySQL UsersMay 09, 2025 am 12:16 AM

TograntpermissionstonewMySQLusers,followthesesteps:1)AccessMySQLasauserwithsufficientprivileges,2)CreateanewuserwiththeCREATEUSERcommand,3)UsetheGRANTcommandtospecifypermissionslikeSELECT,INSERT,UPDATE,orALLPRIVILEGESonspecificdatabasesortables,and4)

How to Add Users in MySQL: A Step-by-Step GuideHow to Add Users in MySQL: A Step-by-Step GuideMay 09, 2025 am 12:14 AM

ToaddusersinMySQLeffectivelyandsecurely,followthesesteps:1)UsetheCREATEUSERstatementtoaddanewuser,specifyingthehostandastrongpassword.2)GrantnecessaryprivilegesusingtheGRANTstatement,adheringtotheprincipleofleastprivilege.3)Implementsecuritymeasuresl

MySQL: Adding a new user with complex permissionsMySQL: Adding a new user with complex permissionsMay 09, 2025 am 12:09 AM

ToaddanewuserwithcomplexpermissionsinMySQL,followthesesteps:1)CreatetheuserwithCREATEUSER'newuser'@'localhost'IDENTIFIEDBY'password';.2)Grantreadaccesstoalltablesin'mydatabase'withGRANTSELECTONmydatabase.TO'newuser'@'localhost';.3)Grantwriteaccessto'

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

ZendStudio 13.5.1 Mac

ZendStudio 13.5.1 Mac

Powerful PHP integrated development environment