search
HomeDatabaseMysql Tutorialcsv批量导入mysql命令_MySQL

今天把从Kaggle上下载下来的csv数据导入mysql,想做个统计分析,怎奈csv文件有些大,所以只能用mysql 命令导入,现mark下,以备以后不时之需:

1. 导入:

<code class="language-mysql hljs sql">基本语法:
load data [low_priority] [local] infile &#39;file_name txt&#39; [replace | ignore]
into table tbl_name
[character set gbk]
[fields
[terminated by&#39;t&#39;]
[OPTIONALLY] enclosed by &#39;&#39;]
[escaped by&#39;\&#39; ]]
[lines terminated by&#39;n&#39;]
[ignore number lines]
[(col_name, )]
</code>

导入命令_example:

<code class="language-mysql hljs sql"><code class="language-mysql hljs sql">load data infile &#39;csv文件路径\\test.csv&#39; 
replace into table 表名              
fields terminated by &#39;,&#39; 
optionally enclosed by &#39;"&#39; 
lines terminated by &#39;\n&#39; 
ignore 1 lines(Id,@dummy,DayOfWeek,PdDistrict,Address,X,Y);</code></code>

<code class="language-mysql hljs sql">不要小看这个简单的example,包含了很多东西;

<code class="language-mysql hljs sql">第一行就是导入文件;

<code class="language-mysql hljs sql">第二行参看语法就会发现有两个词:replace 和 ignore 。<strong>replace</strong>和<strong>ignore</strong>关键词控制对现有的唯一键记录的重复的处理。如果你指定<strong>replace</strong>,新行将代替有相同的唯一键值的现有行。如果你指定<strong>ignore</strong>,跳过有唯一键的现有行的重复行的输入。如果你不指定任何一个选项,当找到重复键时,出现一个错误,并且文本文件的余下部分被忽略。<br> 所以我觉得现实情况下你的表设计主键,还是最好要不会重复的字段;

<code class="language-mysql hljs sql">第三~四行很简单就是每个具体字段内容之间是以逗号隔开的,那就以逗号分开。<br> erminated by描述字段的分隔符,默认情况下是tab字符(\t)<br> enclosed by描述的是字段的括起字符,就是说字段中如果有引号,就当做是字段的一部分。<br> 语法中还有一个是 escaped by, 它描述的是转义字符。默认的是反斜杠(backslash:\ )

<code class="language-mysql hljs sql">第五行 lines terminated by是对每行进行分割,这里要注意一个问题,如果csv文件是在windows下生成,那分割用 ‘\r\n’,linux下用 ‘\n’。

<code class="language-mysql hljs sql">第六行中 ignore 1 lines 是忽略第一行,因为第一行往往是字段名,后边括号中有个字段很特别 @dummy,它是说如果csv文件中有个字段我不想插进去,那就把对应字段名变成@dummy。

<code class="language-mysql hljs sql"><strong><em>PS:想顺便插入导入时间,就在最后加上set update_time=current_timestamp;</em></strong>

<code class="language-mysql hljs sql"><strong>2. 导出:</strong>

<code class="language-mysql hljs sql">同时附带上导出命令:

<code class="language-mysql hljs sql"><code class="language-mysql hljs sql"><code class="hljs sql">select * from 表名
into outfile &#39;导出路径\\test.csv&#39; 
fields terminated by &#39;,&#39; 
optionally enclosed by &#39;"&#39; 
escaped by &#39;"&#39; 
lines terminated by &#39;\n&#39;; </code></code></code>

<code class="language-mysql hljs sql"><code class="hljs sql">希望多多交流!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
What are stored procedures in MySQL?What are stored procedures in MySQL?May 01, 2025 am 12:27 AM

Stored procedures are precompiled SQL statements in MySQL for improving performance and simplifying complex operations. 1. Improve performance: After the first compilation, subsequent calls do not need to be recompiled. 2. Improve security: Restrict data table access through permission control. 3. Simplify complex operations: combine multiple SQL statements to simplify application layer logic.

How does query caching work in MySQL?How does query caching work in MySQL?May 01, 2025 am 12:26 AM

The working principle of MySQL query cache is to store the results of SELECT query, and when the same query is executed again, the cached results are directly returned. 1) Query cache improves database reading performance and finds cached results through hash values. 2) Simple configuration, set query_cache_type and query_cache_size in MySQL configuration file. 3) Use the SQL_NO_CACHE keyword to disable the cache of specific queries. 4) In high-frequency update environments, query cache may cause performance bottlenecks and needs to be optimized for use through monitoring and adjustment of parameters.

What are the advantages of using MySQL over other relational databases?What are the advantages of using MySQL over other relational databases?May 01, 2025 am 12:18 AM

The reasons why MySQL is widely used in various projects include: 1. High performance and scalability, supporting multiple storage engines; 2. Easy to use and maintain, simple configuration and rich tools; 3. Rich ecosystem, attracting a large number of community and third-party tool support; 4. Cross-platform support, suitable for multiple operating systems.

How do you handle database upgrades in MySQL?How do you handle database upgrades in MySQL?Apr 30, 2025 am 12:28 AM

The steps for upgrading MySQL database include: 1. Backup the database, 2. Stop the current MySQL service, 3. Install the new version of MySQL, 4. Start the new version of MySQL service, 5. Recover the database. Compatibility issues are required during the upgrade process, and advanced tools such as PerconaToolkit can be used for testing and optimization.

What are the different backup strategies you can use for MySQL?What are the different backup strategies you can use for MySQL?Apr 30, 2025 am 12:28 AM

MySQL backup policies include logical backup, physical backup, incremental backup, replication-based backup, and cloud backup. 1. Logical backup uses mysqldump to export database structure and data, which is suitable for small databases and version migrations. 2. Physical backups are fast and comprehensive by copying data files, but require database consistency. 3. Incremental backup uses binary logging to record changes, which is suitable for large databases. 4. Replication-based backup reduces the impact on the production system by backing up from the server. 5. Cloud backups such as AmazonRDS provide automation solutions, but costs and control need to be considered. When selecting a policy, database size, downtime tolerance, recovery time, and recovery point goals should be considered.

What is MySQL clustering?What is MySQL clustering?Apr 30, 2025 am 12:28 AM

MySQLclusteringenhancesdatabaserobustnessandscalabilitybydistributingdataacrossmultiplenodes.ItusestheNDBenginefordatareplicationandfaulttolerance,ensuringhighavailability.Setupinvolvesconfiguringmanagement,data,andSQLnodes,withcarefulmonitoringandpe

How do you optimize database schema design for performance in MySQL?How do you optimize database schema design for performance in MySQL?Apr 30, 2025 am 12:27 AM

Optimizing database schema design in MySQL can improve performance through the following steps: 1. Index optimization: Create indexes on common query columns, balancing the overhead of query and inserting updates. 2. Table structure optimization: Reduce data redundancy through normalization or anti-normalization and improve access efficiency. 3. Data type selection: Use appropriate data types, such as INT instead of VARCHAR, to reduce storage space. 4. Partitioning and sub-table: For large data volumes, use partitioning and sub-table to disperse data to improve query and maintenance efficiency.

How can you optimize MySQL performance?How can you optimize MySQL performance?Apr 30, 2025 am 12:26 AM

TooptimizeMySQLperformance,followthesesteps:1)Implementproperindexingtospeedupqueries,2)UseEXPLAINtoanalyzeandoptimizequeryperformance,3)Adjustserverconfigurationsettingslikeinnodb_buffer_pool_sizeandmax_connections,4)Usepartitioningforlargetablestoi

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment