search
HomeDatabaseMysql TutorialMySQL导入导出以及性能测试

最近做了MySQL的相关测试,包括备份数据的导入导出、压力测试等,因为数据量比较大,每次测试等待时间很长,所以自己动手写了相关

最近做了MySQL的相关测试,包括备份数据的导入导出、压力测试等,因为数据量比较大,每次测试等待时间很长,所以自己动手写了相关测试脚本,直接放后台screen运行即可:import.sh、dump.sh,需要读者对screen、mysqldump、tee等命令比较熟悉,screen的话可以参考我写的一篇关于screen的文章:,另外两个命令读者就在网上搜罗吧^_^,如有疑问可以联系我(QQ:349871740)。

我的mysqld启动方式如下:
/usr/local/mysql5/bin/mysqld_safe --defaults-file=/usr/local/mysql5/etc/innodb.cnf --datadir=/data1/mysql5/data/ --user=mysql &

以下是mysqldump出来的文件大小:
[root@localhost data1]# du -sh /data2/6_ddb_201204260120
47G     /data2/6_ddb_201204260120

导入数据库之后:
[root@localhost mysql5]# du -sh data/
72G     data/

以下是我的脚本具体内容:
[root@localhost data1]# more import.sh
::::::::::::::
import.sh
::::::::::::::
#!bin/bash

DIR=/data/script/db_back/
DIST=6
DDB=${DIST}_ddb_
MYSQL_BIN=/usr/local/mysql5/bin/

cd ${DIR}
if [ $? -eq 0 ] ; then
echo "`date -d today "+%Y-%m-%d %H:%M:%S"` Import Game Start!" | tee -a import.log
TIME=`date -d today +%Y%m%d%H%M`
#{ /usr/bin/time ${mysql} ddb >import.log
{ /usr/bin/time ${MYSQL_BIN}mysql ddb &1 | tee -a import.log
echo -e "`date -d today "+%Y-%m-%d %H:%M:%S"` Import Game Over!\n" | tee -a import.log
sleep 300
fi
::::::::::::::
dump.sh
::::::::::::::
#!/bin/sh

DIR=/data/script/db_back/
DIST=6
DDB=${DIST}_ddb_
MYSQL_BIN=/usr/local/mysql5/bin/
cd ${DIR}
if [ $? -eq 0 ] ; then
echo "`date -d today "+%Y-%m-%d %H:%M:%S"` Game Start!" | tee -a dump.log
TIME=`date -d today +%Y%m%d%H%M`
#{ /usr/bin/time ${MYSQL_BIN}mysqldump -Q -e -a -q --no-autocommit --single-transaction ddb | bzip2 -2 > ${DIST}_ddb_${TIME}.bz2; } 2>>dump.log
{ /usr/bin/time ${MYSQL_BIN}mysqldump -Q -e -a -q --no-autocommit --single-transaction ddb | bzip2 -2 > ${DIST}_ddb_${TIME}.bz2; } 2>&1 | tee -a dump.log
echo -e "`date -d today "+%Y-%m-%d %H:%M:%S"` Game Over!\n" | tee -a dump.log
sleep 300
rm -f ${DIST}_ddb_${TIME}.bz2
sleep 30
fi
[root@localhost data1]#

然后用下面的命令对导入和导出各测试10次,这两个测试跑完总时间用了5天左右,但是我是在业余时间做的测试,,所以前后时间间隔很长,后面还有压力测试,例如:mysqlslap,sql_bench等,随后附上。
[root@localhost data1]# for i in $(seq 10); do sh dump.sh ;done
[root@localhost data1]# for i in $(seq 10); do sh import.sh ;done

脚本中将测试结果输出到文本中,截取部分内容:
[root@localhost db_back]# tail -10 dump.log     
2012-05-11 15:24:09 Game Start!
1147.64user 265.25system 45:49.79elapsed 51%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (1major+330minor)pagefaults 0swaps
2012-05-11 16:09:59 Game Over!

2012-05-11 16:55:24 Game Start!
1149.02user 266.73system 44:25.40elapsed 53%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (4major+314minor)pagefaults 0swaps
2012-05-11 17:39:49 Game Over!

[root@localhost db_back]# tail -10 import.log
2012-05-07 02:29:26 Import Game Start!
1149.62user 67.70system 2:41:43elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (7major+1089minor)pagefaults 0swaps
2012-05-07 05:11:09 Import Game Over!

2012-05-07 05:16:09 Import Game Start!
1149.78user 66.98system 2:41:45elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (7major+1089minor)pagefaults 0swaps
2012-05-07 07:57:54 Import Game Over!

这次测试模拟线上服务器的真实环境,所以测试还是比较准确的,如果读者有类似环境,可以拿去加以修改应用,希望对读者有所帮助,测试过程中也能学习到很多拓展知识,需要我们去花大量的时间、精力去做。

linux

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
MySQL: BLOB and other no-sql storage, what are the differences?MySQL: BLOB and other no-sql storage, what are the differences?May 13, 2025 am 12:14 AM

MySQL'sBLOBissuitableforstoringbinarydatawithinarelationaldatabase,whileNoSQLoptionslikeMongoDB,Redis,andCassandraofferflexible,scalablesolutionsforunstructureddata.BLOBissimplerbutcanslowdownperformancewithlargedata;NoSQLprovidesbetterscalabilityand

MySQL Add User: Syntax, Options, and Security Best PracticesMySQL Add User: Syntax, Options, and Security Best PracticesMay 13, 2025 am 12:12 AM

ToaddauserinMySQL,use:CREATEUSER'username'@'host'IDENTIFIEDBY'password';Here'showtodoitsecurely:1)Choosethehostcarefullytocontrolaccess.2)SetresourcelimitswithoptionslikeMAX_QUERIES_PER_HOUR.3)Usestrong,uniquepasswords.4)EnforceSSL/TLSconnectionswith

MySQL: How to avoid String Data Types common mistakes?MySQL: How to avoid String Data Types common mistakes?May 13, 2025 am 12:09 AM

ToavoidcommonmistakeswithstringdatatypesinMySQL,understandstringtypenuances,choosetherighttype,andmanageencodingandcollationsettingseffectively.1)UseCHARforfixed-lengthstrings,VARCHARforvariable-length,andTEXT/BLOBforlargerdata.2)Setcorrectcharacters

MySQL: String Data Types and ENUMs?MySQL: String Data Types and ENUMs?May 13, 2025 am 12:05 AM

MySQloffersechar, Varchar, text, Anddenumforstringdata.usecharforfixed-Lengthstrings, VarcharerForvariable-Length, text forlarger text, AndenumforenforcingdataAntegritywithaetofvalues.

MySQL BLOB: how to optimize BLOBs requestsMySQL BLOB: how to optimize BLOBs requestsMay 13, 2025 am 12:03 AM

Optimizing MySQLBLOB requests can be done through the following strategies: 1. Reduce the frequency of BLOB query, use independent requests or delay loading; 2. Select the appropriate BLOB type (such as TINYBLOB); 3. Separate the BLOB data into separate tables; 4. Compress the BLOB data at the application layer; 5. Index the BLOB metadata. These methods can effectively improve performance by combining monitoring, caching and data sharding in actual applications.

Adding Users to MySQL: The Complete TutorialAdding Users to MySQL: The Complete TutorialMay 12, 2025 am 12:14 AM

Mastering the method of adding MySQL users is crucial for database administrators and developers because it ensures the security and access control of the database. 1) Create a new user using the CREATEUSER command, 2) Assign permissions through the GRANT command, 3) Use FLUSHPRIVILEGES to ensure permissions take effect, 4) Regularly audit and clean user accounts to maintain performance and security.

Mastering MySQL String Data Types: VARCHAR vs. TEXT vs. CHARMastering MySQL String Data Types: VARCHAR vs. TEXT vs. CHARMay 12, 2025 am 12:12 AM

ChooseCHARforfixed-lengthdata,VARCHARforvariable-lengthdata,andTEXTforlargetextfields.1)CHARisefficientforconsistent-lengthdatalikecodes.2)VARCHARsuitsvariable-lengthdatalikenames,balancingflexibilityandperformance.3)TEXTisidealforlargetextslikeartic

MySQL: String Data Types and Indexing: Best PracticesMySQL: String Data Types and Indexing: Best PracticesMay 12, 2025 am 12:11 AM

Best practices for handling string data types and indexes in MySQL include: 1) Selecting the appropriate string type, such as CHAR for fixed length, VARCHAR for variable length, and TEXT for large text; 2) Be cautious in indexing, avoid over-indexing, and create indexes for common queries; 3) Use prefix indexes and full-text indexes to optimize long string searches; 4) Regularly monitor and optimize indexes to keep indexes small and efficient. Through these methods, we can balance read and write performance and improve database efficiency.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

SublimeText3 English version

SublimeText3 English version

Recommended: Win version, supports code prompts!

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

Atom editor mac version download

Atom editor mac version download

The most popular open source editor