search
HomeDatabaseMysql Tutorial[MySQL优化]为MySQL数据文件ibdata1瘦身

[MySQL优化]为MySQL数据文件ibdata1瘦身

Jun 07, 2016 pm 03:01 PM
mysqloptimizationdatadocumentlose weight

系统环境 发现问题 解决问题 1. 系统环境 Linux Ubuntu 13.04 64bit server ~ uname -aLinux d2 3.8.0-21-generic #32-Ubuntu SMP Tue May 14 22:16:46 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux~ cat /etc/issueUbuntu 13.04 \n \l MySQL: 5.5.31-0ubuntu0.

  1. 系统环境
  2. 发现问题
  3. 解决问题

1. 系统环境

Linux Ubuntu 13.04 64bit server

<code>~ uname -a
Linux d2 3.8.0-21-generic #32-Ubuntu SMP Tue May 14 22:16:46 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
~ cat /etc/issue
Ubuntu 13.04 \n \l
</code>

MySQL: 5.5.31-0ubuntu0.13.04.1

<code>~ mysql --version
mysql  Ver 14.14 Distrib 5.5.31, for debian-linux-gnu (x86_64) using readline 6.2
</code>

硬盘:36G+4G+4G+36G

<code>~ df -h
Filesystem                    Size  Used Avail Use% Mounted on
/dev/mapper/server3--vg-root   36G   31G  3.2G  91% /
none                          4.0K     0  4.0K   0% /sys/fs/cgroup
udev                          4.1G  1.1G  3.0G  26% /dev
tmpfs                         824M  280K  823M   1% /run
none                          5.0M     0  5.0M   0% /run/lock
none                          4.1G  3.4G  729M  83% /run/shm
none                          100M     0  100M   0% /run/user
/dev/vda1                     228M   30M  187M  14% /boot
192.168.1.10:/home/amg/data    36G   13G   21G  39% /home/amg/data
</code>

MySQL的ibdata1占用空间:20G

<code>~ cd /var/lib/mysql
~ ls -l
drwxr-xr-x 2 mysql mysql        4096 Aug  2 19:38 CB
drwxr-xr-x 2 mysql mysql        4096 Jun 24 23:08 conan
drwxr-xr-x 2 mysql mysql        4096 Jun  2 00:52 dbwordpress
-rwxr-xr-x 1 root  root            0 May 23 00:48 debian-5.5.flag
-rwxr-xr-x 1 mysql mysql 20101201920 Aug  2 20:08 ibdata1
-rwxr-xr-x 1 mysql mysql     5242880 Aug  2 20:08 ib_logfile0
-rwxr-xr-x 1 mysql mysql     5242880 Aug  2 19:38 ib_logfile1
drwxr-xr-x 2 mysql mysql        4096 Jun 26 09:03 Macro
drwxr-xr-x 2 mysql root         4096 May 23 00:48 mysql
-rwxr-xr-x 1 root  root            6 May 23 00:48 mysql_upgrade_info
drwxr-xr-x 2 mysql mysql        4096 May 23 00:48 performance_schema
drwxr-xr-x 2 mysql mysql        4096 May 23 00:53 phpmyadmin
drwxr-xr-x 2 mysql root         4096 May 23 00:48 test
drwxr-xr-x 2 mysql mysql        4096 Jul 22 14:09 TF
drwxr-xr-x 2 mysql mysql        4096 Jun  2 01:04 wordpress
</code>

业务数据表

<code>mysql> show tables;
+-----------------+
| Tables_in_CB    |
+-----------------+
| NSpremium       |
| cb_hft          |
| cb_hft_20130801 |
| cb_hft_20130802 |
+-----------------+
4 rows in set (0.00 sec)
</code>

2. 发现问题

ibdata1单个文件占用20G大小。
1. MySQL默认设置,没有按表空间分离数据,所有的表的数据都被放到ibdata1文件中。
2. 业务操作,每天会产生一张表cb_hft,晚上的时候对表进行重命名。

<code>RENAME TABLE cb_hft TO cb_hft_20130801;
create table cb_hft like cb_hft_20130801;
</code>

3. 每周会把数据导出,同时drop表。但drop后,ibdata1不会减少,随着数据的积累ibdata1越来越大,根空间已经不够用了。

3. 解决问题

1). 导出数据
现在数据库中,有两个数据表,cb_hft_20130801,cb_hft_20130802,分别导出到/run/shm, /dev

<code>~ cd /dev
~ mysqldump -uroot -p CB cb_hft_20130802 > export_cb_hft_20130802.sql

~ cd /run/shm
~ mysqldump -uroot -p CB cb_hft_20130801 > export_cb_hft_20130801.sql

~ df -h
Filesystem                    Size  Used Avail Use% Mounted on
/dev/mapper/server3--vg-root   36G   31G  3.2G  91% /
none                          4.0K     0  4.0K   0% /sys/fs/cgroup
udev                          4.1G  3.7G  368M  92% /dev
tmpfs                         824M  280K  823M   1% /run
none                          5.0M     0  5.0M   0% /run/lock
none                          4.1G  3.4G  729M  83% /run/shm
none                          100M     0  100M   0% /run/user
/dev/vda1                     228M   30M  187M  14% /boot
192.168.1.10:/home/amg/data    36G   13G   21G  39% /home/amg/data
</code>

两张表分别占了,3.4G,3.7G。

登陆mysql删除CB数据库

<code>~ mysql -uroot -p
~ drop database CB
</code>

导出其他数据库数据

<code>~ cd /run/shm
~ mysqldump -uroot -p -R -q --all-databases > others.sql
</code>

2). 修改配置文件/etc/mysql/my.cnf
对每张表使用单独的数据文件存储innodb_file_per_table

停止mysql服务器

<code>~ sudo /etc/init.d/mysql stop

#清空所有数据文件
~ sudo rm -rf /var/lib/mysql/*
</code>

修改配置文件

<code>~ sudo vi /etc/mysql/my.cnf

[mysqld]
innodb_file_per_table
</code>

重新构建数据库实例

<code>~ /usr/bin/mysql_install_db

~ ls /var/lib/mysql
mysql  performance_schema  test

#启动MySQL
~ sudo /etc/init.d/mysql start
</code>

3). 恢复其他数据库

<code>~ mysql  show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| Macro              |
| TF                 |
| conan              |
| dbwordpress        |
| mysql              |
| performance_schema |
| phpmyadmin         |
| test               |
| wordpress          |
+--------------------+
10 rows in set (0.01 sec)

#查看ibdata1大小
~ ls -l /var/lib/mysql
drwx------ 2 mysql mysql     4096 Aug  2 21:33 CB
drwx------ 2 mysql mysql     4096 Aug  2 21:23 conan
drwx------ 2 mysql mysql     4096 Aug  2 21:23 dbwordpress
-rw-rw---- 1 mysql mysql 18874368 Aug  2 21:34 ibdata1
-rw-rw---- 1 mysql mysql  5242880 Aug  2 21:34 ib_logfile0
-rw-rw---- 1 mysql mysql  5242880 Aug  2 21:34 ib_logfile1
drwx------ 2 mysql mysql     4096 Aug  2 21:23 Macro
drwx------ 2 mysql root      4096 Aug  2 21:23 mysql
drwx------ 2 mysql mysql     4096 Aug  2 21:19 performance_schema
drwx------ 2 mysql mysql     4096 Aug  2 21:23 phpmyadmin
drwx------ 2 mysql root      4096 Aug  2 21:19 test
drwx------ 2 mysql mysql     4096 Aug  2 21:23 TF
drwx------ 2 mysql mysql     4096 Aug  2 21:23 wordpress
</code>

4). 重置root密码

<code>mysql> SET PASSWORD FOR 'root'@'localhost' = PASSWORD('123456');
mysql> FLUSH PRIVILEGES;
</code>

5). 恢复CB数据库

<code>mysql> create database CB;
Query OK, 1 row affected (0.00 sec)

~  mysql --database CB </code>

刚才设置的innodb_file_per_table参数已经起作用了,当我们再导出表drop后,对应的数据文件idb就会被删除,系统硬盘空间使用就会在正常值范围内。

查看表数据

<code>mysql> show tables;
+-----------------+
| Tables_in_CB    |
+-----------------+
| cb_hft_20130801 |
| cb_hft_20130802 |
+-----------------+
2 rows in set (0.00 sec)

mysql> select count(1) from cb_hft_20130801;
+----------+
| count(1) |
+----------+
| 21063172 |
+----------+
1 row in set (1 min 1.46 sec)

#删除表
~ drop table cb_hft_20130801;

#查看数据文件
~ ls -l /var/lib/mysql/CB
-rw-rw---- 1 mysql mysql       9928 Aug  2 22:09 cb_hft_20130802.frm
-rw-rw---- 1 mysql mysql 7805599744 Aug  2 22:38 cb_hft_20130802.ibd
-rw-rw---- 1 mysql mysql         61 Aug  2 21:30 db.opt
-rw-rw---- 1 mysql mysql       9274 Aug  2 22:52 NSpremium.frm
-rw-rw---- 1 mysql mysql      98304 Aug  2 22:53 NSpremium.ibd
</code>

drop后,数据就一起被删除了。

经过对MySQL的调优,ibdata1已经被瘦身!数据库又可以继续正常的稳定的工作了。

http://blog.fens.me/mysql-ibdata1/

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Explain the InnoDB Buffer Pool and its importance for performance.Explain the InnoDB Buffer Pool and its importance for performance.Apr 19, 2025 am 12:24 AM

InnoDBBufferPool reduces disk I/O by caching data and indexing pages, improving database performance. Its working principle includes: 1. Data reading: Read data from BufferPool; 2. Data writing: After modifying the data, write to BufferPool and refresh it to disk regularly; 3. Cache management: Use the LRU algorithm to manage cache pages; 4. Reading mechanism: Load adjacent data pages in advance. By sizing the BufferPool and using multiple instances, database performance can be optimized.

MySQL vs. Other Programming Languages: A ComparisonMySQL vs. Other Programming Languages: A ComparisonApr 19, 2025 am 12:22 AM

Compared with other programming languages, MySQL is mainly used to store and manage data, while other languages ​​such as Python, Java, and C are used for logical processing and application development. MySQL is known for its high performance, scalability and cross-platform support, suitable for data management needs, while other languages ​​have advantages in their respective fields such as data analytics, enterprise applications, and system programming.

Learning MySQL: A Step-by-Step Guide for New UsersLearning MySQL: A Step-by-Step Guide for New UsersApr 19, 2025 am 12:19 AM

MySQL is worth learning because it is a powerful open source database management system suitable for data storage, management and analysis. 1) MySQL is a relational database that uses SQL to operate data and is suitable for structured data management. 2) The SQL language is the key to interacting with MySQL and supports CRUD operations. 3) The working principle of MySQL includes client/server architecture, storage engine and query optimizer. 4) Basic usage includes creating databases and tables, and advanced usage involves joining tables using JOIN. 5) Common errors include syntax errors and permission issues, and debugging skills include checking syntax and using EXPLAIN commands. 6) Performance optimization involves the use of indexes, optimization of SQL statements and regular maintenance of databases.

MySQL: Essential Skills for Beginners to MasterMySQL: Essential Skills for Beginners to MasterApr 18, 2025 am 12:24 AM

MySQL is suitable for beginners to learn database skills. 1. Install MySQL server and client tools. 2. Understand basic SQL queries, such as SELECT. 3. Master data operations: create tables, insert, update, and delete data. 4. Learn advanced skills: subquery and window functions. 5. Debugging and optimization: Check syntax, use indexes, avoid SELECT*, and use LIMIT.

MySQL: Structured Data and Relational DatabasesMySQL: Structured Data and Relational DatabasesApr 18, 2025 am 12:22 AM

MySQL efficiently manages structured data through table structure and SQL query, and implements inter-table relationships through foreign keys. 1. Define the data format and type when creating a table. 2. Use foreign keys to establish relationships between tables. 3. Improve performance through indexing and query optimization. 4. Regularly backup and monitor databases to ensure data security and performance optimization.

MySQL: Key Features and Capabilities ExplainedMySQL: Key Features and Capabilities ExplainedApr 18, 2025 am 12:17 AM

MySQL is an open source relational database management system that is widely used in Web development. Its key features include: 1. Supports multiple storage engines, such as InnoDB and MyISAM, suitable for different scenarios; 2. Provides master-slave replication functions to facilitate load balancing and data backup; 3. Improve query efficiency through query optimization and index use.

The Purpose of SQL: Interacting with MySQL DatabasesThe Purpose of SQL: Interacting with MySQL DatabasesApr 18, 2025 am 12:12 AM

SQL is used to interact with MySQL database to realize data addition, deletion, modification, inspection and database design. 1) SQL performs data operations through SELECT, INSERT, UPDATE, DELETE statements; 2) Use CREATE, ALTER, DROP statements for database design and management; 3) Complex queries and data analysis are implemented through SQL to improve business decision-making efficiency.

MySQL for Beginners: Getting Started with Database ManagementMySQL for Beginners: Getting Started with Database ManagementApr 18, 2025 am 12:10 AM

The basic operations of MySQL include creating databases, tables, and using SQL to perform CRUD operations on data. 1. Create a database: CREATEDATABASEmy_first_db; 2. Create a table: CREATETABLEbooks(idINTAUTO_INCREMENTPRIMARYKEY, titleVARCHAR(100)NOTNULL, authorVARCHAR(100)NOTNULL, published_yearINT); 3. Insert data: INSERTINTObooks(title, author, published_year)VA

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.