bitsCN.com
Linux HugePages及MySQL大页配置
㈠ HugePages简介
HugePages是kernel 2.6引入以便适应越来越大的物理内存
在Linux下、page size默认是4K、如果使用HugePages、默认是2M
再看2个术语:
page table 映射表:物理内存和swap的对应关系、访问内存是先读page table、根据表里的映射关系操作
TLB :cpu cache组件、缓存部分page table以提高转换速度
㈡ MySQL 配置大页
好处
① 提高TLB的命中率
② 利用HugePages不会被Swap 的特性保证MySQL内存不会被交换到Swap中
目前在MySQL中HugePages只被InnoDB所支持
以下简单介绍其配置流程
⑴ 配置前:[plain] [root@cdio ~]# cat /proc/meminfo | grep -i huge HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 Hugepagesize: 2048 kB ⑵ 设置大页数量、每页通常2M、20个就40M、系统要有足够的内存待分配[plain] [root@obe11g ~]# echo 20 > /proc/sys/vm/nr_hugepages ⑶ 增加最大共享内存段的大小、本例12G[plain] [root@obe11g ~]# echo 1560281088 > /proc/sys/kernel/shmmax ⑷ 增加共享内存的大小、每页4K[plain] [root@obe11g ~]# echo 4194304 > /proc/sys/kernel/shmall ⑸ 将mysql用户所属组添加到系统内核中[plain] [root@obe11g ~]# more /proc/sys/vm/hugetlb_shm_group 0 [root@obe11g ~]# id mysql uid=501(mysql) gid=501(dba) groups=501(dba) [root@obe11g ~]# echo 501 > /proc/sys/vm/hugetlb_shm_group ⑹ 再次确认配置情况[plain] [root@obe11g ~]# cat /proc/meminfo | grep -i huge HugePages_Total: 20 HugePages_Free: 20 Hugepagesize: 4096 kB ⑺ 设置max locked memory[plain] [root@obe11g ~]# cat /etc/security/limits.conf | grep -i mysql mysql hard memlock unlimited mysql soft memlock unlimited ⑻ 配置 my.cnf[plain] [mysqld] large-pages ⑼ 启动mysqld ⑽ 观察HugePages 使用情况[plain] [root@obe11g ~]# grep -i huge /proc/meminfo HugePages_Total: 20 HugePages_Free: 16 Hugepagesize: 4096 kB
bitsCN.com

MySQL index cardinality has a significant impact on query performance: 1. High cardinality index can more effectively narrow the data range and improve query efficiency; 2. Low cardinality index may lead to full table scanning and reduce query performance; 3. In joint index, high cardinality sequences should be placed in front to optimize query.

The MySQL learning path includes basic knowledge, core concepts, usage examples, and optimization techniques. 1) Understand basic concepts such as tables, rows, columns, and SQL queries. 2) Learn the definition, working principles and advantages of MySQL. 3) Master basic CRUD operations and advanced usage, such as indexes and stored procedures. 4) Familiar with common error debugging and performance optimization suggestions, such as rational use of indexes and optimization queries. Through these steps, you will have a full grasp of the use and optimization of MySQL.

MySQL's real-world applications include basic database design and complex query optimization. 1) Basic usage: used to store and manage user data, such as inserting, querying, updating and deleting user information. 2) Advanced usage: Handle complex business logic, such as order and inventory management of e-commerce platforms. 3) Performance optimization: Improve performance by rationally using indexes, partition tables and query caches.

SQL commands in MySQL can be divided into categories such as DDL, DML, DQL, DCL, etc., and are used to create, modify, delete databases and tables, insert, update, delete data, and perform complex query operations. 1. Basic usage includes CREATETABLE creation table, INSERTINTO insert data, and SELECT query data. 2. Advanced usage involves JOIN for table joins, subqueries and GROUPBY for data aggregation. 3. Common errors such as syntax errors, data type mismatch and permission problems can be debugged through syntax checking, data type conversion and permission management. 4. Performance optimization suggestions include using indexes, avoiding full table scanning, optimizing JOIN operations and using transactions to ensure data consistency.

InnoDB achieves atomicity through undolog, consistency and isolation through locking mechanism and MVCC, and persistence through redolog. 1) Atomicity: Use undolog to record the original data to ensure that the transaction can be rolled back. 2) Consistency: Ensure the data consistency through row-level locking and MVCC. 3) Isolation: Supports multiple isolation levels, and REPEATABLEREAD is used by default. 4) Persistence: Use redolog to record modifications to ensure that data is saved for a long time.

MySQL's position in databases and programming is very important. It is an open source relational database management system that is widely used in various application scenarios. 1) MySQL provides efficient data storage, organization and retrieval functions, supporting Web, mobile and enterprise-level systems. 2) It uses a client-server architecture, supports multiple storage engines and index optimization. 3) Basic usages include creating tables and inserting data, and advanced usages involve multi-table JOINs and complex queries. 4) Frequently asked questions such as SQL syntax errors and performance issues can be debugged through the EXPLAIN command and slow query log. 5) Performance optimization methods include rational use of indexes, optimized query and use of caches. Best practices include using transactions and PreparedStatemen

MySQL is suitable for small and large enterprises. 1) Small businesses can use MySQL for basic data management, such as storing customer information. 2) Large enterprises can use MySQL to process massive data and complex business logic to optimize query performance and transaction processing.

InnoDB effectively prevents phantom reading through Next-KeyLocking mechanism. 1) Next-KeyLocking combines row lock and gap lock to lock records and their gaps to prevent new records from being inserted. 2) In practical applications, by optimizing query and adjusting isolation levels, lock competition can be reduced and concurrency performance can be improved.


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Safe Exam Browser
Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

MantisBT
Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

SecLists
SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

ZendStudio 13.5.1 Mac
Powerful PHP integrated development environment