Home >Database >Mysql Tutorial >Do you know MySQL lock and transaction isolation levels?

Do you know MySQL lock and transaction isolation levels?

coldplay.xixi
coldplay.xixiforward
2020-10-06 14:52:232019browse

Do you know MySQL lock and transaction isolation levels?

Related free learning recommendations: mysql database (video)

Preface

  • MySQL index underlying data structure and algorithm
  • MySQL performance optimization principle-Part 1
  • MySQL performance optimization-Practice 1
  • MySQL performance optimization-Practice 2

Earlier we talked about the underlying data structure and algorithm of the MySQL database and some content about MySQL performance optimization. Let’s talk about MySQL’s lock and transaction isolation levels again, divided into two articles. This article focuses on MySQL’s row locks and transaction isolation levels.

Lock Definition

Lock is a mechanism for computers to coordinate multiple processes or threads to access a resource concurrently.

In the database, in addition to the competition for traditional computing resources (such as CPU, RAM, I/O, etc.), data is also a resource that needs to be shared by users. How to ensure the consistency and effectiveness of concurrent access to data is a problem that all databases must solve. Lock conflict is also an important factor affecting the performance of concurrent access to the database.

Lock classification

  • In terms of performance, it is divided into optimistic lock (implemented by version comparison) and pessimistic lock;
  • The database operation types are divided into: read lock and write lock (both are pessimistic locks)
    • read lock (shared lock ): For the same data, multiple read operations can be performed at the same time without affecting each other;
    • Write lock (exclusive lock): It will block the current write operation before it is completed. Break other write locks and read locks.
  • The granularity of database operations is divided into: table lock and row lock.

For an in-depth understanding of locks, you can check out "Understanding of Locks in Java".

MySQL locks

  • Record Locks

  • Gap Locks

  • Next-key Locks

  • Shared and Exclusive Locks

  • Intention Shared and Exclusive Locks

  • Insert Intention Locks

  • Auto-inc Locks

  • ## Predictive lock, this kind of lock is mainly used for spatial index that stores spatial data.

# Let’s talk about them separately in the next article. This article focuses on row locks and transaction isolation levels.

Table lock

Locks the entire table for each operation.

    The overhead is small and locking is fast;
  • No deadlock will occur;
  • The lock granularity is large and the probability of lock conflict is the highest;
  • The lowest degree of concurrency.
Basic operations

Sample table, as follows:

# 建表SQLCREATE TABLE mylock (    id INT(11) NOT NULL AUTO_INCREMENT,    NAME VARCHAR(20) DEFAULT NULL,
    PRIMARY KEY(id)
) ENGINE = MyISAM DEFAULT CHARSET = utf8;

# 插入数据INSERT INTO`test`.`mylock`(`id`,`NAME`) VALUES ('1','a'); 
INSERT INTO`test`.`mylock`(`id`,`NAME`) VALUES ('2','b'); 
INSERT INTO`test`.`mylock`(`id`,`NAME`) VALUES ('3','c'); 
INSERT INTO`test`.`mylock`(`id`,`NAME`) VALUES ('4','d');复制代码
    Manually add table lock
lock table 表名称 read(write), 表名称2 read(write);复制代码
    View Locks added to the table
show open tables;复制代码
    Delete table lock
unlock tables;复制代码
Case analysis - Add read lock

LOCK TABLE mylock read;复制代码

Do you know MySQL lock and transaction isolation levels?
Both the current session and other seesion can read the table;

Inserting or updating the locked table in the current session will report an error, while other sessions will wait for insertion or update.

Do you know MySQL lock and transaction isolation levels?
Case Analysis - Write Lock

LOCK TABLE mylock WRITE;复制代码

Do you know MySQL lock and transaction isolation levels?
##Current There is no problem with the addition, deletion, modification, and query of the table by the session. All operations on the table by other sessions will be blocked.

Case conclusion

MyISAM

Before executing the query statement (SELECT), read locks will be automatically added to all tables involved; before adding, deleting, modifying, and querying operations are performed, read locks will be automatically added. Automatically add write locks to the tables involved.

Reading operations (adding read locks) to MyISAM tables will not block read requests for the same table by other processes, but will block write requests for the same table. Only when the read lock is released, the write operation of other processes will be performed.
  • Writing operations (adding write locks) to the MyISAM table will block other processes from reading and writing operations on the same table. Only when the write lock is released, will the read and write operations of other processes be performed.
  • Summary:
Read locks will block writing, but not reading; write locks will block both reading and writing

. Row lock

Locks one row of data for each operation.

  • 开销大,加锁慢;
  • 会出现死锁;
  • 锁定粒度最小,发生锁冲突的概率最低;
  • 并发度最高。

InnoDB 和 MyISAM 的最大不同点:

  • 支持事务(TRANSACTION)
  • 支持行级锁

行锁支持事务

事务(Transaction)及其 ACID 属性

事务是由一组 SQL 语句组成的逻辑处理单元,事务具有以下四个属性,通常简称为事务的 ACID属性

  • 原子性(Atomicity):事务是一个原子操作单元,其对数据的修改,要么全部执行,要么全部不执行。
  • 一致性(Consistent):在事务开始和完成时,数据都必须保持一致状态。这意味着所有相关的数据规则都必须应用于事务的修改,以保持数据的完整性;事务结束时,所有的内部数据结构(如B+树索引或双向链表)也都必须是正确的。
  • 隔离性(Lsolation):数据库系统提供一定的隔离机制,保障事务在不受外部并发操作影响的“独立”环境执行。这意味着事务处理过程中的中间状态对外部是不可见的,反之亦然。
  • 持久性(Durable):事务完成之后,它对于数据的修改是永久性的,即使出现系统故障也能保持。

并发事务处理带来的问题

  • 更新丢失(Lost Update)

当两个或多个事务选择同一行,然后基于最初选定的值更新该行值,由于每个事务都不知道其他事务的存在,就会发生丢失更新问题,最后的更新覆盖来其他事务所做的更新。

  • 脏读(Dirty Reads)

一个事务正在对一条记录做修改,在这个事务完成并提交前,这个条记录的数据就处于不一致的状态;这时另外一个事务也来读取同一条记录,如果不加控制,第二个事务读取来这些“脏”数据,并据此做进一步的处理,就会产生未提交的数据依赖关系。这种现象被形象的叫做“脏读”。

总结:事务A读取到来事务B已经修改但尚未提交的数据,还在这个数据基础上做来操作。此时,如果事务B回滚,事务A读取的数据无效,不符合一致性要求。

  • 不可重复读(Non-Repeatable Reads)

一个事务在读取某些数据后的某个时间,再次读取以前读过的数据,却发现其读出的数据已经发生来改变、或某些记录已经被删除了,这种现象就叫做“不可重复读”。

总结:事务A读取到了事务B已经提交的修改数据,不符合隔离性。

  • 幻读(Phantom Reads)

一个事务按相同的查询条件重新读取以前检索过的数据,却发现其他事务插入了满足其查询条件的新数据,这种现象就称为“幻读”。

总结:事务A读取到了事务B提交的新增数据,不符合隔离性。

事务隔离级别

“脏读”、“不可重复读”、“幻读”,其实都是数据库读一致性问题,必须由数据库提供一定的事务隔离机制来解决。

Do you know MySQL lock and transaction isolation levels?

数据库的事务隔离越严格,并发副作用越小,但付出的代价也就越大,因为事务隔离实质上就是使事务在一定程度上“串行化”进行,这显然与“并发”是矛盾的。

同时,不同应用对读一致性和事务隔离程度的要求也是不同的,比如许多应用对“不可重复读”和“幻读” 并不敏感,可能更关系数据并发访问的能力。

查看当前数据库的事务隔离级别

show variables like 'tx_isolation';复制代码
Do you know MySQL lock and transaction isolation levels?

设置事务隔离级别

set tx_isolation='REPEATABLE-READ';复制代码

数据库版本是5.7,隔离级别是Repeatable-Read(可重复读),不同的数据库版本和隔离级别对语句的执行结果影响很大。所以需要说明版本和隔离级别

行锁与隔离级别案例分析

事务控制语句

  • BEGINSTART TRANSACTION;显式地开启一个事务;
  • COMMIT;也可以使用 COMMIT WORK,不过二者是等价的。COMMIT会提交事务,并使已对数据库进行的所有修改称为永久性的;
  • ROLLBACK;有可以使用 ROLLBACK WORK,不过二者是等价的。回滚会结束用户的事务,并撤销正在进行的所有未提交的修改;
  • SAVEPOINT identifier;SAVEPOINT允许在事务中创建一个保存点,一个事务中可以有多个SAVEPOINT;
  • RELEASE SAVEPOINT identifier;删除一个事务的保存点,当没有指定的保存点时,执行该语句会抛出一个异常;
  • ROLLBACK TO identifier;把事务回滚到标记点;
  • SET TRANSACTION;用来设置事务的隔离级别。InnoDB存储引擎提供事务的隔离级别有READ UNCOMMITTEDREAD COMMITTEDREPEATABLE READSERIALIZABLE

事务处理方法

MYSQL 事务处理主要有两种方法:

  1. BEGIN, ROLLBACK, COMMIT来实现
    • BEGIN 开始一个事务
    • ROLLBACK 事务回滚
    • COMMIT 事务确认
  1. 直接用 SET 来改变 MySQL 的自动提交模式:
    • SET AUTOCOMMIT=0 禁止自动提交
    • SET AUTOCOMMIT=1`` 开启自动提交

示例表,如下:

CREATE TABLE `user` (    `id` INT (11) NOT NULL AUTO_INCREMENT,    `name` VARCHAR (255) DEFAULT NULL,    `balance` INT (11) DEFAULT NULL,
    PRIMARY KEY (`id`)
) ENGINE = INNODB DEFAULT CHARSET = utf8;INSERT INTO `test`.`user` (`name`,`balance`) VALUES ('zhangsan','450');INSERT INTO `test`.`user` (`name`,`balance`) VALUES ('lisi', '16000');INSERT INTO `test`.`user` (`name`,`balance`) VALUES ('wangwu','2400');复制代码

行锁演示

一个 session 开启事务更新不提交,另一个 seesion 更新同一条记录会阻塞,更新不同记录u会阻塞。

Do you know MySQL lock and transaction isolation levels?
Do you know MySQL lock and transaction isolation levels?

读未提交

(1)打开一个客户端A,并设置当前事务模式为 read uncommitted (读未提交),查询表 user 的初始化值

set tx_isolation='read-uncommitted';复制代码
Do you know MySQL lock and transaction isolation levels?

(2)在客户端A的事务提交之前,打开另一个客户端B,更新表 user

Do you know MySQL lock and transaction isolation levels?

(3)这时,虽然客户端B的事务还没提交,但是在客户端A就可以查询到B已经更新的数据

Do you know MySQL lock and transaction isolation levels?

(4)一旦客户端B的事务因为某种原因回滚,所有的操作都将会被撤销,那么客户端A查询到的数据其实就是脏数据

Do you know MySQL lock and transaction isolation levels?

(5)在客户端A执行更新语句 update user set balance = balance - 50 where id = 1; zhangsan 的 balance没有变成350,居然是400,是不是很奇怪,数据不一致啊。如果你这么想就太天真了,在应用程序中,我们会用400-50=350,并不知道其他会话回滚了,要想解决这个问题可以采用读已提交的隔离级别。

Do you know MySQL lock and transaction isolation levels?

读已提交

(1)打开一个客户端A,并设置当前事务模式为 read committed (读已提交),查询表 user 的所有记录

set tx_isolation='read-committed';复制代码
Do you know MySQL lock and transaction isolation levels?

(2)在客户端A的事务提交之前,打开另一个客户端B,更新表 user

Do you know MySQL lock and transaction isolation levels?

(3)这时,客户端B的事务还没提交,客户端A不能查询到B已经更新的数据,解决了脏读问题。

Do you know MySQL lock and transaction isolation levels?

(4)客户端B的事务提交

Do you know MySQL lock and transaction isolation levels?

(5)客户端A执行与上一步相同的查询,结果与上一步不一致,即产生了不可重复读的问题。

Do you know MySQL lock and transaction isolation levels?

可重复读

(1)打开一个客户端A,并设置当前的事务模式为 repeatable read ,查询表 user 的所有记录。

set tx_isolation='REPEATABLE-READ';复制代码
Do you know MySQL lock and transaction isolation levels?

(2)在客户端A的事务提交之前,打开另一个客户端B,更新表 user 并提交。

Do you know MySQL lock and transaction isolation levels?

(3)在客户端A查询表 user 的所有记录,与步骤(1)查询结果一直,没有出现不可重复读的问题。

Do you know MySQL lock and transaction isolation levels?

(4)在客户端A,接着执行 update user set balance = balance - 50 where id = 1 , balance 没有变成 400 - 50 = 350, zhangsan 的 balance 的值用的是步骤(2) 中的 350 来计算的,所以是300,数据的一致性倒是没有被破坏。可重复读的隔离级别下使用了 MVCC(multi-version concurrency control)机制,select 操作不会更新版本号,是快照读(历史版本);insert、update、delete 会更新版本号,是当前读(当前版本)。

我们下篇来讲 MVCC。

Do you know MySQL lock and transaction isolation levels?

(5)重新打开客户端B,插入一条新数据后提交。

Do you know MySQL lock and transaction isolation levels?

(6)在客户端A查询表user 的所有记录,没有查出新增数据,所以没有出现幻读。

Do you know MySQL lock and transaction isolation levels?

(7)验证幻读 在客户端A执行 update user set balance = 8888 where id = 4; ,能更新成功,再次查询到客户端B新增的数据。

串行化

(1)打开一个客户端A,并设置当前事务模式为 serializable ,查询表 user 的初始值

set tx_isolation='serializable';复制代码
Do you know MySQL lock and transaction isolation levels?

(2)打开一个客户端B,并设置当前事务模式为 serializable ,插入一条记录报错,表被锁了插入失败,MySQL 中事务隔离级别为 serializable 时会锁表,因此不会出现幻读的情况,这种隔离级别并发性极低,开发中很少会用到。

Do you know MySQL lock and transaction isolation levels?

案例结论

InnoDB 存储引擎由于实现了行级锁定,虽然在锁定机制的实现方面所带来的性能损耗可能比表级锁定会更高一下,但是在整体并发处理能力方面要远远优于 MyISAM 的表级锁定的。当系统并发量最高的时候,InnoDB 的整体性能和 MyISAM 相比就会有比较明显的优势。

但是,InnoDB 的行级锁定同样也有其脆弱的一面,当我们使用不当的时候,可能会让 InnoDB 的整体性能表现不仅不能比 MyISAM 高,甚至可能会更差。

行锁分析

通过检查 innodb_row_lock 状态变量来分析系统上的行锁的竞争情况:

show status like 'innodb_row_lock%';复制代码
Do you know MySQL lock and transaction isolation levels?

对各个状态量的说明如下:

  • Innodb_row_lock_current_waits :当前正在等待锁定的数量
  • Innodb_row_lock_time :从系统启动到现在锁定总时间长度
  • Innodb_row_lock_time_avg :每次等待所花平均时间
  • Innodb_row_lock_time_max :从系统启动到现在等待最长的一次所花时间
  • Innodb_row_lock_waits :系统启动后到现在总共等待的次数

对于这5个状态变量,比较重要的主要是:

  • Innodb_row_lock_time_avg (等待平均时长)
  • Innodb_row_lock_waits (等待总次数)
  • Innodb_row_lock_time(等待总时长)

尤其是当等待次数很高,而且每次等待时长也不小的时候,我们就需要分析系统 中为什么会有如此多的等待,然后根据分析结果着手制定优化计划。

死锁

set tx_isolation='REPEATABLE-READ';复制代码
Session_1执行:select * from user where id=1 for update;
Session_2执行:select * from user where id=2 for update;
Session_1执行:select * from user where id=2 for update;
Session_2执行:select * from user where id=1 for update;复制代码

查看近期死锁日志信息:

show engine innodb status\G;复制代码

大多数情况mysql可以自动检测死锁并回滚产生死锁的那个事务,但是有些情况 mysql没法自动检测死锁

优化建议

  1. 尽可能让所有数据检索都通过索引来完成,避免无索引行锁升级为表锁;
  2. 合理设计索引,尽量缩小锁的范围;
  3. 尽可能减少检索条件范围,避免间隙锁;
  4. 尽量控制事务大小,减少锁定资源量和时间长度,涉及事务加锁的sql尽量放在事务最后执行;
  5. 尽可能低级别事务隔离。

问答

  1. MySQL 默认级别是 repeatable-read,有什么办法可以解决幻读妈?

间隙锁(Gap Lock)在某些情况下可以解决幻读问题,它是 Innodb 在 可重复读 提交下为解决幻读问题时引入的锁机制。要避免幻读可以用间隙锁在Session_1 下面执行 update user set name = 'hjh' where id > 10 and id  ,则其他 Session 没法在这个范围锁包含的间隙里插入或修改任何数据。

如:user 表有3条数据, id > 2 and id  会把第三条记录锁住,其他会话对则无法对第三条记录做操作。

Do you know MySQL lock and transaction isolation levels?
Do you know MySQL lock and transaction isolation levels?
  1. 无索引锁会升级为表锁,锁主要是加在索引上,如果对非索引字段更新,行锁可能会变变锁。

客户端A执行: update user set balance = 800 where name = 'zhangsan'; 

Do you know MySQL lock and transaction isolation levels?

客户端B对该表任一行执行修改、删除操作都会阻塞

Do you know MySQL lock and transaction isolation levels?

InnoDB 的行锁是针对索引加的锁,不是针对记录加的锁。并且该索引不能失效,否则都会从行锁升级为表锁。

  1. You can also use local in share mode (shared lock) and for update (exclusive lock) to lock a certain row, for example: select * from test_innodb_lock where a = 2 for update; In this way, other sessions can only read this row of data, and modifications will be blocked until the session that locks the row is submitted.

The above is the detailed content of Do you know MySQL lock and transaction isolation levels?. For more information, please follow other related articles on the PHP Chinese website!

Statement:
This article is reproduced at:juejin.im. If there is any infringement, please contact admin@php.cn delete