search
HomeDatabaseMysql TutorialRedis cache and MySQL data consistency methods

Redis cache and MySQL data consistency methods

May 29, 2023 pm 08:17 PM
mysqlredis

Cause of demand

In high-concurrency business scenarios, the database is in most cases the weakest link for concurrent user access. Therefore, you need to use redis to perform a buffering operation so that the request can access redis first instead of directly accessing databases such as MySQL.

This business scenario mainly solves the problem of reading data from Redis cache. Business operations are generally carried out according to the process in the figure below.

There is generally no problem in reading the cache step, but once data updates are involved: database and cache updates, data consistency issues between the cache (Redis) and the database (MySQL) are prone to occur.

Whether you write the MySQL database first and then delete the Redis cache; or delete the cache first and then write to the database, data inconsistency may occur. As an example:

1. If the Redis cache is deleted and another thread comes to read before it has time to write to the database MySQL, and finds that the cache is empty, it reads the data from the database and writes it to the cache. At this time, the cache contains dirty data.

2. If the library is written first, and the thread writing the library crashes before the cache is deleted, and the cache is not deleted, data inconsistency will also occur.

Because writing and reading are concurrent and the order cannot be guaranteed, there will be data inconsistency between the cache and the database.

Tathagata solves it? Here are two solutions, easy first and then difficult, chosen based on business and technical costs.

Cache and database consistency solution

1. The first option: adopt delayed double deletion strategy

Perform the redis.del (key) operation before and after writing the library, and set a reasonable timeout.

The pseudo code is as follows

​public void write(String key,Object data){

redis.delKey(key);

​db.updateData(data);

Thread.sleep(500);

redis.delKey(key);

}

2. The specific steps are:

1) Delete the cache first

2) Write the database again

3) Sleep for 500 milliseconds

4) Delete cache again

So, how is this 500 milliseconds determined, and how long should it sleep for?

You need to evaluate the time-consuming data reading business logic of your project. The purpose of this is to ensure that the read request ends, and the write request can delete the cached dirty data caused by the read request.

Of course, this strategy also needs to consider the time-consuming synchronization between redis and database master-slave. The final sleep time for writing data: Add a few hundred milliseconds to the time it takes to read data business logic. For example: sleep for 1 second.

3. Set cache expiration time

Theoretically, setting an expiration time for the cache is a solution to ensure eventual consistency. All write operations are subject to the database. As long as the cache expiration time is reached, subsequent read requests will naturally read new values ​​from the database and backfill the cache.

4. Disadvantages of this plan

Combined with the double delete strategy and the cache timeout setting, the worst case scenario is that the data is inconsistent within the timeout period, and it also increases the time it takes to write the request.

2. The second solution: asynchronous update cache (synchronization mechanism based on subscribing to binlog)

1. Overall technical idea:

MySQL binlog incremental subscription consumption message queue incremental data update to redis

1) Read Redis: Hot data is basically in Redis

2) Writing MySQL: Addition, deletion and modification are all operations on MySQL

3) Update Redis data: MySQ data operation binlog to update to Redis

2.Redis update

1) Data operations are mainly divided into two blocks:

One is full (write all data to redis at once)

One is incremental (real-time update)

What we are talking about here is increment, which refers to the update, insert and delete change data of mysql.

2) After reading the binlog, analyze it, and use the message queue to push and update the redis cache data of each station.

In this way, once new write, update, delete and other operations occur in MySQL, binlog-related messages can be pushed to Redis, and Redis will update Redis based on the records in the binlog.

In fact, this mechanism is very similar to MySQL's master-slave backup mechanism, because MySQL's master-slave backup also achieves data consistency through binlog.

Here you can use canal (an open source framework of Alibaba) in combination, through which you can subscribe to MySQL's binlog. Canal imitates the backup request of mysql's slave database, so that Redis's data update achieves the same effect.

Of course, for the message push tool here, you can also use other third parties: kafka, rabbitMQ, etc. to implement push updates to Redis.

The above is the detailed content of Redis cache and MySQL data consistency methods. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:亿速云. If there is any infringement, please contact admin@php.cn delete
How does MySQL's licensing compare to other database systems?How does MySQL's licensing compare to other database systems?Apr 25, 2025 am 12:26 AM

MySQL uses a GPL license. 1) The GPL license allows the free use, modification and distribution of MySQL, but the modified distribution must comply with GPL. 2) Commercial licenses can avoid public modifications and are suitable for commercial applications that require confidentiality.

When would you choose InnoDB over MyISAM, and vice versa?When would you choose InnoDB over MyISAM, and vice versa?Apr 25, 2025 am 12:22 AM

The situations when choosing InnoDB instead of MyISAM include: 1) transaction support, 2) high concurrency environment, 3) high data consistency; conversely, the situation when choosing MyISAM includes: 1) mainly read operations, 2) no transaction support is required. InnoDB is suitable for applications that require high data consistency and transaction processing, such as e-commerce platforms, while MyISAM is suitable for read-intensive and transaction-free applications such as blog systems.

Explain the purpose of foreign keys in MySQL.Explain the purpose of foreign keys in MySQL.Apr 25, 2025 am 12:17 AM

In MySQL, the function of foreign keys is to establish the relationship between tables and ensure the consistency and integrity of the data. Foreign keys maintain the effectiveness of data through reference integrity checks and cascading operations. Pay attention to performance optimization and avoid common errors when using them.

What are the different types of indexes in MySQL?What are the different types of indexes in MySQL?Apr 25, 2025 am 12:12 AM

There are four main index types in MySQL: B-Tree index, hash index, full-text index and spatial index. 1.B-Tree index is suitable for range query, sorting and grouping, and is suitable for creation on the name column of the employees table. 2. Hash index is suitable for equivalent queries and is suitable for creation on the id column of the hash_table table of the MEMORY storage engine. 3. Full text index is used for text search, suitable for creation on the content column of the articles table. 4. Spatial index is used for geospatial query, suitable for creation on geom columns of locations table.

How do you create an index in MySQL?How do you create an index in MySQL?Apr 25, 2025 am 12:06 AM

TocreateanindexinMySQL,usetheCREATEINDEXstatement.1)Forasinglecolumn,use"CREATEINDEXidx_lastnameONemployees(lastname);"2)Foracompositeindex,use"CREATEINDEXidx_nameONemployees(lastname,firstname);"3)Forauniqueindex,use"CREATEU

How does MySQL differ from SQLite?How does MySQL differ from SQLite?Apr 24, 2025 am 12:12 AM

The main difference between MySQL and SQLite is the design concept and usage scenarios: 1. MySQL is suitable for large applications and enterprise-level solutions, supporting high performance and high concurrency; 2. SQLite is suitable for mobile applications and desktop software, lightweight and easy to embed.

What are indexes in MySQL, and how do they improve performance?What are indexes in MySQL, and how do they improve performance?Apr 24, 2025 am 12:09 AM

Indexes in MySQL are an ordered structure of one or more columns in a database table, used to speed up data retrieval. 1) Indexes improve query speed by reducing the amount of scanned data. 2) B-Tree index uses a balanced tree structure, which is suitable for range query and sorting. 3) Use CREATEINDEX statements to create indexes, such as CREATEINDEXidx_customer_idONorders(customer_id). 4) Composite indexes can optimize multi-column queries, such as CREATEINDEXidx_customer_orderONorders(customer_id,order_date). 5) Use EXPLAIN to analyze query plans and avoid

Explain how to use transactions in MySQL to ensure data consistency.Explain how to use transactions in MySQL to ensure data consistency.Apr 24, 2025 am 12:09 AM

Using transactions in MySQL ensures data consistency. 1) Start the transaction through STARTTRANSACTION, and then execute SQL operations and submit it with COMMIT or ROLLBACK. 2) Use SAVEPOINT to set a save point to allow partial rollback. 3) Performance optimization suggestions include shortening transaction time, avoiding large-scale queries and using isolation levels reasonably.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function