linux - 跨机房实时大量小文件同步方案

Question

大家有没有大量小文件在多个机房之间实时同步的方案？有没有实际生产环境部署过的？

Answer 1

Previously used:

1. nfs
2. inotify + rsync
3. MongoDB Storage

The sersync mentioned by @qrpeng should also be good, completely suitable for LZ scenarios.

Answer 2

I use sersync a lot. It can indeed meet your needs and can lay out a complex structure. However, I would like to remind you that there are many disadvantages. It is more troublesome to manage multiple nodes, and there is no detailed information. Logging and rollback methods. In fact, this tool uses inotify+rsync but uses a multi-process approach and adds configuration management, so it is easier to use than ordinary tools. If you have the energy, you can try to modify it, and it can be implemented well if you switch to other languages. Such as GO language, python.

Answer 3

You can try sersync