search
HomeBackend DevelopmentPHP Tutorial请教php保存数据的方案,谢谢!

小弟有个数据查询的网站,预计数据量很大,我起初想为了查询方便就插入mysql中,但实测下来每天插入的数据量可能在100M以上,如果用mysql估计成本增加,还不知道效率怎么样。
所以我想用文件形式保存数据,考虑过txt,xml,这样读取文件稍微麻烦点也不好紧。不过我最近想到,能不能用序列化的办法保存成文件?(因为我那些数据本质上属于一些数组数据),如果全部序列化,读取的时候直接反序列化那么效率应该会快得多?
想听听高手的意见,谢谢!!


回复讨论(解决方案)

查询读取的次数应该数量级多于写入吧?不用数据库用文件,IO会耗死机器的

查询读取的次数应该数量级多于写入吧?不用数据库用文件,IO会耗死机器的

确实,这样只好考虑数据库了。。。。

只有缓存不经常变化的数据才是有意义的,否则检查数据是否更新的开销也是不可忽略的
如果你的数据只是一些数组数据,那么最高效的就是保存 var_export 的结果到程序文件
使用时只需 include 即可

用文件不如用sqlite,文件且带sql查询

不清楚楼主说的成本指哪方面
建议楼主谷歌下PostgreSQL,mysql内存数据库,以及maria
文档类型简单数据也可考虑nosql,如couchdb,mongodb等


-----------------------------------------------------
另外,如果不考虑IO,性能,查询插入并发啥的,可以把生成php文件用变量放数组或序列化后的数据

试试mogonDB啊,存储序列化数据还是很方便的,跟php的连接读取也很成熟,读xml和txt肯定没读数据库快的

只有缓存不经常变化的数据才是有意义的,否则检查数据是否更新的开销也是不可忽略的
如果你的数据只是一些数组数据,那么最高效的就是保存 var_export 的结果到程序文件
使用时只需 include 即可

版主讲的狠对,另外将var_export的结果保存在一个文件php文件中同时设置下缓存时间,这样就既可以保证缓存还可以保证不频繁查询数据库,当然要用数据库保存的话插入是必不可少的嘛。还能有什么办法减少插入的次数的同时还能保证数据不变?大概只能保证少链接下数据库了吧?请指教 

不需要 设置缓存时间 !
设置缓存时间 是一种被动方式,无论数据是否变化,时间一到就都要重写缓存。既然是想用缓存来提高速度,那么任何一点浪费都是不应该的
你可以在更新数据成功后,即可更新缓存!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
What are the advantages of using a database to store sessions?What are the advantages of using a database to store sessions?Apr 24, 2025 am 12:16 AM

The main advantages of using database storage sessions include persistence, scalability, and security. 1. Persistence: Even if the server restarts, the session data can remain unchanged. 2. Scalability: Applicable to distributed systems, ensuring that session data is synchronized between multiple servers. 3. Security: The database provides encrypted storage to protect sensitive information.

How do you implement custom session handling in PHP?How do you implement custom session handling in PHP?Apr 24, 2025 am 12:16 AM

Implementing custom session processing in PHP can be done by implementing the SessionHandlerInterface interface. The specific steps include: 1) Creating a class that implements SessionHandlerInterface, such as CustomSessionHandler; 2) Rewriting methods in the interface (such as open, close, read, write, destroy, gc) to define the life cycle and storage method of session data; 3) Register a custom session processor in a PHP script and start the session. This allows data to be stored in media such as MySQL and Redis to improve performance, security and scalability.

What is a session ID?What is a session ID?Apr 24, 2025 am 12:13 AM

SessionID is a mechanism used in web applications to track user session status. 1. It is a randomly generated string used to maintain user's identity information during multiple interactions between the user and the server. 2. The server generates and sends it to the client through cookies or URL parameters to help identify and associate these requests in multiple requests of the user. 3. Generation usually uses random algorithms to ensure uniqueness and unpredictability. 4. In actual development, in-memory databases such as Redis can be used to store session data to improve performance and security.

How do you handle sessions in a stateless environment (e.g., API)?How do you handle sessions in a stateless environment (e.g., API)?Apr 24, 2025 am 12:12 AM

Managing sessions in stateless environments such as APIs can be achieved by using JWT or cookies. 1. JWT is suitable for statelessness and scalability, but it is large in size when it comes to big data. 2.Cookies are more traditional and easy to implement, but they need to be configured with caution to ensure security.

How can you protect against Cross-Site Scripting (XSS) attacks related to sessions?How can you protect against Cross-Site Scripting (XSS) attacks related to sessions?Apr 23, 2025 am 12:16 AM

To protect the application from session-related XSS attacks, the following measures are required: 1. Set the HttpOnly and Secure flags to protect the session cookies. 2. Export codes for all user inputs. 3. Implement content security policy (CSP) to limit script sources. Through these policies, session-related XSS attacks can be effectively protected and user data can be ensured.

How can you optimize PHP session performance?How can you optimize PHP session performance?Apr 23, 2025 am 12:13 AM

Methods to optimize PHP session performance include: 1. Delay session start, 2. Use database to store sessions, 3. Compress session data, 4. Manage session life cycle, and 5. Implement session sharing. These strategies can significantly improve the efficiency of applications in high concurrency environments.

What is the session.gc_maxlifetime configuration setting?What is the session.gc_maxlifetime configuration setting?Apr 23, 2025 am 12:10 AM

Thesession.gc_maxlifetimesettinginPHPdeterminesthelifespanofsessiondata,setinseconds.1)It'sconfiguredinphp.iniorviaini_set().2)Abalanceisneededtoavoidperformanceissuesandunexpectedlogouts.3)PHP'sgarbagecollectionisprobabilistic,influencedbygc_probabi

How do you configure the session name in PHP?How do you configure the session name in PHP?Apr 23, 2025 am 12:08 AM

In PHP, you can use the session_name() function to configure the session name. The specific steps are as follows: 1. Use the session_name() function to set the session name, such as session_name("my_session"). 2. After setting the session name, call session_start() to start the session. Configuring session names can avoid session data conflicts between multiple applications and enhance security, but pay attention to the uniqueness, security, length and setting timing of session names.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 English version

SublimeText3 English version

Recommended: Win version, supports code prompts!