search
HomeTechnology peripheralsAINew 'AI scientists” combine theory and data to discover scientific equations

The goal of scientists is to discover meaningful formulas that accurately describe experimental data. Mathematical models of natural phenomena can be created manually based on domain knowledge, or they can be created automatically from large data sets using machine learning algorithms. The academic community has studied the problem of merging related prior knowledge and related function models, and believes that finding a model that is consistent with prior knowledge of general logical axioms is an unsolved problem.

Researchers from the IBM research team and Samsung AI team developed a method "AI-Descartes" that combines logical reasoning with symbolic regression to extract data from axiomatic knowledge and experimental data. in principle derivation of models of natural phenomena.

The research is titled "Combining data and theory for derivable scientific discovery with AI-Descartes" and was published on April 12, 2023 in "Nature Communications》.

New AI scientists” combine theory and data to discover scientific equations

Artificial neural networks (NN) and statistical regression are often used to automatically discover patterns and relationships in data. NN returns a "black box" model, where the underlying functions are typically used only for prediction. In standard regression, the functional form is predetermined, so model discovery amounts to parameter fitting. In symbolic regression (SR), the functional form is not predetermined but consists of operators from a given list (e.g., , -, ×, and ÷) and is calculated from the data.

SR models are generally more "interpretable" than NN models and require less data. Therefore, to discover natural laws symbolically from experimental data, SR may be more effective than NN or fixed-form regression; the integration of NN and SR has been the subject of recent research in neurosymbolic AI. A major challenge in SR is identifying scientifically meaningful models from the many models that fit the data. Scientists define a meaningful function as one that balances accuracy and complexity. However, many such expressions exist for a given data set, and not all of them are consistent with known background theory.

An alternative approach is to start with a known background theory, but there are currently no practical inference tools that can generate theorems consistent with experimental data from a known set of axioms. Automatic Theorem Provers (ATP) are the most widely used reasoning tools that can prove conjectures for a given logical theory. Computational complexity is a major challenge for ATP; for some types of logic, proving conjectures is undecidable.

Additionally, deriving models from logical theories using formal reasoning tools is especially difficult when arithmetic and calculus operators are involved. Machine learning techniques have been used to improve the performance of ATP, for example, by using reinforcement learning to guide the search process.

Derivable models must not only be empirically accurate, but they should also be predictive and insightful.

Researchers from the IBM Research Team and Samsung AI Team attempted to obtain such a model by combining a novel mathematical optimization-based SR method with an inference system. This resulted in an end-to-end discovery system "AI-Descartes" that extracts formulas from data via SR and then provides a proof of the formula's derivability from a set of axioms, or provides a proof of inconsistency. When a model is provably not derivable, the researchers propose new measures that indicate how close the formula is to a derivable formula, and use their inference system to calculate the values ​​of these measures.

New AI scientists” combine theory and data to discover scientific equations

Illustration: System overview. (Source: paper)

In early work combining machine learning with inference, scientists used logic-based descriptions to constrain the output of GAN neural architectures that generated images. There are also teams that combine machine learning tools and inference engines to search for functional forms that satisfy pre-specified constraints. This is to augment the initial data set with new points, thus improving the efficiency of the learning method and the accuracy of the final model. Some teams also leverage prior knowledge to create additional data points. However, these studies only considered constraints on the functional form to be learned and did not include general background theoretical axioms (logical constraints describing other laws and unmeasured variables involved in the phenomenon).

Cristina Cornelio, lead author of the paper and a research scientist at Samsung AI, said AI-Descartes offers some advantages over other systems, but its most distinguishing feature is that it logical reasoning ability. If there are multiple candidate equations that fit the data well, the system identifies which equation best fits the background scientific theory. The ability to reason also sets the system apart from "generative AI" programs like ChatGPT, which have limited logic capabilities in large language models and sometimes mess with basic math.

"In our work, we are combining first-principles methods with the more common data-driven methods of the machine learning era, which have been used by scientists for centuries. "This combination allows us to leverage both approaches and create more accurate and meaningful models for a wide range of applications."

The name AI-Descartes is a tribute to the 17th-century mathematician and philosopher René Descartes, who believed that the natural world could be described by a few basic physical laws and that logical inferences played a key role in scientific discoveries. .

New AI scientists” combine theory and data to discover scientific equations

Illustration: Explanation of the scientific method for system implementation. (Source: Paper)

Researchers from this team have demonstrated that combining logical reasoning with symbolic regression is of great value in obtaining meaningful symbolic models of physical phenomena. ; because they are consistent with background theory and generalize well to domains significantly larger than experimental data. The combination of regression and inference produces better models than either SR or logical inference alone.

Improvement or replacement of individual system components and the introduction of new modules, such as abductive inference or experimental design will expand the functionality of the entire system. Deeper integration of inference and regression can help synthesize data-driven and first-principles-based models and lead to a revolution in the scientific discovery process. Discovering models that are consistent with prior knowledge will accelerate scientific discovery and transcend existing discovery paradigms.

The team used models to deduce Kepler's third law of planetary motion, Einstein's relativistic time dilation law, and Langmuir's adsorption theory; the research shows that when logical reasoning is used to When distinguishing candidate formulas with similar errors on the data, the model can discover dominant patterns from a small number of data points.

New AI scientists” combine theory and data to discover scientific equations

Illustration: Visualization of related sets and their distances. (Source: paper)

# "In this work, we need human experts to write down in a formal, computer-readable way what the axioms of the background theory are, and if If humans miss any of them or get any of them wrong, the system won't work," said Tyler Josephson, assistant professor of chemistry, biochemistry and environmental engineering at UMBC. "In the future, we also hope to automate this part of the job so we can Explore more fields of science and engineering."

Ultimately, the team hopes their AI-Descartes can inspire a productive new scientific approach just like real scientists. "One of the most exciting aspects of our work is the potential for significant advances in scientific research," Cornelio said.

Paper link: https://www.nature.com/articles/s41467-023-37236-y

Related reports: https://techxplore.com/news/2023-04-ai-scientist-combines-theory-scientific.html

The above is the detailed content of New 'AI scientists” combine theory and data to discover scientific equations. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
The AI Skills Gap Is Slowing Down Supply ChainsThe AI Skills Gap Is Slowing Down Supply ChainsApr 26, 2025 am 11:13 AM

The term "AI-ready workforce" is frequently used, but what does it truly mean in the supply chain industry? According to Abe Eshkenazi, CEO of the Association for Supply Chain Management (ASCM), it signifies professionals capable of critic

How One Company Is Quietly Working To Transform AI ForeverHow One Company Is Quietly Working To Transform AI ForeverApr 26, 2025 am 11:12 AM

The decentralized AI revolution is quietly gaining momentum. This Friday in Austin, Texas, the Bittensor Endgame Summit marks a pivotal moment, transitioning decentralized AI (DeAI) from theory to practical application. Unlike the glitzy commercial

Nvidia Releases NeMo Microservices To Streamline AI Agent DevelopmentNvidia Releases NeMo Microservices To Streamline AI Agent DevelopmentApr 26, 2025 am 11:11 AM

Enterprise AI faces data integration challenges The application of enterprise AI faces a major challenge: building systems that can maintain accuracy and practicality by continuously learning business data. NeMo microservices solve this problem by creating what Nvidia describes as "data flywheel", allowing AI systems to remain relevant through continuous exposure to enterprise information and user interaction. This newly launched toolkit contains five key microservices: NeMo Customizer handles fine-tuning of large language models with higher training throughput. NeMo Evaluator provides simplified evaluation of AI models for custom benchmarks. NeMo Guardrails implements security controls to maintain compliance and appropriateness

AI Paints A New Picture For The Future Of Art And DesignAI Paints A New Picture For The Future Of Art And DesignApr 26, 2025 am 11:10 AM

AI: The Future of Art and Design Artificial intelligence (AI) is changing the field of art and design in unprecedented ways, and its impact is no longer limited to amateurs, but more profoundly affecting professionals. Artwork and design schemes generated by AI are rapidly replacing traditional material images and designers in many transactional design activities such as advertising, social media image generation and web design. However, professional artists and designers also find the practical value of AI. They use AI as an auxiliary tool to explore new aesthetic possibilities, blend different styles, and create novel visual effects. AI helps artists and designers automate repetitive tasks, propose different design elements and provide creative input. AI supports style transfer, which is to apply a style of image

How Zoom Is Revolutionizing Work With Agentic AI: From Meetings To MilestonesHow Zoom Is Revolutionizing Work With Agentic AI: From Meetings To MilestonesApr 26, 2025 am 11:09 AM

Zoom, initially known for its video conferencing platform, is leading a workplace revolution with its innovative use of agentic AI. A recent conversation with Zoom's CTO, XD Huang, revealed the company's ambitious vision. Defining Agentic AI Huang d

The Existential Threat To UniversitiesThe Existential Threat To UniversitiesApr 26, 2025 am 11:08 AM

Will AI revolutionize education? This question is prompting serious reflection among educators and stakeholders. The integration of AI into education presents both opportunities and challenges. As Matthew Lynch of The Tech Edvocate notes, universit

The Prototype: American Scientists Are Looking For Jobs AbroadThe Prototype: American Scientists Are Looking For Jobs AbroadApr 26, 2025 am 11:07 AM

The development of scientific research and technology in the United States may face challenges, perhaps due to budget cuts. According to Nature, the number of American scientists applying for overseas jobs increased by 32% from January to March 2025 compared with the same period in 2024. A previous poll showed that 75% of the researchers surveyed were considering searching for jobs in Europe and Canada. Hundreds of NIH and NSF grants have been terminated in the past few months, with NIH’s new grants down by about $2.3 billion this year, a drop of nearly one-third. The leaked budget proposal shows that the Trump administration is considering sharply cutting budgets for scientific institutions, with a possible reduction of up to 50%. The turmoil in the field of basic research has also affected one of the major advantages of the United States: attracting overseas talents. 35

All About Open AI's Latest GPT 4.1 Family - Analytics VidhyaAll About Open AI's Latest GPT 4.1 Family - Analytics VidhyaApr 26, 2025 am 10:19 AM

OpenAI unveils the powerful GPT-4.1 series: a family of three advanced language models designed for real-world applications. This significant leap forward offers faster response times, enhanced comprehension, and drastically reduced costs compared t

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

SublimeText3 English version

SublimeText3 English version

Recommended: Win version, supports code prompts!