


Graph-aware contrastive learning improves multivariate time series classification effects
This paper in AAAI 2024 was jointly published by the Singapore Agency for Science, Technology and Research (A*STAR) and Nanyang Technological University, Singapore. It proposed a method of using graph-aware contrastive learning to improve multivariate time series classification. Experimental results show that this method has achieved remarkable results in improving the performance of time series classification.
Picture
Paper title: Graph-Aware Contrasting for Multivariate Time-Series Classification
Download address: https://arxiv. org/pdf/2309.05202.pdf
Open source code: https://github.com/Frank-Wang-oss/TS-GAC
1. Overall introduction
Author Based on existing contrastive learning methods, a method called graph-aware contrast (TS-GAC) is proposed, which aims to solve the spatial consistency problem of multi-sensors in MTS data. TS-GAC consists of two main components: graph enhancement and graph comparison. Graph enhancement improves spatial consistency through node and edge enhancement to maintain sensor stability and relevance. The graph comparison introduces multi-window time comparison to maintain time consistency. Through extensive experimental verification, this method achieves optimal performance on various MTS classification tasks. The findings highlight the importance of considering spatial consistency in contrastive learning of MTS data and provide a comprehensive solution that significantly improves classification performance. This research is of great significance for further improving the effect of contrastive learning and provides a powerful tool for processing MTS data.
Picture
2. Model structure
The method proposed in this article mainly includes two parts: graph enhancement and graph comparison.
In order to effectively enhance MTS data, we introduce node and edge enhancement to generate weak views and strong views. Node enhancement includes frequency domain and time domain enhancement to fully enhance graph nodes. First, we apply frequency domain enhancement to enhance the nodes, and then segment the enhanced samples into multiple windows according to the dynamic local patterns in the MTS data (as shown in Figure 2). In each window, we use node temporal augmentation and perform feature extraction on the window through a one-dimensional convolutional neural network. Subsequently, we construct a graph for each window and further enhance the graph through edge enhancement. Finally, we use a graph neural network-based encoder for graph processing and feature learning.
Picture
Graph comparison: including node-level comparison and graph-level comparison to achieve spatial consistency. Node-level comparison ensures the robustness of node features by pulling corresponding sensors closer in different views and pushing different sensors farther away in different views. Graph-level comparison further ensures the robustness of global features by comparing samples in different views.
The goal of this architecture is to achieve spatial consistency in contrastive learning, and specific enhancement and contrast techniques are provided for MTS classification. By first applying node enhancement, then utilizing temporal enhancement within nodes, and finally edge enhancement processed by GNN, this method is able to generate weak and strong views with different spatial and temporal properties for each sample. The innovation of this method is that it not only considers temporal consistency, but also enhances spatial consistency through graph structure, providing a new perspective for in-depth analysis and processing of MTS data.
3. Graph enhancement module
In view of the characteristics of MTS data, that is, as data collected by multiple sensors, the author proposes two main methods of node and edge enhancement:
Node enhancement: divided into frequency domain enhancement and time domain enhancement. Frequency domain enhancement converts the signal of each sensor to the frequency domain, enhances the extracted frequency features, and then converts the enhanced frequency features back to the time domain to obtain an enhanced signal. Specifically, the discrete wavelet transform is used to decompose the signal through high-pass and low-pass filters to represent macro-trends and micro-trends within the signal. Time domain enhancement takes into account the dynamic characteristics of MTS data by dividing each MTS sample into multiple windows and performing time domain enhancement in each window.
Edge enhancement: aims to enhance the correlation between sensors, that is, the edges in the constructed graph. The nodes (sensors) and edges (correlations between sensors) are first defined through a graph building process. Then, the correlation between sensors is effectively enhanced through the edge enhancement method. In this step, considering that strong correlation is more important than weak correlation in the feature propagation of GNN, when performing edge enhancement, the strongest s correlations are retained to ensure the stability of topological information, and The remaining correlations are replaced with random values to enhance the edge connections.
Through these enhancement strategies, the author aims to generate weak views and strong views so that the subsequent contrastive learning process can learn robust sensor features and inter-sensor relationships. The design of these enhancement strategies takes into account the multi-source and dynamic nature of MTS data, and enhances the capabilities of CL by providing data views from different angles, so that more robust and generalized representations can be learned.
4. Graph comparison module
The paper proposes a graph-aware comparison method, which specially designs node and edge enhancement and graph comparison strategies to enhance the spatial consistency of MTS data. It mainly includes three levels of comparison: multi-window time comparison, node-level comparison, and graph-level comparison.
Multi-Window Temporal Contrasting (MWTC): This method ensures the temporal consistency of each sensor at the sensor level and maintains the robustness of temporal dependence within MTS data through predictive coding. sex. MWTC maintains the robustness of temporal patterns by summarizing past window information in one view and comparing it to future windows in another view.
Node-level Contrasting (NC): NC learns robust sensor-level features by comparing sensors in different views within each MTS sample. This involves maximizing the similarity between corresponding sensors in two views while minimizing the similarity between different sensors in those views.
Graph-level Contrasting (GC): GC promotes robust global-level feature learning by comparing samples within each training batch. This strategy works by maximizing the similarity between corresponding samples in two views while minimizing the similarity between different samples in those views.
These contrastive learning strategies work together to enhance representation learning of MTS data through graph structures, thereby improving classification accuracy. The article also highlights the importance of temporal comparison to maintain temporal consistency for each sensor, as well as the role of graph comparison in learning robust features at the sensor and global levels. By combining node-level and graph-level comparisons, this method can effectively learn complex spatial and temporal patterns in MTS data and achieve significant improvement in MTS classification performance.
5. Experimental results
In the experimental part, the paper compares the performance on ten public multivariate time series data sets and compares it with the existing state-of-the-art methods. . These datasets include Human Activity Recognition (HAR), ISRUC sleep stage classification, and sub-datasets in the UEA dataset such as finger movements, spoken Arabic numerals, etc. For fair comparison, all methods use the same encoder. Experimental results show that TS-GAC achieved the best performance on eight of the data sets, especially on the HAR and ISRUC data sets. Compared with other methods, the accuracy increased by 1.44% and 3.13% respectively.
Picture
At the same time, the author also visualized the model features. The visualization results enabled TS-GAC to extract more discernible sensor-level features. . At the same time, compared with other methods, TS-GAC can obtain more consistent sensor-level features for data from different viewing angles.
Picture
The authors also conducted ablation studies to evaluate the impact of the designed enhancement and contrast techniques on model performance. The ablation study tested different variants, including those that removed node enhancement, removed edge enhancement, removed graph-level contrast, removed node-level contrast, and removed multi-window temporal contrast. The results show that graph enhancement and graph contrast techniques are extremely effective in improving the spatial consistency of MTS data, and the full TS-GAC shows better performance than any variant that reduces contrast loss.
Picture
In addition, the author also analyzed the sensitivity of the model, including the impact and retention of hyperparameters (such as λMWTC, λGC, λNC) Effect of number of edges. These analyzes further confirm the effectiveness and robustness of the proposed method.
Overall, the experimental results highlight the ability of TS-GAC to achieve optimal performance on multiple MTS classification tasks, proving that the proposed graph enhancement and graph comparison techniques improve the spatial consistency of the model on MTS data. Importance and validity of sexual aspects.
The above is the detailed content of Graph-aware contrastive learning improves multivariate time series classification effects. For more information, please follow other related articles on the PHP Chinese website!

The term "AI-ready workforce" is frequently used, but what does it truly mean in the supply chain industry? According to Abe Eshkenazi, CEO of the Association for Supply Chain Management (ASCM), it signifies professionals capable of critic

The decentralized AI revolution is quietly gaining momentum. This Friday in Austin, Texas, the Bittensor Endgame Summit marks a pivotal moment, transitioning decentralized AI (DeAI) from theory to practical application. Unlike the glitzy commercial

Enterprise AI faces data integration challenges The application of enterprise AI faces a major challenge: building systems that can maintain accuracy and practicality by continuously learning business data. NeMo microservices solve this problem by creating what Nvidia describes as "data flywheel", allowing AI systems to remain relevant through continuous exposure to enterprise information and user interaction. This newly launched toolkit contains five key microservices: NeMo Customizer handles fine-tuning of large language models with higher training throughput. NeMo Evaluator provides simplified evaluation of AI models for custom benchmarks. NeMo Guardrails implements security controls to maintain compliance and appropriateness

AI: The Future of Art and Design Artificial intelligence (AI) is changing the field of art and design in unprecedented ways, and its impact is no longer limited to amateurs, but more profoundly affecting professionals. Artwork and design schemes generated by AI are rapidly replacing traditional material images and designers in many transactional design activities such as advertising, social media image generation and web design. However, professional artists and designers also find the practical value of AI. They use AI as an auxiliary tool to explore new aesthetic possibilities, blend different styles, and create novel visual effects. AI helps artists and designers automate repetitive tasks, propose different design elements and provide creative input. AI supports style transfer, which is to apply a style of image

Zoom, initially known for its video conferencing platform, is leading a workplace revolution with its innovative use of agentic AI. A recent conversation with Zoom's CTO, XD Huang, revealed the company's ambitious vision. Defining Agentic AI Huang d

Will AI revolutionize education? This question is prompting serious reflection among educators and stakeholders. The integration of AI into education presents both opportunities and challenges. As Matthew Lynch of The Tech Edvocate notes, universit

The development of scientific research and technology in the United States may face challenges, perhaps due to budget cuts. According to Nature, the number of American scientists applying for overseas jobs increased by 32% from January to March 2025 compared with the same period in 2024. A previous poll showed that 75% of the researchers surveyed were considering searching for jobs in Europe and Canada. Hundreds of NIH and NSF grants have been terminated in the past few months, with NIH’s new grants down by about $2.3 billion this year, a drop of nearly one-third. The leaked budget proposal shows that the Trump administration is considering sharply cutting budgets for scientific institutions, with a possible reduction of up to 50%. The turmoil in the field of basic research has also affected one of the major advantages of the United States: attracting overseas talents. 35

OpenAI unveils the powerful GPT-4.1 series: a family of three advanced language models designed for real-world applications. This significant leap forward offers faster response times, enhanced comprehension, and drastically reduced costs compared t


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

WebStorm Mac version
Useful JavaScript development tools

mPDF
mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

EditPlus Chinese cracked version
Small size, syntax highlighting, does not support code prompt function

DVWA
Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

SublimeText3 English version
Recommended: Win version, supports code prompts!
