search
HomeJavajavaTutorialHow to implement log file monitoring and read related data in Java

Project Requirements

Because the data center project team needs to implement the need to monitor folders or log files and read dirty data in the corresponding format, so that corresponding business can be performed when files and folders change. Process; so the implementation of relevant business and technology selection are recorded here.

Apache Commons-IO

First you need to add the corresponding dependencies:

<dependency>
 <groupId>commons-io</groupId>
 <artifactId>commons-io</artifactId>
 <version>2.7</version>
</dependency>

You can choose the version by yourself. It should be noted here that version 2.7 and above require Java 8

Official website screenshot:

How to implement log file monitoring and read related data in Java

##org.apache.commons.io.monitor package in Apache Commos IO provides files System monitoring function.

How to implement log file monitoring and read related data in Java##Core knowledge

    Summary in one sentence: Through the observer pattern and event listening mechanism,
  • FileAlterationObserver

    As the core, through FileAlterationListener, FileAlterationMonitor, you can realize event monitoring of the file system.

  • Overall process:
    Customize the file listening class and inherit
  • FileAlterationListenerAdaptor

    to implement file monitoring Handling directory creation, modification, and deletion events

  • Customize the file monitoring class and create an observer by specifying the directory
  • FileAlterationObserver

  • Add a file system observer to this monitor and add a file listener
  • Call via
  • ApplicationRunner

    or CommandLineRunner and Execute

  • code to implement

    File monitoring class:
  • /**
     * 文件监听类
     * @author Greenarrow
     * @date 2022-05-12 14:43
     **/
    public class FileListener extends FileAlterationListenerAdaptor {
    
        private static Logger logger = LoggerFactory.getLogger(FileListener.class);
        @Override
        public void onStart(FileAlterationObserver observer) {
            super.onStart(observer);
            logger.info("onStart");
        }
    
        @Override
        public void onDirectoryCreate(File directory) {
            logger.info("[新建]:" + directory.getAbsolutePath());
        }
    
        @Override
        public void onDirectoryChange(File directory) {
            logger.info("[修改]:" + directory.getAbsolutePath());
        }
    
        @Override
        public void onDirectoryDelete(File directory) {
            logger.info("[删除]:" + directory.getAbsolutePath());
        }
    
        @Override
        public void onFileCreate(File file) {
            String compressedPath = file.getAbsolutePath();
            logger.info("[新建]:" + compressedPath);
            List<String> contentList = null;
            try {
                if (file.canRead()){
                    // 将文件按行读取为字符串集合
                    contentList = FileUtils.readLines(new File(compressedPath), StandardCharsets.UTF_8);
                    if (CollectionUtil.isNotEmpty(contentList)){
                        // 获取对应格式的数据并输出,这里可自行添加业务处理
                        List<String> dirtyRecord  = contentList.stream().filter(s -> s.startsWith("{") && s.endsWith("}")).collect(Collectors.toList());
                        dirtyRecord.forEach(System.out::println);
                    }
                }
    
            } catch (IOException e) {
                e.printStackTrace();
                logger.error("读取文件内容失败",e);
            }
        }
    
        @Override
        public void onFileChange(File file) {
            String compressedPath = file.getAbsolutePath();
            logger.info("[修改]:" + compressedPath);
        }
    
        @Override
        public void onFileDelete(File file) {
            logger.info("[删除]:" + file.getAbsolutePath());
        }
    
        @Override
        public void onStop(FileAlterationObserver observer) {
            super.onStop(observer);
            logger.info("onStop");
        }
    }
    File monitoring class:
  • /**
     * 文件监听测试 demo
     * @author Greenarrow
     * @date 2022-05-12 14:45
     **/
    public class FileMonitor {
    
        FileAlterationMonitor monitor = null;
    
        public FileMonitor(long interval) throws Exception {
            monitor = new FileAlterationMonitor(interval);
        }
    
        /**
         * 给文件添加监听
         * @param path
         * @param listener
         */
        public void monitor(String path, FileAlterationListener listener) {
            FileAlterationObserver observer = new FileAlterationObserver(new File(path));
            monitor.addObserver(observer);
            observer.addListener(listener);
        }
    
        public void stop() throws Exception {
            monitor.stop();
        }
    
        public void start() throws Exception {
            monitor.start();
    
        }
    }
    Customize Runner and implement
  • CommandLineRunner

    :

    /**
     * 项目启动之后开启文件监听功能
     * @author Greenarrow
     * @date 2022-05-12 10:02
     **/
    @Component
    // @Order(Integer.MIN_VALUE)
    public class DirtyRecordRunner implements CommandLineRunner {
    
        private static Logger logger = LoggerFactory.getLogger(DirtyRecordRunner.class);
    
        @Value("${test}")
        private String path;
    
        @Override
        public void run(String... args) throws Exception {
            logger.info(this.getClass().getName()+"[开启文件夹监听功能]");
            FileMonitor fileMonitor = new FileMonitor(1000);
            fileMonitor.monitor(path,new FileListener());
            fileMonitor.start();
        }
    }

The above is the detailed content of How to implement log file monitoring and read related data in Java. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:亿速云. If there is any infringement, please contact admin@php.cn delete
What aspects of Java development are platform-dependent?What aspects of Java development are platform-dependent?Apr 26, 2025 am 12:19 AM

Javadevelopmentisnotentirelyplatform-independentduetoseveralfactors.1)JVMvariationsaffectperformanceandbehavioracrossdifferentOS.2)NativelibrariesviaJNIintroduceplatform-specificissues.3)Filepathsandsystempropertiesdifferbetweenplatforms.4)GUIapplica

Are there performance differences when running Java code on different platforms? Why?Are there performance differences when running Java code on different platforms? Why?Apr 26, 2025 am 12:15 AM

Java code will have performance differences when running on different platforms. 1) The implementation and optimization strategies of JVM are different, such as OracleJDK and OpenJDK. 2) The characteristics of the operating system, such as memory management and thread scheduling, will also affect performance. 3) Performance can be improved by selecting the appropriate JVM, adjusting JVM parameters and code optimization.

What are some limitations of Java's platform independence?What are some limitations of Java's platform independence?Apr 26, 2025 am 12:10 AM

Java'splatformindependencehaslimitationsincludingperformanceoverhead,versioncompatibilityissues,challengeswithnativelibraryintegration,platform-specificfeatures,andJVMinstallation/maintenance.Thesefactorscomplicatethe"writeonce,runanywhere"

Explain the difference between platform independence and cross-platform development.Explain the difference between platform independence and cross-platform development.Apr 26, 2025 am 12:08 AM

Platformindependenceallowsprogramstorunonanyplatformwithoutmodification,whilecross-platformdevelopmentrequiressomeplatform-specificadjustments.Platformindependence,exemplifiedbyJava,enablesuniversalexecutionbutmaycompromiseperformance.Cross-platformd

How does Just-In-Time (JIT) compilation affect Java's performance and platform independence?How does Just-In-Time (JIT) compilation affect Java's performance and platform independence?Apr 26, 2025 am 12:02 AM

JITcompilationinJavaenhancesperformancewhilemaintainingplatformindependence.1)Itdynamicallytranslatesbytecodeintonativemachinecodeatruntime,optimizingfrequentlyusedcode.2)TheJVMremainsplatform-independent,allowingthesameJavaapplicationtorunondifferen

Why is Java a popular choice for developing cross-platform desktop applications?Why is Java a popular choice for developing cross-platform desktop applications?Apr 25, 2025 am 12:23 AM

Javaispopularforcross-platformdesktopapplicationsduetoits"WriteOnce,RunAnywhere"philosophy.1)ItusesbytecodethatrunsonanyJVM-equippedplatform.2)LibrarieslikeSwingandJavaFXhelpcreatenative-lookingUIs.3)Itsextensivestandardlibrarysupportscompr

Discuss situations where writing platform-specific code in Java might be necessary.Discuss situations where writing platform-specific code in Java might be necessary.Apr 25, 2025 am 12:22 AM

Reasons for writing platform-specific code in Java include access to specific operating system features, interacting with specific hardware, and optimizing performance. 1) Use JNA or JNI to access the Windows registry; 2) Interact with Linux-specific hardware drivers through JNI; 3) Use Metal to optimize gaming performance on macOS through JNI. Nevertheless, writing platform-specific code can affect the portability of the code, increase complexity, and potentially pose performance overhead and security risks.

What are the future trends in Java development that relate to platform independence?What are the future trends in Java development that relate to platform independence?Apr 25, 2025 am 12:12 AM

Java will further enhance platform independence through cloud-native applications, multi-platform deployment and cross-language interoperability. 1) Cloud native applications will use GraalVM and Quarkus to increase startup speed. 2) Java will be extended to embedded devices, mobile devices and quantum computers. 3) Through GraalVM, Java will seamlessly integrate with languages ​​such as Python and JavaScript to enhance cross-language interoperability.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

WebStorm Mac version

WebStorm Mac version

Useful JavaScript development tools