Home >Java >javaTutorial >Comparison of file copying performance between io and nio in java

Comparison of file copying performance between io and nio in java

高洛峰
高洛峰Original
2016-11-23 09:45:061709browse

1. In the traditional JAVA IO system, the process of reading disk file data is as follows:

Take the FileInputStream class as an example. This class has a read(byte b[]) method. byte b[] is the data we want to store and read. Get the user space buffer. Referring to the source code of the read(byte b[]) method, we can see that it will call the readBytes(b, 0, b.length) method internally, and the readBytes(b, 0, b.length) method is a native method (i.e. Local method), and finally initiate a system call through this local method, that is, calling the read() method of the system kernel. The kernel reads data from the disk to the kernel buffer. In this process, the disk controller reads the data from the disk through DMA operation. Get the kernel buffer, this process does not depend on the CPU. The user process then copies the data from the kernel buffer to the user space buffer. The user process then reads data from the user space buffer. Because user processes cannot directly access the hardware. Therefore, the kernel needs to act as a middleman to read the file.

The whole process is shown in the figure below: Comparison of file copying performance between io and nio in java

2. Since JAVA 1.4, JAVA has introduced the concept of file channel in NIO. The biggest difference from traditional IO is that traditional IO is based on Byte (byte) and Stream ( Stream), and NIO is based on Buffer (buffer) and Channel (channel). The API provides a FileChannel class and Selector (selector), which is associated with the traditional IO stream. The file channel can be obtained by FileInputStream or FileOutputStream, and we can read and write files through the channel.

3. JAVA NIO also introduces the concept of file memory mapping: most modern operating systems support virtual memory mapping, so that we can map the kernel space address and the user space virtual address to the same physical address, so that the DMA hardware (can only access physical memory address) can fill the buffer visible to both the kernel and user space processes. As shown in the figure below

Comparison of file copying performance between io and nio in java

Let’s take a look at the time-consuming comparison of file copying using IO, BufferedIO and NIO: 11 MB audio file

The time-consuming file copying using the traditional IO method: 21ms
Using the NIO file channel method Time-consuming to implement file copy: 16ms
Time-consuming to implement file copy using NIO file memory mapping and file channel: 7ms
Time-consuming to implement file copy using FileUtils file copy tool class: 53ms

package com.maystar.utils;
import java.io.File ;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.nio.MappedByteBuffer;
import java.nio.channels.FileChannel;

import org.apache.commons.io.FileUtils;

public class FileCopyTest {

​ public static void main(String[] args) throws Exception {

​ ​ String sourcePath = "F:\glzmv.mp3";

​ ​ String destPath1 = "F:\glzmvCopy1.mp3";

String destPath2 = "F:\glzmvCopy2.mp3";
                        String destPath3 = "                                      ;
long t1 = System.currentTimeMillis();

            traditionalCopy(sourcePath,destPath1);                                                   using           using using ’s ’ s ’ using using ‐ to copy through through ‐ ‐ ‐t ‐ t2 to 1) + "ms") ;
                                                                                                                           nioCopy (   ); t3-t2) + " ms");
nioCopy2(sourcePath,destPath3);

long t4 = System.currentTimeMillis();

System.out.println("Time-consuming to implement file copy using NIO file memory mapping and file channel:" + (t 4 -t3) + "ms");
                                                                                                                                              nioCopy3 ( ) nioCopy3(sourcePath, destPath4); ) + "ms");
}
  private static void nioCopy3(String sourcePath, String destPath) throws Exception {
                                                                                                               ,, , , ,                                                                                                     File dest = new File(destPath);


FileUtils. copyFile(source, dest);//View source code commons-io-2.4 also uses nio operations to implement operations similar to nioCopy, but the efficiency is lower than nioCopy. The reason is that after executing doCopyFile in FileUtils.copyFile, the IOUtils tool class is closed. Stream operations call corresponding constructors according to different types of streams.
                                                                                                                                                                                                                                                                File dest = new File(destPath);

if(!dest.exists( :) (dest);
                                                                                FileChannel sourceCh =         getChannel();                     FileChannel destCh = fos.getChannel();

        MappedByteBuffer mbb = sourceCh.map(FileChannel.MapMode.READ_ONLY, 0, sourceCh.size()); sourceCh.close();

destCh .close();
                                                                                                                                                  .close();         File source = new File(sourcePath); 
     
         File dest = new File(destPath); 
     
         if(!dest.exists()) { 
    
            dest.createNewFile(); 
    
        } 
    
        FileInputStream fis = new FileInputStream(source); 
    
        FileOutputStream fos = new FileOutputStream(dest); 
    
        byte [] buf = new byte [fis.available()]; 
    
        int len = 0; 
    
        while((len = fis.read(buf)) != -1) { 
    
            fos.write(buf, 0, len); 
    
        } 
    
        fis.close(); 
    
        fos.close(); 
    
     } 
    
     private  static  void nioCopy(String sourcePath, String destPath) throws Exception{ 
    
        File source = new File(sourcePath); 
    
        File dest = new File(destPath); 
    
        if(!dest.exists()) { 
    
            dest.createNewFile(); 
    
        } 
    
        FileInputStream fis = new FileInputStream(source); 
    
        FileOutputStream fos = new FileOutputStream(dest); 
    
        FileChannel sourceCh = fis.getChannel(); 
       
    
        FileChannel destCh = fos.getChannel(); 
        destCh.transferFrom(sourceCh, 0, sourceCh.size()); 
    
        sourceCh.close(); 
    
        destCh.close(); 
    
     } 
    
 } 


Statement:
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn