search
HomeJavajavaTutorialWhy does Hadoop use java?

Why does Hadoop use java?

May 27, 2019 am 10:47 AM
hadoop

The founder of Hadoop is Doug Cutting, the founder of Lucene. Doug Cutting developed Lucene in 2000, which was only 5 years after the official launch of the Java language (1995). You can imagine how new the Java language was at that time. And cool!
According to Doug Cutting's self-report, his main purpose of developing software at that time was to make money to support his family. At this time, many new features of Java naturally won the favor of young engineers.

Why does Hadoop use java?

Doug Cutting is also the founder of the famous Java-based search engine library Apache Lucene. Hadoop was originally used for the famous open source search engine Apache Nutch, and Nutch itself is based on Lucene and is also a sub-project of Lucene. Therefore, it is natural that Hadoop is based on Java, so Hadoop is written in Java.

Hadoop is written in Java, so Hadoop naturally supports Java language writing jobs. However, in actual applications, sometimes, due to the use of non-Java third-party libraries or other reasons, C/C or other Language to write MapReduce jobs, at this time you may need to use some tools provided by Hadoop.

If you want to write MpaReduce jobs in C/C, the tools you can use include Hadoop Streaming or Hadoop Pipes.

If you want to write MapReduce jobs in Python, you can use Hadoop Streaming or Pydoop.

If you want to use other languages, such as shell, php, ruby, etc., you can use Hadoop Streaming.

JVM/JDK Developers Requesting Help

We strongly recommend that anyone with a production JVM/JDK test compile and run Hadoop.

It makes for a fantastic performance and stress test. As Hadoop is becoming a critical back-end data center application, good Hadoop support is important.

The above is the detailed content of Why does Hadoop use java?. For more information, please follow other related articles on the PHP Chinese website!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
How do I use Maven or Gradle for advanced Java project management, build automation, and dependency resolution?How do I use Maven or Gradle for advanced Java project management, build automation, and dependency resolution?Mar 17, 2025 pm 05:46 PM

The article discusses using Maven and Gradle for Java project management, build automation, and dependency resolution, comparing their approaches and optimization strategies.

How do I create and use custom Java libraries (JAR files) with proper versioning and dependency management?How do I create and use custom Java libraries (JAR files) with proper versioning and dependency management?Mar 17, 2025 pm 05:45 PM

The article discusses creating and using custom Java libraries (JAR files) with proper versioning and dependency management, using tools like Maven and Gradle.

How do I implement multi-level caching in Java applications using libraries like Caffeine or Guava Cache?How do I implement multi-level caching in Java applications using libraries like Caffeine or Guava Cache?Mar 17, 2025 pm 05:44 PM

The article discusses implementing multi-level caching in Java using Caffeine and Guava Cache to enhance application performance. It covers setup, integration, and performance benefits, along with configuration and eviction policy management best pra

How can I use JPA (Java Persistence API) for object-relational mapping with advanced features like caching and lazy loading?How can I use JPA (Java Persistence API) for object-relational mapping with advanced features like caching and lazy loading?Mar 17, 2025 pm 05:43 PM

The article discusses using JPA for object-relational mapping with advanced features like caching and lazy loading. It covers setup, entity mapping, and best practices for optimizing performance while highlighting potential pitfalls.[159 characters]

How does Java's classloading mechanism work, including different classloaders and their delegation models?How does Java's classloading mechanism work, including different classloaders and their delegation models?Mar 17, 2025 pm 05:35 PM

Java's classloading involves loading, linking, and initializing classes using a hierarchical system with Bootstrap, Extension, and Application classloaders. The parent delegation model ensures core classes are loaded first, affecting custom class loa

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
4 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
4 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Chat Commands and How to Use Them
1 months agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor