Hadoop 2.2 & HBase 0.96 Maven 依赖总结-Mysql Tutorial-php.cn

Home

Database

Mysql Tutorial

Hadoop 2.2 & HBase 0.96 Maven 依赖总结

WBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWB

Jun 07, 2016 pm 03:12 PM

amphadoophbase

由于Hbase 0.94对Hadoop 2.x的支持不是非常好，故直接添加Hbase 0.94的jar依赖可能会导致问题。但是直接添加Hbase0.96的依赖，由于官方并没有发布Hbase 0.96的jar包，通过maven编译项目的时候会出现找不到jar包导致编译失败。通过网上的资料，得知Hbase 0.9

由于Hbase 0.94对Hadoop 2.x的支持不是非常好，故直接添加Hbase 0.94的jar依赖可能会导致问题。

但是直接添加Hbase0.96的依赖，由于官方并没有发布Hbase 0.96的jar包，通过maven编译项目的时候会出现找不到jar包导致编译失败。

通过网上的资料，得知Hbase 0.94后版本，直接添加Hbase-Client的依赖，通过查询得知需要以下依赖：

[html] view plaincopy Hadoop 2.2 & HBase 0.96 Maven 依赖总结

dependency>
groupId>commons-iogroupId>
artifactId>commons-ioartifactId>
version>1.3.2version>
dependency>
dependency>
groupId>commons-logginggroupId>
artifactId>commons-loggingartifactId>
version>1.1.3version>
dependency>
dependency>
groupId>log4jgroupId>
artifactId>log4jartifactId>
version>1.2.17version>
dependency>
dependency>
groupId>org.apache.hbasegroupId>
artifactId>hbase-clientartifactId>
version>0.96.1-hadoop2version>
dependency>
dependency>
groupId>com.google.protobufgroupId>
artifactId>protobuf-javaartifactId>
version>2.5.0version>
dependency>
dependency>
groupId>io.nettygroupId>
artifactId>nettyartifactId>
version>3.6.6.Finalversion>
dependency>
dependency>
groupId>org.apache.hbasegroupId>
artifactId>hbase-commonartifactId>
version>0.96.1-hadoop2version>
dependency>
dependency>
groupId>org.apache.hbasegroupId>
artifactId>hbase-protocolartifactId>
version>0.96.1-hadoop2version>
dependency>
dependency>
groupId>org.apache.zookeepergroupId>
artifactId>zookeeperartifactId>
version>3.4.5version>
dependency>
dependency>
groupId>org.cloudera.htracegroupId>
artifactId>htrace-coreartifactId>
version>2.01version>
dependency>
dependency>
groupId>org.codehaus.jacksongroupId>
artifactId>jackson-mapper-aslartifactId>
version>1.9.13version>
dependency>
dependency>
groupId>org.codehaus.jacksongroupId>
artifactId>jackson-core-aslartifactId>
version>1.9.13version>
dependency>
dependency>
groupId>org.codehaus.jacksongroupId>
artifactId>jackson-jaxrsartifactId>
version>1.9.13version>
dependency>
dependency>
groupId>org.codehaus.jacksongroupId>
artifactId>jackson-xcartifactId>
version>1.9.13version>
dependency>
dependency>
groupId>org.slf4jgroupId>
artifactId>slf4j-apiartifactId>
version>1.6.4version>
dependency>
dependency>
groupId>org.slf4jgroupId>
artifactId>slf4j-log4j12artifactId>
version>1.6.4version>
dependency>

若要使用org.apache.hadoop.hbase.mapreduce的API，需要加上：

org.apache.hbase

hbase-server

0.96.1-hadoop2

最后，把Hadoop的依赖也贴上来，以防自己忘记：

            org.apache.hadoop
            hadoop-client
            2.3.0


            commons-configuration
            commons-configuration
            1.6


            org.apache.hadoop
            hadoop-auth
            2.3.0


            org.apache.hadoop
            hadoop-common
            2.3.0

Statement

The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

MySQL: BLOB and other no-sql storage, what are the differences?May 13, 2025 am 12:14 AM

MySQL'sBLOBissuitableforstoringbinarydatawithinarelationaldatabase,whileNoSQLoptionslikeMongoDB,Redis,andCassandraofferflexible,scalablesolutionsforunstructureddata.BLOBissimplerbutcanslowdownperformancewithlargedata;NoSQLprovidesbetterscalabilityand

MySQL Add User: Syntax, Options, and Security Best PracticesMay 13, 2025 am 12:12 AM

ToaddauserinMySQL,use:CREATEUSER'username'@'host'IDENTIFIEDBY'password';Here'showtodoitsecurely:1)Choosethehostcarefullytocontrolaccess.2)SetresourcelimitswithoptionslikeMAX_QUERIES_PER_HOUR.3)Usestrong,uniquepasswords.4)EnforceSSL/TLSconnectionswith

MySQL: How to avoid String Data Types common mistakes?May 13, 2025 am 12:09 AM

ToavoidcommonmistakeswithstringdatatypesinMySQL,understandstringtypenuances,choosetherighttype,andmanageencodingandcollationsettingseffectively.1)UseCHARforfixed-lengthstrings,VARCHARforvariable-length,andTEXT/BLOBforlargerdata.2)Setcorrectcharacters

MySQL: String Data Types and ENUMs?May 13, 2025 am 12:05 AM

MySQloffersechar, Varchar, text, Anddenumforstringdata.usecharforfixed-Lengthstrings, VarcharerForvariable-Length, text forlarger text, AndenumforenforcingdataAntegritywithaetofvalues.

MySQL BLOB: how to optimize BLOBs requestsMay 13, 2025 am 12:03 AM

Optimizing MySQLBLOB requests can be done through the following strategies: 1. Reduce the frequency of BLOB query, use independent requests or delay loading; 2. Select the appropriate BLOB type (such as TINYBLOB); 3. Separate the BLOB data into separate tables; 4. Compress the BLOB data at the application layer; 5. Index the BLOB metadata. These methods can effectively improve performance by combining monitoring, caching and data sharding in actual applications.

Adding Users to MySQL: The Complete TutorialMay 12, 2025 am 12:14 AM

Mastering the method of adding MySQL users is crucial for database administrators and developers because it ensures the security and access control of the database. 1) Create a new user using the CREATEUSER command, 2) Assign permissions through the GRANT command, 3) Use FLUSHPRIVILEGES to ensure permissions take effect, 4) Regularly audit and clean user accounts to maintain performance and security.

Mastering MySQL String Data Types: VARCHAR vs. TEXT vs. CHARMay 12, 2025 am 12:12 AM

ChooseCHARforfixed-lengthdata,VARCHARforvariable-lengthdata,andTEXTforlargetextfields.1)CHARisefficientforconsistent-lengthdatalikecodes.2)VARCHARsuitsvariable-lengthdatalikenames,balancingflexibilityandperformance.3)TEXTisidealforlargetextslikeartic

MySQL: String Data Types and Indexing: Best PracticesMay 12, 2025 am 12:11 AM

Best practices for handling string data types and indexes in MySQL include: 1) Selecting the appropriate string type, such as CHAR for fixed length, VARCHAR for variable length, and TEXT for large text; 2) Be cautious in indexing, avoid over-indexing, and create indexes for common queries; 3) Use prefix indexes and full-text indexes to optimize long string searches; 4) Regularly monitor and optimize indexes to keep indexes small and efficient. Through these methods, we can balance read and write performance and improve database efficiency.

See all articles