search
HomeDatabaseMysql TutorialCDH5.2 Cloudera Manager installer安装配置

CDH5.2 Cloudera Manager installer安装配置

Jun 07, 2016 pm 04:41 PM
clouderamanager

一、机器准备 1、3台主机名:server202 server203 server204 另外server201用来搭建本地yum的repos,不参与集群。 2、配置server202的ssh免密码登录到其他机器(包括自己) 3、3个机器节点的/etc/hosts加入 192.168.2.201 archive.cloudera.com 192.168.2.20


一、机器准备

1、3台主机名:server202 server203 server204

另外server201用来搭建本地yum的repos,不参与集群。

2、配置server202的ssh免密码登录到其他机器(包括自己)

3、3个机器节点的/etc/hosts加入

192.168.2.201 archive.cloudera.com

192.168.2.202 server202

192.168.2.203 server203

192.168.2.204 server204

4、其他一些相关操作:

关闭防火墙

chkconfig iptables off

service iptables stop

通过Cloudera Manager installer安装必须设置/etc/selinux/config中的SELINUX=disabled,你需要重启机器。

sed -i "s/SELINUX=enforcing/SELINUX=disabled/g" /etc/selinux/config

配置163,sohu源

cd /etc/yum.repos.d/

#Centos5

wget?http://mirrors.163.com/.help/CentOS5-Base-163.repo

#wget?http://mirrors.sohu.com/help/CentOS-Base-sohu.repo

#Centos6

wget?http://mirrors.163.com/.help/CentOS6-Base-163.repo

yum?makecache

同步时间

ntpdate -u pool.ntp.org

安装CDH5.2必须安装python26版本,通过yum安装。

python yum -y install python26 python26-devel

有可能会提示zlib的错误,同时python中通过下面编译来重新配置。

yum install zlib

vi Modules/Setup Modules/Setup.dist
搜索zlib,去掉 #zlib zlibmodule.c -I$(prefix)/include -L$(exec_prefix)/lib -lz 前面的注释。
./configure
make

make install

二、构建本地repos(server201机器)

下载CDH5.2的tarball安装包,后面的manager通过tarball来安装

http://archive.cloudera.com/cdh5/repo-as-tarball/5.2.0/cdh5.2.0-centos5.tar.gz

http://archive.cloudera.com/cdh5/repo-as-tarball/5.2.0/cdh5.2.0-centos6.tar.gz

http://archive.cloudera.com/cm5/repo-as-tarball/5.2.0/cm5.2.0-centos5.tar.gz

http://archive.cloudera.com/cm5/repo-as-tarball/5.2.0/cm5.2.0-centos6.tar.gz

注意如果是centos6的操作系统还需要下载?navigator-keytrustee5目录,通过wget来下载

wget --mirror -p --convert-links -P /disk/cloudera/t?http://archive-primary.cloudera.com/navigator-keytrustee5/

这里是通过server201中nginx代理本地repos,并将archive.cloudera.com指定到192.168.2.201,这样你就不用修改yum的repos的网址。要不你得手动指定自己的repos地址。

nginx的默认配置没打开显示目录下的全部文件,你可以通过下面的配置在nginx.conf中启用。

autoindex on;#自动显示目录

autoindex_exact_size off;#人性化方式显示文件大小否则以byte显示

autoindex_localtime on;#按服务器时间显示,否则以gmt时间显示


搭建本地repos的相关配置命令


#centos5

mkdir -p /disk/cloudera/cdh5/redhat/5/x86_64

cd /disk/cloudera/cdh5/redhat/5/x86_64

tar -xzvf /disk/cloudera/download/cdh5.2.0-centos5.tar.gz

mkdir -p?/disk/cloudera/cm5/redhat/5/x86_64

cd?/disk/cloudera/cm5/redhat/5/x86_64

tar -xzvf /disk/cloudera/download/cm5.2.0-centos5.tar.gz

#centos6


mkdir -p /disk/cloudera/cdh5/redhat/6/x86_64

cd /disk/cloudera/cdh5/redhat/6/x86_64

tar -xzvf /disk/cloudera/download/cdh5.2.0-centos6.tar.gz


mkdir -p?/disk/cloudera/cm5/redhat/6/x86_64

cd?/disk/cloudera/cm5/redhat/6/x86_64

tar -xzvf /disk/cloudera/download/cm5.2.0-centos6.tar.gz

mkdir -p /disk/cloudera/redhat/cdh/

cd /disk/cloudera/redhat/cdh

cp /disk/cloudera/cdh5/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera .

配置成功后,确保http://archive.cloudera.com能够访问到你的本地的repos。

三、cloudera manager 安装

1、下载cloudera-manager-installer.bin?:?http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin


2、执行cloudera-manager-installer.bin,安装上面的步骤来安装即可。一般指需要几分钟时间。因为走得是本地repos源。注意要关闭SELINUX=disabled。安装的错误相关日志在/var/log/cloudera-manager-installer/这边可以查看。

3、安装后访问?http://server202:7180 来访问,默认账号密码:admin admin

四、通过cloudera manager安装集群

按照界面的导航流程操作即可。

1、选择 Cloudera Express 版本。

2、列出可安装的包及服务

3、指定CDH主机:

server202

server203

server204

4、选择存储库。选择方法:使用数据包。 CDH版本选择5.2。其他不要去修改。

5、选址安装oracle JDK 安装默认配置即可。

6、设置ssh登录的key,上传的是server202的私钥。

7、进入安装的流程。可以详细看到每个节点的安装情况。错误日志等,可以回滚重新安装。一般只要十几分钟。如果有错误,按照错误提示的内容修复即可。我碰到的错误就是python26依赖问题。

8、安装成功后,会自动对集群的机器的一些服务环境检查,根据检查结果自己来修复。一般都会检查通过。

9、选择需要安装的服务,这里你最大话安装,选择全部。

10、配置集群的角色。一般按照默认即可。注意,有些角色没有默认配置主机,你需要自己配置需要安装的主机位置。数据库,配置文件都按照默认即可。首次配置也需要十几分钟时间。

11、一切正常后,就进入管理面板,可以看到安装的服务。

安装成功后截图:

参考:

本站haddop文章?http://www.lifeba.org/?s=hadoop

http://blog.csdn.net/yangzhaohui168/article/details/33403555

http://www.cnblogs.com/thinkCoding/p/3567408.html

http://www.doc88.com/p-0042075356791.html

http://www.tuicool.com/articles/AnuiUra

http://wenku.baidu.com/link?url=6u94qotuyNG9n0rcgd9fNLQ_i4qhDyE3lN-7wo3oW1nZ9NSvnswNsCN007uOEBVccnjpVfW2YwBbgp1MgSz6O8RkztV-feyD2V40ghY2SES

以上就是CDH5.2 Cloudera Manager installer安装配置的内容,更多相关内容请关注PHP中文网(www.php.cn)!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
What Are the Limitations of Using Views in MySQL?What Are the Limitations of Using Views in MySQL?May 14, 2025 am 12:10 AM

MySQLviewshavelimitations:1)Theydon'tsupportallSQLoperations,restrictingdatamanipulationthroughviewswithjoinsorsubqueries.2)Theycanimpactperformance,especiallywithcomplexqueriesorlargedatasets.3)Viewsdon'tstoredata,potentiallyleadingtooutdatedinforma

Securing Your MySQL Database: Adding Users and Granting PrivilegesSecuring Your MySQL Database: Adding Users and Granting PrivilegesMay 14, 2025 am 12:09 AM

ProperusermanagementinMySQLiscrucialforenhancingsecurityandensuringefficientdatabaseoperation.1)UseCREATEUSERtoaddusers,specifyingconnectionsourcewith@'localhost'or@'%'.2)GrantspecificprivilegeswithGRANT,usingleastprivilegeprincipletominimizerisks.3)

What Factors Influence the Number of Triggers I Can Use in MySQL?What Factors Influence the Number of Triggers I Can Use in MySQL?May 14, 2025 am 12:08 AM

MySQLdoesn'timposeahardlimitontriggers,butpracticalfactorsdeterminetheireffectiveuse:1)Serverconfigurationimpactstriggermanagement;2)Complextriggersincreasesystemload;3)Largertablesslowtriggerperformance;4)Highconcurrencycancausetriggercontention;5)M

MySQL: Is it safe to store BLOB?MySQL: Is it safe to store BLOB?May 14, 2025 am 12:07 AM

Yes,it'ssafetostoreBLOBdatainMySQL,butconsiderthesefactors:1)StorageSpace:BLOBscanconsumesignificantspace,potentiallyincreasingcostsandslowingperformance.2)Performance:LargerrowsizesduetoBLOBsmayslowdownqueries.3)BackupandRecovery:Theseprocessescanbe

MySQL: Adding a user through a PHP web interfaceMySQL: Adding a user through a PHP web interfaceMay 14, 2025 am 12:04 AM

Adding MySQL users through the PHP web interface can use MySQLi extensions. The steps are as follows: 1. Connect to the MySQL database and use the MySQLi extension. 2. Create a user, use the CREATEUSER statement, and use the PASSWORD() function to encrypt the password. 3. Prevent SQL injection and use the mysqli_real_escape_string() function to process user input. 4. Assign permissions to new users and use the GRANT statement.

MySQL: BLOB and other no-sql storage, what are the differences?MySQL: BLOB and other no-sql storage, what are the differences?May 13, 2025 am 12:14 AM

MySQL'sBLOBissuitableforstoringbinarydatawithinarelationaldatabase,whileNoSQLoptionslikeMongoDB,Redis,andCassandraofferflexible,scalablesolutionsforunstructureddata.BLOBissimplerbutcanslowdownperformancewithlargedata;NoSQLprovidesbetterscalabilityand

MySQL Add User: Syntax, Options, and Security Best PracticesMySQL Add User: Syntax, Options, and Security Best PracticesMay 13, 2025 am 12:12 AM

ToaddauserinMySQL,use:CREATEUSER'username'@'host'IDENTIFIEDBY'password';Here'showtodoitsecurely:1)Choosethehostcarefullytocontrolaccess.2)SetresourcelimitswithoptionslikeMAX_QUERIES_PER_HOUR.3)Usestrong,uniquepasswords.4)EnforceSSL/TLSconnectionswith

MySQL: How to avoid String Data Types common mistakes?MySQL: How to avoid String Data Types common mistakes?May 13, 2025 am 12:09 AM

ToavoidcommonmistakeswithstringdatatypesinMySQL,understandstringtypenuances,choosetherighttype,andmanageencodingandcollationsettingseffectively.1)UseCHARforfixed-lengthstrings,VARCHARforvariable-length,andTEXT/BLOBforlargerdata.2)Setcorrectcharacters

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

ZendStudio 13.5.1 Mac

ZendStudio 13.5.1 Mac

Powerful PHP integrated development environment

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor