


Offline installation of Cloudera Manager and Cloudera Hadoop on CentOS6.5
Cloudera Manager and Cloudera Hadoop
Change hostname/turn off firewall/turn off selinux/ssh key-free login/NTP synchronization
Download relevant files (it is recommended that the CM and CDH versions be consistent; also pay attention to the compatibility of CDH and JDK versions)
- cloudera-manager.repo a configuration file
- cm install installation script
- cm rpms The local source file of rpm (you can also choose to download the tar file and decompress it directly)
- CDH parcel CDH installation file, for offline installation, just download the corresponding parcel, sha1 and manifest.json files. Foreign websites may be slow, so here we use the reverse proxy of HKUST
- Install CM (use local source files to install here, download the tar file will not be described again)
Perform the following steps on all nodes
Copy the cloudera-manager.repo configuration file into the
/etc/yum.repos.d/
folderVerify whether the repo file is valid
<code class="sourceCode bash"><span class="kw">yum</span> list<span class="kw">|grep</span> cloudera <span class="co">#如果列出的不是你安装的版本,执行下面命令重试</span> <span class="kw">yum</span> clean all <span class="kw">yum</span> list <span class="kw">|</span> <span class="kw">grep</span> cloudera</code>
- Put the rpm source file into any directory, execute
yum -y install *.rpm
, and install CM
Perform the following steps on the master node
- Copy the bin file to any directory on the master node
- Copy the parcel related files (3) into
/opt/cloudera/parcel-repo
. Note that the sha1 file is renamed to sha and do not modify the file content - Give execution permissions and install CM
./cloudera-manager-installer.bin
CM’s database
- There may be an error that there is no database. Non-production environments can bind the PostgreSQL database by default
sudo yum install cloudera-manager-server-db-2
sudo service cloudera-scm-server-db start
Use other databases to see the official website
Install CDH
- Enter the browser
master_ip:7180
, log in (account password defaults to admin) Select the corresponding CDH version that needs to be installed, which is basically the next step
Possible errors
- When installing CDH, it is stuck in the "Getting installation lock" process. Just delete the cache on the corresponding host.
cd /tmp
rm -rf scm_prepare_node.*
yum clean all
reboot
For other questions, please refer to the link or directly Google
For uninstallation, please refer to the official website
- refer to
The above is the detailed content of Offline installation of Cloudera Manager and Cloudera Hadoop on CentOS6.5. For more information, please follow other related articles on the PHP Chinese website!

The key steps in Linux system management and maintenance include: 1) Master the basic knowledge, such as file system structure and user management; 2) Carry out system monitoring and resource management, use top, htop and other tools; 3) Use system logs to troubleshoot, use journalctl and other tools; 4) Write automated scripts and task scheduling, use cron tools; 5) implement security management and protection, configure firewalls through iptables; 6) Carry out performance optimization and best practices, adjust kernel parameters and develop good habits.

Linux maintenance mode is entered by adding init=/bin/bash or single parameters at startup. 1. Enter maintenance mode: Edit the GRUB menu and add startup parameters. 2. Remount the file system to read and write mode: mount-oremount,rw/. 3. Repair the file system: Use the fsck command, such as fsck/dev/sda1. 4. Back up the data and operate with caution to avoid data loss.

This article discusses how to improve Hadoop data processing efficiency on Debian systems. Optimization strategies cover hardware upgrades, operating system parameter adjustments, Hadoop configuration modifications, and the use of efficient algorithms and tools. 1. Hardware resource strengthening ensures that all nodes have consistent hardware configurations, especially paying attention to CPU, memory and network equipment performance. Choosing high-performance hardware components is essential to improve overall processing speed. 2. Operating system tunes file descriptors and network connections: Modify the /etc/security/limits.conf file to increase the upper limit of file descriptors and network connections allowed to be opened at the same time by the system. JVM parameter adjustment: Adjust in hadoop-env.sh file

This guide will guide you to learn how to use Syslog in Debian systems. Syslog is a key service in Linux systems for logging system and application log messages. It helps administrators monitor and analyze system activity to quickly identify and resolve problems. 1. Basic knowledge of Syslog The core functions of Syslog include: centrally collecting and managing log messages; supporting multiple log output formats and target locations (such as files or networks); providing real-time log viewing and filtering functions. 2. Install and configure Syslog (using Rsyslog) The Debian system uses Rsyslog by default. You can install it with the following command: sudoaptupdatesud

When choosing a Hadoop version suitable for Debian system, the following key factors need to be considered: 1. Stability and long-term support: For users who pursue stability and security, it is recommended to choose a Debian stable version, such as Debian11 (Bullseye). This version has been fully tested and has a support cycle of up to five years, which can ensure the stable operation of the system. 2. Package update speed: If you need to use the latest Hadoop features and features, you can consider Debian's unstable version (Sid). However, it should be noted that unstable versions may have compatibility issues and stability risks. 3. Community support and resources: Debian has huge community support, which can provide rich documentation and

This article describes how to use TigerVNC to share files on Debian systems. You need to install the TigerVNC server first and then configure it. 1. Install the TigerVNC server and open the terminal. Update the software package list: sudoaptupdate to install TigerVNC server: sudoaptinstalltigervnc-standalone-servertigervnc-common 2. Configure TigerVNC server to set VNC server password: vncpasswd Start VNC server: vncserver:1-localhostno

Configuring a Debian mail server's firewall is an important step in ensuring server security. The following are several commonly used firewall configuration methods, including the use of iptables and firewalld. Use iptables to configure firewall to install iptables (if not already installed): sudoapt-getupdatesudoapt-getinstalliptablesView current iptables rules: sudoiptables-L configuration

The steps to install an SSL certificate on the Debian mail server are as follows: 1. Install the OpenSSL toolkit First, make sure that the OpenSSL toolkit is already installed on your system. If not installed, you can use the following command to install: sudoapt-getupdatesudoapt-getinstallopenssl2. Generate private key and certificate request Next, use OpenSSL to generate a 2048-bit RSA private key and a certificate request (CSR): openss


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Zend Studio 13.0.1
Powerful PHP integrated development environment

DVWA
Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

EditPlus Chinese cracked version
Small size, syntax highlighting, does not support code prompt function

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Safe Exam Browser
Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.