记录cloudera manager安装hadoop的步骤-Mysql Tutorial-php.cn

Home

Database

Mysql Tutorial

记录cloudera manager安装hadoop的步骤

WBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWB

Jun 07, 2016 pm 04:32 PM

clouderahadoopmanagerInstallRecord

安装cloudera-manager 在http://go.cloudera.com/cloudera-standard-download.html下载cloudera-manager-installer.bin 下载完要给它设置执行权限 chmod +x ./cloudera-manager-installer.bin 要用root权限运行, sudo?./cloudera-manager-installer.bin 一步

安装cloudera-manager

在http://go.cloudera.com/cloudera-standard-download.html下载cloudera-manager-installer.bin

下载完要给它设置执行权限 chmod +x ./cloudera-manager-installer.bin

要用root权限运行, sudo?./cloudera-manager-installer.bin

一步步执行后，会下载安装jdk和cm，需要等一会儿，要下载200mb左右。(手工下载路径，http://archive.cloudera.com/cm4/cm/4/，但下载这个不知道怎么用，还是给程序下载吧。)

安装完后，提示打开 http://localhost:7180

部署hadoop

ubuntu中的root用户没有密码，可以sudo passwd root设置密码

ubuntu默认没有openssh-server，使用sudo apt-get install openssh-server安装吧，需要测试ssh localhost是否有效

host好像不允许一个IP对应多个主机名称，编辑/etc/hosts把localhost的那个去掉，保留主机的那个。

到`http://archive.cloudera.com/cdh4/parcels/`下载你想要安装的CDH版本（我的是ubuntu12.04，下载CDH-4.3.0-1.cdh4.3.0.p0.22-precise.parcel文件），并且下载manifest.json文件，里面有hash值，把hash值找出来，保存为CDH-4.3.0-1.cdh4.3.0.p0.22-precise.parcel.sha文件（根据版本改名字），echo “1959e87dc6bfcfe9cc7eacd1ff7727bfd737f42d” ?>?/opt/cloudera/parcel-repo/CDH-4.3.0-1.cdh4.3.0.p0.22-precise.parcel.sha

把下载好的包放在/opt/cloudera/parcel-repo目录下,然后cm应该不会重新下载了。。

另外如果用mysql还要自己安装mysql-server和jdbc包。

原文地址：记录cloudera manager安装hadoop的步骤, 感谢原作者分享。

Statement

The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

How do you handle database upgrades in MySQL?Apr 30, 2025 am 12:28 AM

The steps for upgrading MySQL database include: 1. Backup the database, 2. Stop the current MySQL service, 3. Install the new version of MySQL, 4. Start the new version of MySQL service, 5. Recover the database. Compatibility issues are required during the upgrade process, and advanced tools such as PerconaToolkit can be used for testing and optimization.

What are the different backup strategies you can use for MySQL?Apr 30, 2025 am 12:28 AM

MySQL backup policies include logical backup, physical backup, incremental backup, replication-based backup, and cloud backup. 1. Logical backup uses mysqldump to export database structure and data, which is suitable for small databases and version migrations. 2. Physical backups are fast and comprehensive by copying data files, but require database consistency. 3. Incremental backup uses binary logging to record changes, which is suitable for large databases. 4. Replication-based backup reduces the impact on the production system by backing up from the server. 5. Cloud backups such as AmazonRDS provide automation solutions, but costs and control need to be considered. When selecting a policy, database size, downtime tolerance, recovery time, and recovery point goals should be considered.

What is MySQL clustering?Apr 30, 2025 am 12:28 AM

MySQLclusteringenhancesdatabaserobustnessandscalabilitybydistributingdataacrossmultiplenodes.ItusestheNDBenginefordatareplicationandfaulttolerance,ensuringhighavailability.Setupinvolvesconfiguringmanagement,data,andSQLnodes,withcarefulmonitoringandpe

How do you optimize database schema design for performance in MySQL?Apr 30, 2025 am 12:27 AM

Optimizing database schema design in MySQL can improve performance through the following steps: 1. Index optimization: Create indexes on common query columns, balancing the overhead of query and inserting updates. 2. Table structure optimization: Reduce data redundancy through normalization or anti-normalization and improve access efficiency. 3. Data type selection: Use appropriate data types, such as INT instead of VARCHAR, to reduce storage space. 4. Partitioning and sub-table: For large data volumes, use partitioning and sub-table to disperse data to improve query and maintenance efficiency.

How can you optimize MySQL performance?Apr 30, 2025 am 12:26 AM

TooptimizeMySQLperformance,followthesesteps:1)Implementproperindexingtospeedupqueries,2)UseEXPLAINtoanalyzeandoptimizequeryperformance,3)Adjustserverconfigurationsettingslikeinnodb_buffer_pool_sizeandmax_connections,4)Usepartitioningforlargetablestoi

How to use MySQL functions for data processing and calculationApr 29, 2025 pm 04:21 PM

MySQL functions can be used for data processing and calculation. 1. Basic usage includes string processing, date calculation and mathematical operations. 2. Advanced usage involves combining multiple functions to implement complex operations. 3. Performance optimization requires avoiding the use of functions in the WHERE clause and using GROUPBY and temporary tables.

An efficient way to batch insert data in MySQLApr 29, 2025 pm 04:18 PM

Efficient methods for batch inserting data in MySQL include: 1. Using INSERTINTO...VALUES syntax, 2. Using LOADDATAINFILE command, 3. Using transaction processing, 4. Adjust batch size, 5. Disable indexing, 6. Using INSERTIGNORE or INSERT...ONDUPLICATEKEYUPDATE, these methods can significantly improve database operation efficiency.

Steps to add and delete fields to MySQL tablesApr 29, 2025 pm 04:15 PM

In MySQL, add fields using ALTERTABLEtable_nameADDCOLUMNnew_columnVARCHAR(255)AFTERexisting_column, delete fields using ALTERTABLEtable_nameDROPCOLUMNcolumn_to_drop. When adding fields, you need to specify a location to optimize query performance and data structure; before deleting fields, you need to confirm that the operation is irreversible; modifying table structure using online DDL, backup data, test environment, and low-load time periods is performance optimization and best practice.

See all articles