CDH 使用内部Parcel仓库

创建内部Parcel仓库

安装web服务 以apache为例

//# RHEL $ sudo yum install httpd $ sudo service httpd start //# SLES $ sudo zypper install httpd $ sudo service apache2 start //# Ubuntu $ sudo apt-get install httpd $ sudo service apache2 start

下载和发布Parcel仓库 下载地址

//# CDH 5: Impala,Kudu,Spark1等等 https://archive.cloudera.com/cdh5/parcels/ //# Accumulo https://archive.cloudera.com/accumulo-c5/parcels/ //# GPL Extras https://archive.cloudera.com/gplextras5/parcels/ //# CDS 2: CDH5 用的spark2 https://archive.cloudera.com/spark2/parcels/ //# Navigator Key Trustee Server http://www.cloudera.com/content/www/en-us/downloads/navigator/key-trustee-server.html //# Navigator Key Trustee KMS and HSM KMS http://www.cloudera.com/content/www/en-us/downloads/navigator/key-trustee-kms.html //# Sqoop Connectors https://archive.cloudera.com/sqoop-connectors/parcels/

下载.parcel和manifest.json到web根目录

//# apache默认根目录 $ sudo cd /var/www/html $ sudo mkdir -p /var/www/html/cloudera-parcels/cdh5/5.16/ //# CDH $ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel $ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/manifest.json //# 权限 $ sudo chmod -R ugo+rX /var/www/html/cloudera-parcels/cdh5/5.16/

当CM(Cloudera Manager)从web服务器读取parcel时,不使用.sha1,而是从manifest.json里读取SHA1哈希;

配置CMS使用内部parcel地址

设置parcel 导航栏, 点击导向栏上[]或点击 主机->Parcel->配置或管理->设置->类别->Parcel 在"远程 Parcel 存储库 URL",添加内部Parcel地址

使用本地Parcel仓库

打开CM web界面,导航到Parcel页点周 “配置”, 修改"本地 Parcel 存储库路径" 为内部Parcel仓库目录(httpd根目录)删除"远程 Parcel 存储库 URL",包括指向Cloudera官网此设置需要读取.sha1,在httpd根目录里下载 $ sudo cd /var/www/html/cloudera-parcels/cdh5/5.16/ $ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha1 //# 改文件名 $ sudo mv CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha1 CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha //# 更改属主 $ sudo chown cloudera-scm:cloudera-scm /var/www/html/cloudera-parcels/cdh5/5.16/ 在web界面导向到Parcel页,点击"检查新Parcel"

当新的parcel出现时,就可以下载,分发和激活了;