Option I - Mirror server has no access to the Internet

Complete the following instructions to set up a mirror server that has no access to the Internet:

Check Your Prerequisites.

Select a mirror server host with the following characteristics:

The server OS is Debian 7, CentOS (6,7), RHEL (6,7), Oracle Linux(6,7), SLES (11,12), or Ubuntu (12,14,16), and has several GB of storage available.

This server and the cluster nodes are all running the same OS.

	Note
	To support repository mirroring for heterogeneous clusters requires a more complex procedure than the one documented here.

The firewall lets all cluster nodes (the servers on which you want to install HDP) access this serve

Install the Repos.

Use a workstation with access to the Internet and download the tarball image of the appropriate Hortonworks yum repository.

Table 6.2. Hortonworks Yum Repositories

Cluster OS	HDP Repository Tarballs
Debian 7	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/debian7/HDP-2.6.0.3-debian7-deb.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/debian7/HDP-UTILS-1.1.0.21-debian7.tar.gz`
RHEL/CentOS/Oracle LINUX 6	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/centos6/HDP-2.6.0.3-centos6-rpm.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/centos6/HDP-UTILS-1.1.0.21-centos6.tar.gz`
RHEL/CentOS/Oracle LINUX 7	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/centos7/HDP-2.6.0.3-centos7-rpm.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz`
SLES 11 SP3/SP4	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/suse11sp3/HDP-2.6.0.3-suse11sp3-rpm.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/suse11sp3/HDP-UTILS-1.1.0.21-suse11sp3.tar.gz`
SLES 12	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/sles12/HDP-2.6.0.3-sles12-rpm.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/sles12/HDP-UTILS-1.1.0.21-sles12.tar.gz`
Ubuntu 12	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/ubuntu12/HDP-2.6.0.3-ubuntu12-deb.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/ubuntu12/HDP-UTILS-1.1.0.21-ubuntu12.tar.gz`
Ubuntu 14	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/ubuntu14/HDP-2.6.0.3-ubuntu14-deb.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/ubuntu14/HDP-UTILS-1.1.0.21-ubuntu14.tar.gz`
Ubuntu 16	`wget https://hdpweb.o.onslip.net/p/HDP/2.x/2.6.0.3/ubuntu16/HDP-2.6.0.3-ubuntu16-deb.tar.gz` `wget https://hdpweb.o.onslip.net/p/HDP-UTILS/1.1.0.21/repos/ubuntu16/HDP-UTILS-1.1.0.21-ubuntu16.tar.gz`

Create an HTTP server.
- On the mirror server, install an HTTP server (such as Apache httpd) using the instructions provided here.
- Activate this web server.
- Ensure that the firewall settings (if any) allow inbound HTTP access from your cluster nodes to your mirror server.
  Note
  If you are using EC2, make sure that SELinux is disabled.
  If you are using EC2, make sure that SELinux is disabled.
On your mirror server, create a directory for your web server.
- For example, from a shell window, type:
  - ForRHEL/CentOS/Oracle:
    mkdir –p /var/www/html/hdp/
  - For SLES:
    mkdir –p /srv/www/htdocs/rpms
  - For Ubuntu:  
    mkdir –p /var/www/html/hdp/
- If you are using a symlink, enable thefollowsymlinks on your web server.
Copy the HDP Repository Tarball to the directory created in step 3, and untar it.

Verify the configuration.

The configuration is successful, if you can access the above directory through your web browser.

To test this out, browse to the following location: http://$yourwebserver/hdp/$os/HDP-2.6.0.3/.

You should see directory listing for all the HDP components along with the RPMs at: $os/HDP-2.6.0.3.

Note

If you are installing a 2.x.0 release, use: http://$yourwebserver /hdp/ $os /2.x/GA

If you are installing a 2.x.x release, use: http://$yourwebserver /hdp/ $os /2.x/updates

where

$os can be debian7, centos6, centos7, suse11sp3, sles12, ubuntu12, ubuntu14, or ubuntu16. Use the following options table for $osparameter:

Table 6.3. HDP Component Options
Operating System Value
Debian 7 debian7
RHEL 6 centos6
RHEL 7 centos7
SLES 11 SP3/SP4 suse11sp3
SLES 12 sles12
Ubuntu 12 ubuntu12
Ubuntu 14 ubuntu14
Ubuntu 16 ubuntu16

Configure the yum clients on all the nodes in your cluster.
- Fetch the yum configuration file from your mirror server.
```
http://$yourwebserver /hdp/$os/2.x/updates/2.6.0.3/hdp.repo
```
- Store the hdp.repo file to a temporary location.
- Edit the hdp.repo file changing the value of the base url property to point to your local repositories based on your cluster OS.
  where
  - $yourwebserver is the FQDN of your local mirror server.
  - $os can be centos6, centos7, suse11sp3, sles12, ubuntu12, ubuntu14, or ubuntu16. Use the following options table for $os parameter:
    
    Table 6.4. Yum Client Options
    Operating System Value
    Debian 7 debian7
    RHEL 6 centos6
    RHEL 7 centos7
    SLES 11 SP3/SP4 suse11sp3
    SLES 12 sles12
    Ubuntu 12 ubuntu12
    Ubuntu 14 ubuntu14
    Ubuntu 16 ubuntu16
  - Use scp or pdsh to copy the client yum configuration file to /etc/yum.repos.d/ directory on every node in the cluster.
- [Conditional]: If you have multiple repositories configured in your environment, deploy the following plugin on all the nodes in your cluster.
  - Install the plugin.
    For RHEL and CentOs
    yum install yum-plugin-priorities
  - Edit the /etc/yum/pluginconf.d/priorities.conf file to add the following:
    [main] enabled=1 gpgcheck=0

	Note
	If you are using EC2, make sure that SELinux is disabled.

Operating System	Value
Debian 7	debian7
RHEL 6	centos6
RHEL 7	centos7
SLES 11 SP3/SP4	suse11sp3
SLES 12	sles12
Ubuntu 12	ubuntu12
Ubuntu 14	ubuntu14
Ubuntu 16	ubuntu16

​Option I - Mirror server has no access to the Internet

Option I - Mirror server has no access to the Internet