Cisco Cisco Workload Automation 6.3 用户指南
10
Configuring the Hive Adapter
Installing the Hadoop Client Libraries
To download and install Maven:
1.
Download maven 3 or above from
2.
Unzip apache-maven-<3 or above>-bin.zip.
3.
Add the bin directory of the created directory (for example, apache-maven-3.3.9) to the PATH environment variable
4.
Confirm a successful Maven installation by running the mvn -v command in a new shell. The result should look similar
to this:
to this:
Downloading the Hadoop Client Library
With Maven installed, you can now download the Hadoop client library. Maven scripts (POM.xml) are provided for the
following distributions of Hadoop:
following distributions of Hadoop:
Note:
The Cisco Workload Automation Compatibility Guide contains the most current version information.
To download and install the Hadoop client library
1.
Download the POM.zip file. This file is provided in the /Hadoop directory in the CWA 6.3 distribution package.
2.
Unzip the POM.zip.
The POM xml files needed by Maven are saved in the directory structure shown here:
3.
Open a Windows command prompt and navigate to the directory for the Hadoop distribution in which you are
interested. For example, navigate to the CDH directory if you want to download Hadoop client libraries for Cloudera.
interested. For example, navigate to the CDH directory if you want to download Hadoop client libraries for Cloudera.
4.
Edit the POM.xml file to mention exact versions of MapR, Hadoop, Hive, and Sqoop that you are using. For example,
for Cloudera the required properties could be edited as shown below:
for Cloudera the required properties could be edited as shown below:
<properties>
<Hadoop.version>2.6.0-cdh5.6.0</Hadoop.version>
<Hive.version>1.1.0-cdh5.7.0</Hive.version>
<Sqoop.version>1.4.6-cdh5.6.0</Sqoop.version>
</properties>
Hadoop Distribution Type
Versions
Cloudera
CDH5
Hortonworks
HDP 2.4.x
MapR
5.1.0