Cisco Cisco Workload Automation 6.3 User Guide

Page of 46
13
 
Configuring the Sqoop Adapter
Configuring the Adapter
For MapR it is also necessary to mention the version of MapR used, as shown in the  following example:
<properties>
<Hadoop.version>2.7.0-mapr-1602</Hadoop.version>
<Hive.version>1.2.0-mapr-1605</Hive.version>
<Sqoop.version>1.4.6-mapr-1601</Sqoop.version>
<Mapr.version>5.1.0-mapr</Mapr.version>
</properties>
5.
From the directory containing the Hadoop distribution you want, execute this command:
mvn dependency:copy-dependencies -DoutputDirectory=<directory to which you want to download the 
jars>
For example, running the following command from the CDH directory:
mvn dependency:copy-dependencies -DoutputDirectory=C:\CDHlib
would insert the Cloudera Hadoop client libraries to the “C:\CDHlib” directory. 
Configuring the Adapter
You must configure the Sqoop Adapter before you can schedule and run Sqoop jobs.
To configure the Sqoop Adapter:
1.
Stop the Master. 
2.
In the {722A6A78-7C2C-4D8B-AA07-B0D9CED6C55A} directory, create a Config subdirectory.
3.
Create the service.props file in the Config directory if it doesn’t already exist. See 
.
4.
(For the MapR Distribution only) Install the MapR client in the CWA Master machine, and add the following lines in 
the service.props file for your platform:
Windows:
JVMARGS=-Djava.library.path=C:\\opt\\maprv1\\hadoop\\hadoop-0.20.2\\lib\\native\\Windows_7-amd64-64
Linux:
JVMARGS=-Djava.library.path=/opt/mapr/hadoop/hadoop-0.20.2/lib/native/Linux-amd64-64
All paths above are derived from the MapR Client installation. If a filename does not exactly match, use the match 
closest to the filename. See 
5.
(Optional) Add properties to service.prop to control the polling, output, and logging for the Sqoop Adapter. See 
.
6.
Restart the Master.
Note: 
Make sure JDK is installed in the machine and set the JAVA_HOME, and add JAVA_HOME/bin to the system 
PATH. The path to the database drivers and the sqoop jars must be added to the HADOOP_CLASSPATH.
MapR Client Software Requirements
When using MapR:
MapR Client software must be configured on the CWA master machine.