Sqoop: Failed to load mysql driver exception

Question

I installed Sqoop on my local computer. The following is the configuration information.

Bash.bashrc:

export HADOOP_HOME=/home/hduser/hadoop
export HBASE_HOME=/home/hduser/hbase
export HIVE_HOME=/home/hduser/hive
export HCAT_HOME=/home/hduser/hive/hcatalog
export SQOOP_HOME=/home/hduser/sqoop

export PATH=$PATH:$HIVE_HOME/bin
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HBASE_HOME/bin
export PATH=$PATH:$SQOOP_HOME/bin
export PATH=$PATH:$HCAT_HOME/bin

Hadoop:

Version: Hadoop 1.0.3

Hive:

Version: hive 0.11.0 

Mysql Connector Driver

version: mysql-connector-java-5.1.29

"The driver is copied to the lib folder of sqoop"

Sqoop:

version: sqoop 1.4.4

After completing the whole installation, I create a table in mysql called practice_1. But when I run the load command to load data from mysql to hdfs, the command throws an exception:

ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not     load db driver class: com.mysql.jdbc.Driver

Coud, someone please call me, what could be a possible problem.

Answer 1

You need a database driver in the "SQOOP" class to test this class . This one has a great explanation about 'SQOOP'

SQOOP ,

: --driver com.microsoft.jdbc.sqlserver.SQLServerDriver -libjars = ". * jar"

Sqoop JDBC- . JDBC , , .jar $SQOOP_HOME/lib . ( /usr/lib/sqoop/lib, RPM Debian.) .jar , . , MySQL Connector/J com.mysql.jdbc.Driver. . Sqoop --driver.

-

Answer 2

, , jar- sqoop HADOOP_CLASSPATH. -libjars. .

HADOOP_CLASSPATH=/use.case/lib/postgresql-9.2-1003-jdbc4.jar
sqoop export --connect jdbc:postgresql://db:5432/user \
  --driver org.postgresql.Driver \
  --connection-manager org.apache.sqoop.manager.GenericJdbcManager \
  --username user \
  -P \
  --export-dir /user/hive/warehouse/db1/table1 \
  --table table2

, , sqoop 1.4.3-cdh4.4.0

Answer 3

MySql /usr/lib/sqoop/lib. MySQL JDBC Sqoop, , Apache. , ...!!!

Answer 4

mysql sqoop lib. . , sqoop .

/home/hduser/sqoop/bin/sqoop import --connect jdbc:mysql://localhost:3306/test --username root --password root -–table practice_1 -m 1

Answer 5

'mysql-connector-java-5.1.41-bin.jar' sqoop/lib sqoop

Answer 6

Oozie ShareLib. :

Shell

sudo -u hdfs hadoop fs -chown cloudera:cloudera /user/oozie/share/lib/lib_20170719053712/sqoop
hdfs dfs -put /var/lib/sqoop/mysql-connector-java.jar /user/oozie/share/lib/lib_20170719053712/sqoop
sudo -u hdfs hadoop fs -chown oozie:oozie /user/oozie/share/lib/lib_20170719053712/sqoop

oozie admin -oozie http://localhost:11000/oozie -sharelibupdate
oozie admin -oozie http://localhost:11000/oozie -shareliblist sqoop

Hue Sqoop Client

sqoop list-tables --connect jdbc:mysql://localhost/retail_db --username root --password cloudera

:

https://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-apache-oozie-cdh-5/

Answer 7

priveleges , :

. * 'root'@'192.168.168.1' "root123";

flush;

, :

sqoop import --verbose --fields-terminated-by ',' --connect jdbc: mysql: //192.168.168.1/test - root username --password root123 -table student -hive-import --creative-hive- table -hive-home / home / training / hive -warehouse-dir / user / hive / store --fields-terminated-by ',' -hive-table studentmysql