在hadoop的集群中运行sqoop时报错如下:
16/04/28 06:21:41 ERROR : Encountered IOException running import job:
: File does not exist: <span style="color:#ff0000;">hdfs://mycluster/home/sqoop-
1.4.6/lib/commons-codec-1</span>
. at $
(:1072)
at $
(:1064)
at
(:81)
at
(:1064)
at
(:288)
at
(:224)
at
s(:93)
at
sAndCacheVisibilities(:57)
at
(:265)
at
(:301)
at
(:389)
at $(:1285)
at $(:1282)
at (Native Method)
at (:415)
at
(:1614)
at (:1282)
at (:1303)
at
(:196)
at (:169)
at (:266)
at (:673)
at (:118)
at (:497)
at (:605)
at (:143)
at (:70)
at (:179)
at (:218)
at (:227)
at (:236)
错误中可以看到有这么语句话
hdfs://mycluster/home/sqoop-1.4.6/lib/commons-codec-1. 红色部分“hdfs://mycluster” 说明查找commons-codec-1. 是在hadoop集群中查找,同时jar包是个资源是由resourcemanager统一管理,如此推测很有可能是中配置不正确所导致。
解决办法如下:
1.修改hadoop配置目录中的的内容如下:红色部分需根据自己的集群配置情况而定
<configuration>
<property>
<name>-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name></name>
<value>true</value>
</property>
<property>
<name>-id</name>
<value><span style="color:#ff0000;">mycluste</span>r</value>
</property>
<property>
<name>-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>.rm1</name>
<value><span style="color:#ff0000;">node5</span></value>
</property>
<property>
<name>.rm2</name>
<value><span style="color:#ff0000;">node8</span></value>
</property>
<property>
<name>-address</name>
<value><span style="color:#ff0000;">node5,node6,node7</span></value>
</property>
</configuration>
2.修改内容如下:
<configuration>
<property>
<name></name>
<value>yarn</value>
</property>
</configuration>
修改完以上两个文件的内容后重新启动hadoop集群和运行sqoop命令即可,
如果此文章对你有帮助请点个赞写这么多也不容易旨在分享自己的知识,与大家共勉,点赞哦
---------------------
作者:富的只剩下代码
来源:****
原文:/liyongke89/article/details/51276384
版权声明:本文为博主原创文章,转载请附上博文链接!