你好,游客 登录
背景:
阅读新闻

Hadoop常见异常及其解决方案

[日期:2014-07-10] 来源:CSDN博客  作者:jediael_lu [字体: ]

  1、Shell$ExitCodeException

  现象:运行hadoop job时出现如下异常:

  14/07/09 14:42:50 INFO mapreduce.Job: Task Id : attempt_1404886826875_0007_m_000000_1, Status : FAILED

  Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException:

  org.apache.hadoop.util.Shell$ExitCodeException:

  at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)

  at org.apache.hadoop.util.Shell.run(Shell.java:418)

  at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)

  at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)

  at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)

  at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)

  at java.util.concurrent.FutureTask.run(FutureTask.java:262)

  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

  at java.lang.Thread.run(Thread.java:744)

  Container exited with a non-zero exit code 1

  原因及解决办法:原因未知。重启可恢复正常

  2、libhadoop.so.1.0.0 which might have disabled stack guard

  现象:Hadoop 2.2.0 - warning: You have loaded library /home/hadoop/2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard.

  原因及解决方法:

  在/etc/profile中添加:

  #hadoop configuration

  export PATH=$PATH:/home/jediael/hadoop-2.4.1/bin:/home/jediael/hadoop-2.4.1/sbin

  export HADOOP_HOME=/home/jediael/hadoop-2.4.1

  export HADOOP_COMMON_HOME=$HADOOP_HOME

  export HADOOP_HDFS_HOME=$HADOOP_HOME

  export HADOOP_MAPRED_HOME=$HADOOP_HOME

  export HADOOP_YARN_HOME=$HADOOP_HOME

  export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

  export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native

  export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

  此警告出现的原因是最后2项未添加。

    原文链接:http://blog.csdn.net/jediael_lu/article/details/37598727





收藏 推荐 打印 | 录入: | 阅读:
本文评论   查看全部评论 (0)
表情: 表情 姓名: 字数
点评:
       
评论声明
  • 尊重网上道德,遵守中华人民共和国的各项有关法律法规
  • 承担一切因您的行为而直接或间接导致的民事或刑事法律责任
  • 本站管理人员有权保留或删除其管辖留言中的任意内容
  • 本站有权在网站内转载或引用您的评论
  • 参与本评论即表明您已经阅读并接受上述条款