hadoop错误--集群启动master时namenode进程无法启动
- 1、下载文档前请自行甄别文档内容的完整性,平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益,请联系客服反馈,我们会尽快为您处理(人工客服工作时间:9:00-18:30)。
hadoop错误--集群启动master时namenode进程⽆法启动
1. 执⾏./sbin/start-dfs.sh后查看进程发现namecode进程没有启动成功,
2.查看对于⽇志⽂件logs/hadoop-root-namenode-VM-0-16-centos.log,出现如下错误提⽰:
2020-07-25 09:57:51,331 INFO org.apache.hadoop.http.HttpServer2: HttpServer.start() threw a non Bind IOException
.BindException: Port in use: master:50070
at org.apache.hadoop.http.HttpServer2.constructBindException(HttpServer2.java:1198)
at org.apache.hadoop.http.HttpServer2.bindForSinglePort(HttpServer2.java:1220)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:1279)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1134)
at NodeHttpServer.start(NameNodeHttpServer.java:177)
at Node.startHttpServer(NameNode.java:869)
at Node.initialize(NameNode.java:691)
at Node.<init>(NameNode.java:937)
at Node.<init>(NameNode.java:910)
at Node.createNameNode(NameNode.java:1643)
at Node.main(NameNode.java:1710)
Caused by: .BindException: Cannot assign requested address
at .bind0(Native Method)
at .bind(Net.java:433)
at .bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:351)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:319)
at org.apache.hadoop.http.HttpServer2.bindListener(HttpServer2.java:1185)
at org.apache.hadoop.http.HttpServer2.bindForSinglePort(HttpServer2.java:1216)
... 9 more
2020-07-25 09:57:51,336 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
2020-07-25 09:57:51,337 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
2020-07-25 09:57:51,337 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete. 2020-07-25 09:57:51,337 ERROR Node: Failed to start namenode.
.BindException: Port in use: master:50070
at org.apache.hadoop.http.HttpServer2.constructBindException(HttpServer2.java:1198)
at org.apache.hadoop.http.HttpServer2.bindForSinglePort(HttpServer2.java:1220)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:1279)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1134)
at NodeHttpServer.start(NameNodeHttpServer.java:177)
at Node.startHttpServer(NameNode.java:869)
at Node.initialize(NameNode.java:691)
at Node.<init>(NameNode.java:937)
at Node.<init>(NameNode.java:910)
at Node.createNameNode(NameNode.java:1643)
at Node.main(NameNode.java:1710)
Caused by: .BindException: Cannot assign requested address
at .bind0(Native Method)
at .bind(Net.java:433)
at .bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:351)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:319)
at org.apache.hadoop.http.HttpServer2.bindListener(HttpServer2.java:1185)
at org.apache.hadoop.http.HttpServer2.bindForSinglePort(HttpServer2.java:1216)
... 9 more
2020-07-25 09:57:51,338 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: .BindException: Port in use: master:50070 2020-07-25 09:57:51,375 INFO Node: SHUTDOWN_MSG:
3. 解决⽅案:
修改vim /etc/hosts,将本机映射IP修改成内⽹IP(申请的腾讯云主机有内⽹IP和外⽹IP)
另外的SecondaryNameNode,资源管理节点等其他slave节点也是同样修改/etc/hosts的本机为当前节点内⽹IP,查看后也恢复 4. 重新执⾏./sbin/start-dfs.sh后查看进程发现namecode进程:。