Spark启动报错|java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory

时间:2021-02-27 08:06:08
at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:156)
at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:77)
... 6 more
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1309)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$startPolling(FsHistoryProvider.scala:204)

Spark启动报错|java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory

 在网页打开192.168.142.101:4000,无法像下面一样打开

 Spark启动报错|java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory

 

说白了就是没在hdfs上创建手机日志的文件夹 hdfs dfs -mkdir direcory

转自:https://blog.csdn.net/zmc921/article/details/80338267