下载一个 hadoop-eclipse-plugin-*.jar的eclipse插件,并放在plugins目录下
重启eclipse
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVMU9UQTFMVEV6TXpnMk9UQTVNUzV3Ym1jPS5qcGc%3D.jpg?w=700&webp=1)
打开视象,找“大象”
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVMk5UWXlMVE0yTmpZNU56YzJPQzV3Ym1jPS5qcGc%3D.jpg?w=700&webp=1)
连接HDFS
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVM01qRTRMVE0zTWpjMk9UTTJMbkJ1Wnc9PS5qcGc%3D.jpg?w=700&webp=1)
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVM05qQTVMVGc0T1RrMk9UUXVjRzVuLmpwZw%3D%3D.jpg?w=700&webp=1)
success
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVM09UVXlMVEV4TWpnek5qZ3pNRFF1Y0c1bi5qcGc%3D.jpg?w=700&webp=1)
编程准备:
1.建个java项目
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVNE16RXlMVGs0TkRZME1EazFOQzV3Ym1jPS5qcGc%3D.jpg?w=700&webp=1)
在项目下建个文件夹,如lib,导入所需的jar包。然后选中所有的jar包builtpath
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TURVNE56TTBMVEUwTkRnNU1EZzJPRFV1Y0c1bi5qcGc%3D.jpg?w=700&webp=1)
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TVRBd01EWXlMVFE1TnprM01EVTVOQzV3Ym1jPS5qcGc%3D.jpg?w=700&webp=1)
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TVRBek16YzBMVFEzTVRRMk56TXlMbkJ1Wnc9PS5qcGc%3D.jpg?w=700&webp=1)
mapreduce-client和hdfs是关键的,还有yarn-client
IKAnalyzer用于分词
MR流程:1.切分(不写代码);2.mapper(开始写代码)3.
mapper须继承父类Mapper
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TVRBME9UVXlMVEV6TWpnd05qRTVPRGN1Y0c1bi5qcGc%3D.jpg?w=700&webp=1)
重写map方法
![使用eclipse搭建hadoop开发环境 使用eclipse搭建hadoop开发环境](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhBdmFXMWhaMlZ6TWpBeE5TNWpibUpzYjJkekxtTnZiUzlpYkc5bkx6UXhOVEl5TVM4eU1ERTJNRFV2TkRFMU1qSXhMVEl3TVRZd05UQTRNVGt5TVRBMU5ETTNMVGd3TVRrNE16RXpNeTV3Ym1jPS5qcGc%3D.jpg?w=700&webp=1)