- JAVA 1.8
- HADOOP 3.3.4
- SPARK 3.3.1
cd java
- Maven
VSCode
- Extension Pack for JAVA
- Maven for JAVA
VSCode ctrl+shift+B
启动 tasks
-
构建Fat JAR(build)
-
发送到Hadoop上执行(run)
./input
输入格式: documentId sentences
1 你好世界!
./python/jieba.zip
VSCode ctrl+shift+B
启动 tasks
- 运行(run)
hdfs://{hdfsip}:9000/input
hdfs://{hdfsip}:9000/output