Spark3.X分布式集群部署
一、部署规划hadoop高可用集群部署参考: Hadoop3.X分布式高可用集群部署 1.1 版本说明 软件 版本 操作系统 CentOS Linux release 7.8.2003 (Core) JAVA jdk-8u271-linux-x64 Hadoop hadoop-3.2.2 Scala Scala2.12.15 Spark spark-3.1.2-bin-hadoop3.2 1.2 集群规划 hostname IP 组件 master 172.16.20.200 NameNode Spark-Master secondmaster 172.16.20.201 NameNode Spark-Master slave1 172.16.20.202 Zookeeper DataNode NodeManage Spark-Worker slave2 172.16.20.203 Zookeeper DataNode NodeManage Spark-Worker slave3 172.16.20....