wordpress怎么安装插件,珠海网站seo,网站建设项目教程,wordpress模板地址上一篇讲了普通构建spark项目 这次分享用Maven构建Spark项目#xff0c;中间遇到了很多坑#xff01;其根本原因是Scala 与 Spark的版本不一致#xff01;本次环境#xff1a;Java1.8Scala 2.11.8Spark spark-2.1.0-bin-hadoop2.6.tgz 新建Maven项目图1.选择顺序图2.随便写…上一篇讲了普通构建spark项目 这次分享用Maven构建Spark项目中间遇到了很多坑其根本原因是Scala 与 Spark的版本不一致本次环境Java1.8Scala 2.11.8Spark spark-2.1.0-bin-hadoop2.6.tgz 新建Maven项目图1.选择顺序图2.随便写点什么接下来就是选取Maven环境的选取简单的说一下。如果你电脑上装了Maven 并且IDEA运行过Maven项目则会默认给你带出来你以前配置的环境参数。 这里我对Spark项目单独建立了一个依赖文件夹下图E://M2//Repository3(个人喜欢而已)图3.配置Maven环境图4.给项目命名图5.等待2分钟图6.更改Scala版本 org.apache.hadoop hadoop-common 2.6.0org.apache.hadoop hadoop-hdfs 2.6.0org.apache.spark spark-core_2.11 2.1.0org.apache.spark spark-sql_2.11 2.1.0org.apache.spark spark-hive_2.11 2.1.0org.apache.spark spark-streaming_2.11 2.1.0org.apache.spark spark-mllib_2.11 2.1.0com.databricks spark-avro_2.10 2.0.1然后将上处常用的依赖加入pom文件中图7.刷新依赖上述的过程可能会有点慢不过没关系我这边有阿里的Maven库镜像配置只需要将以下代码Copy到Maven安装目录下的setting文件中替换mirrors对应的位置就OK这样下载任何依赖都是非常的快 public public-group-RELEASE https://maven.aliyun.com/repository/public/ * jcenter jcenter-proxy-RELEASE https://maven.aliyun.com/repository/jcenter/ * spring spring-proxy-RELEASE https://maven.aliyun.com/repository/spring/ * spring-plugin spring-plugin-proxy-RELEASE https://maven.aliyun.com/repository/spring-plugin/ * google google-proxy-RELEASE https://maven.aliyun.com/repository/google/ * central central-proxy-RELEASE https://maven.aliyun.com/repository/central/ * grails-core grails-core-proxy-RELEASE https://maven.aliyun.com/repository/grails-core/ * mapr-public mapr-public-proxy-RELEASE https://maven.aliyun.com/repository/mapr-public/ * apache snapshots apache snapshots-proxy-SNAPSHOT https://maven.aliyun.com/repository/apache-snapshots/ * gradle-plugin gradle-plugin-proxy-RELEASE https://maven.aliyun.com/repository/gradle-plugin/ * releases releases-hosted-RELEASE https://maven.aliyun.com/repository/releases/ * snapshots snapshots-hosted-SNAPSHOT https://maven.aliyun.com/repository/snapshots/ * jboss-public-repository-group JBoss Public Repository Group http://repository.jboss.org/nexus/content/groups/public *图8.卡主了有时IDEA会卡在这里关闭重新打开就好图9.删除插件上面有个插件始终下载不下来就删了它我们也没有用它。然后再刷新Maven就没有错误了。图10.删除默认创建的APP.Object图11.创建Test.Object顺序图12.创建Test.Object代码图13.设置Artifacts图14.设置入口参数图15.设置运行参数配置图14.选择Application尝试运行图15.点击运行报错报错我们把Test整个文件夹删掉。再次运行图16.成功运行有需要文件or技术支持的请私信。谢谢~~~下班~~~
