spark运行报： Scala module 2.10.0 requires Jackson Databind version ＞= 2.10.0 and ＜ 2.11.0

这是jackson多版本问题, 我们需要屏蔽所有hadoop 组件中的Jackson ,修改pom文件,之后就不报异常了<dependency><groupId>org.apache.hadoop</groupId><artifactId>hadoop-common</artifactId><version>${hadoop.

猫头鹰数据分析

4882人浏览 · 2021-07-30 11:18:01

猫头鹰数据分析 · 2021-07-30 11:18:01 发布

这是jackson多版本问题 , 我们需要屏蔽所有hadoop 组件中的Jackson ,修改pom文件,之后就不报异常了

     <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>${hadoop.version}</version>
            <exclusions>
                <exclusion>
                    <groupId>com.fasterxml.jackson.module</groupId>
                    <artifactId>*</artifactId>
                </exclusion>
                <exclusion>
                    <groupId>com.fasterxml.jackson.core</groupId>
                    <artifactId>*</artifactId>
                </exclusion>
            </exclusions>
        </dependency>

        <!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-mapreduce-client-core -->
       <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-mapreduce-client-core</artifactId>
            <version>${hadoop.version}</version>
            <exclusions>
                <exclusion>
                    <groupId>com.fasterxml.jackson.module</groupId>
                    <artifactId>*</artifactId>
                </exclusion>
                <exclusion>
                    <groupId>com.fasterxml.jackson.core</groupId>
                    <artifactId>*</artifactId>
                </exclusion>
            </exclusions>
        </dependency>