spark插入数据出错:org.apache.hadoop.hive.ql.metadata.HiveException: Exception when loading 1 in table dim_
·
1.
org.apache.hive.service.cli.HiveSQLException:
Error running query: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Exception
when loading 1 in table dim_com_manager with
loadPath=hdfs://node1:8020/user/hive/warehouse/finance2.db/dim_com_manager/.hive-staging_hive_2025-08-18_23-00-47_453_2283401006887053132-5/-ext-10000
2.解决方案:重启spark远程服务即可
3.停止命令(linux):
/export/server/spark/sbin/stop-thriftserver.sh
4.开启命令:
/export/server/spark/sbin/start-thriftserver.sh \
> --hiveconf hive.server2.thrift.port=10001 \
> --hiveconf hive.server2.thrift.bind.host=node1 \
> --master yarn \
> --conf spark.sql.shuffle.partitions=2
5.重新运行成功
更多推荐
所有评论(0)