
002、Seatunnle同步mysql数据库
seatunnel mysql同步
·
1、创建配置文件
cd /data/apache-seatunnel-2.3.3,创建mysql.template文件,文件内容如下(不同的数据库,有不同的模板,mysql参考如下:MySQL | Apache SeaTunnel)。
env {
execution.parallelism = 2
job.mode = "BATCH"
checkpoint.interval = 10000
}
source {
Jdbc {
url = "jdbc:mysql://127.0.0.1:3306/test"
driver = "com.mysql.cj.jdbc.Driver"
connection_check_timeout_sec = 100
user = "root"
password = "123456"
query = "select * from user"
partition_column = "id"
partition_lower_bound = 1
partition_upper_bound = 5000
partition_num = 10
}
}
sink {
Console {
}
}
2、执行脚本
./bin/seatunnel.sh --config ./config/mysql.template -e local,此时由于没有拷贝mysql连接的jar包,会报错(java.lang.ClassNotFoundException: com.mysql.cj.jdbc.Driver)

3、下载jar包,放入lib目录中
mysql-connector-j-8.3.0.jar,下载此jar包,并放入apache-seatunnel-2.3.3/lib中。下载地址:https://mvnrepository.com/artifact/mysql/mysql-connector-java
4、重新运行脚本
/bin/seatunnel.sh --config ./config/mysql.template -e local,日志中显示如下内容,标示成功。

更多推荐


所有评论(0)