logstash jdbc input 通过mysql数据库为timestamp类型的的字段做增量数据报错
Logstash | 作者 hanyaoyang | 发布于2019年01月24日 | 阅读数:2227
input {
stdin { }
jdbc {
jdbc_connection_string => "****"
jdbc_user => "**"
jdbc_password => "**"
jdbc_driver_library => "/usr/local/elk/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_paging_enabled => "true"
jdbc_page_size => "50000"
schedule => "* * * * *"
statement => "SELECT * FROM da_car_data WHERE LOAD_TIME >=:sql_last_value"
record_last_run => "true"
use_column_value => "true"
tracking_column_type => "timestamp"
tracking_column => "LOAD_TIME"
last_run_metadata_path => "/usr/local/elk/logstash-6.5.4/my_info"
clean_run => "false"
type => "da_car_data"
}
}
配置是这样的 , 下面报错,通过sql解决掉了 ,现在启动logstash之后,全量增加没问题,增量的时候不起效果,my_info文件为空,或者是--- 1969-12-31 16:00:00.000000000 -08:00 ,每次都会全量增加的,一次增加一个表,但是我如果用id字段的话这个配置没问题,每次是增量增加的,用timestamp就是不行
stdin { }
jdbc {
jdbc_connection_string => "****"
jdbc_user => "**"
jdbc_password => "**"
jdbc_driver_library => "/usr/local/elk/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_paging_enabled => "true"
jdbc_page_size => "50000"
schedule => "* * * * *"
statement => "SELECT * FROM da_car_data WHERE LOAD_TIME >=:sql_last_value"
record_last_run => "true"
use_column_value => "true"
tracking_column_type => "timestamp"
tracking_column => "LOAD_TIME"
last_run_metadata_path => "/usr/local/elk/logstash-6.5.4/my_info"
clean_run => "false"
type => "da_car_data"
}
}
配置是这样的 , 下面报错,通过sql解决掉了 ,现在启动logstash之后,全量增加没问题,增量的时候不起效果,my_info文件为空,或者是--- 1969-12-31 16:00:00.000000000 -08:00 ,每次都会全量增加的,一次增加一个表,但是我如果用id字段的话这个配置没问题,每次是增量增加的,用timestamp就是不行
0 个回复