[MariaDB 설치]
%참고사이트
http://altkeycode.tistory.com/6
https://downloads.mariadb.org/mariadb/repositories/#mirror=kaist&distro=CentOS&distro_release=centos7-amd64--centos7&version=10.2
1. Test user 생성
2. Test database 생성
[Logstash 연동]
1. Mariadb Connector Download
http://xbib.org/repository/org/xbib/elasticsearch/importer/elasticsearch-jdbc/2.3.4.1/ elasti사이트에서 csearch-jdbc-2.3.4.1-dist.zip 다운로드
2. elasticsearch-jdbc-2.3.4.1-dist\elasticsearch-jdbc-2.3.4.1\lib에서 mysql-connector-java-5.1.12.jar 확인
3. Centos 특정 디렉토리에 Copy
mysql-connector-java-5.1.12.jar -> "/usr/share/java/mysql-connector-java-5.1.12.jar”
4. Logstash Configuration
conf 위치 -> /etc/logstash/conf.d/logstash.conf
input {
jdbc {
jdbc_driver_library => "./usr/share/java/mysql-connector-java-5.1.38.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_connection_string => "jdbc:mysql://192.168.0.6:3306/elkDB"
jdbc_pool_timeout => 3000
jdbc_paging_enabled => true
jdbc_page_size => 100000
jdbc_user => "elk"
jdbc_password =>"elk"
schedule => "* * * * *"
#tracking_column_typ => "numeric"
#use_column_value => true
#tracking_column => CREATE_DATE
#charset => "UTF-8"
#parameters => { "tracking_date" => "create_date" }
statement => "SELECT * FROM tb_test_table"
}
}
filter {
}
output {
elasticsearch {
hosts => "localhost:9200"
index => "elk"
}
stdout {
codec => rubydebug
}
}
위와 같이 정의 후
logstash restart를 수행
binding 에러발생시
/var/log/logstash 로그 확인 진행
[참고사이트]
http://peung.tistory.com/13
https://vvhiteboard.github.io/general/2017/11/19/elasticsearch-ELK_example1/
http://digndig.kr/elasticsearch/756/
https://discuss.elastic.co/t/logstash-mariadb-to-elasticsearch-no-error-but-doesnt-load/95127
https://www.elastic.co/guide/en/logstash/5.2/plugins-inputs-jdbc.html
https://discuss.elastic.co/t/jdbc-output-plugin/86833
http://peung.tistory.com/13 (logstash JDBC input plugin 설명)
http://blog.naver.com/PostView.nhn?blogId=hanajava&logNo=221007040292&redirect=Dlog&widgetTypeCall=true