onebirdrocks / geektime-elk Goto Github PK

Hi:
docker version: 19.03.13
logstash version: 7.4.0
run command:
docker run -d --name logstash-test -v /home/docker/logstash.conf:/usr/share/logstash/config/logstash.yml logstash:7.4.0
logstash.yml:
`
input {
file {
path => "/home/docker/movies.csv"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}
filter {
csv {
separator => ","
columns => ["id","content","genre"]
}

mutate {
split => { "genre" => "|" }
remove_field => ["path", "host","@timestamp","message"]
}

mutate {

split => ["content", "("]
add_field => { "title" => "%{[content][0]}"}
add_field => { "year" => "%{[content][1]}"}

}

mutate {
convert => {
"year" => "integer"
}
strip => ["title"]
remove_field => ["path", "host","@timestamp","message","content"]
}

}
output {
elasticsearch {
hosts => "http://es-cluster:9200"
index => "movies"
document_id => "%{id}"
user => "es"
password => "pwd"
}
stdout {}
}
**report error**：cannot unmarshal !!str input {... into map[string]interface {}`

Can you help me to fix it ,thanks

I have a feeling, this project will be fired up.

因為光看免費的教材投影片就可以學到很多，不知道教材免費提供的用意為何？

這個repo有68人watch，789人打星，2000+人Fork，無法確定這些人是不是都付費購買了此課程？

對於已購買的學生而言，

因為已經是2年前的課程，留言區的討論也並非每則都會回覆。

如果教材視頻只是朗讀投影片並稍作講解，再加上用kibana demo的話，大概沒有必要再花錢購買課程。

很想退費。

windows下没有Mac下面的字体, 导致PDF文字复制乱码, 老师能不能贴一下Word

扩容之后，我在discovery.zen.ping.unicast.hosts增加了全部节点，重启之后，数据同步非常慢，请问有什么好办法吗

阮老师好：
我通过stats聚合获取max和min来算用量，在query中使用的terms query，用terms aggregation来分组,但是发现使用date_histogram 将12月的数据sum 和 直接interval 为年的数据相差很大，但是课程里面讲的观察"doc_count_error_upper_bound" 发现值又是0 就不太明白会是什么地方的问题
"aggs": {
"date": {
"date_histogram": {
"field": "timestamp",
"interval": "month" or "year"
},
"aggs": {
"device": {
"terms": {
"field": "label.deviceId",
"show_term_doc_count_error": true
},
"aggs": {
"stats": {
"stats": {
"field": "value"
}
}
}
}

一鸣哥，我买了你视频，能把github的内容放到一个云盘吗，github真的down不下来

下载 ：7.x-docker-2-es-instances/docker-compose.yaml
执行：docker-compose up
生成的2个容器 es7_01 和 es7_02只能启动一个，当启动es7_01时es7_02自动运行结束，当启动es7_02时es7_01自动结束

启动的时候报错，一直在滚动报：
./kibana

[14:57:36.428] [warning][stats-collection] Unable to fetch data from spaces collector
error [14:57:46.510] [warning][stats-collection] [index_not_found_exception] no such index [.kibana], with { resource.type="index_or_alias" & resource.id=".kibana" & index_uuid="na" & index=".kibana" } :: {"path":"/.kibana/_search","query":{},"body":"{"track_total_hits":true,"query":{"term":{"type":{"value":"space"}}},"aggs":{"disabledFeatures":{"terms":{"field":"space.disabledFeatures","include":["discover","visualize","dashboard","dev_tools","advancedSettings","indexPatterns","savedObjectsManagement","timelion","graph","monitoring","ml","apm","maps","canvas","infrastructure","logs","siem","uptime"],"size":18}}},"size":0}","statusCode":404,"response":"{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [.kibana]","resource.type":"index_or_alias","resource.id":".kibana","index_uuid":"na","index":".kibana"}],"type":"index_not_found_exception","reason":"no such index [.kibana]","resource.type":"index_or_alias","resource.id":".kibana","index_uuid":"na","index":".kibana"},"status":404}"}
at respond (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/transport.js:315:15)
at checkRespForFailure (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/transport.js:274:7)
at HttpConnector. (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/connectors/http.js:166:7)
at IncomingMessage.wrapper (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/node_modules/lodash/lodash.js:4929:19)
at IncomingMessage.emit (events.js:194:15)
at endReadableNT (_stream_readable.js:1103:12)
at process._tickCallback (internal/process/next_tick.js:63:19)

ES如何实时同步mysql的数据？