onebirdrocks / geektime-elk Goto Github PK
View Code? Open in Web Editor NEWELK Training
ELK Training
Hi:
docker version: 19.03.13
logstash version: 7.4.0
run command:
docker run -d --name logstash-test -v /home/docker/logstash.conf:/usr/share/logstash/config/logstash.yml logstash:7.4.0
logstash.yml:
`
input {
file {
path => "/home/docker/movies.csv"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}
filter {
csv {
separator => ","
columns => ["id","content","genre"]
}
mutate {
split => { "genre" => "|" }
remove_field => ["path", "host","@timestamp","message"]
}
mutate {
split => ["content", "("]
add_field => { "title" => "%{[content][0]}"}
add_field => { "year" => "%{[content][1]}"}
}
mutate {
convert => {
"year" => "integer"
}
strip => ["title"]
remove_field => ["path", "host","@timestamp","message","content"]
}
}
output {
elasticsearch {
hosts => "http://es-cluster:9200"
index => "movies"
document_id => "%{id}"
user => "es"
password => "pwd"
}
stdout {}
}
**report error**:
cannot unmarshal !!str input {...
into map[string]interface {}`
Can you help me to fix it ,thanks
I have a feeling, this project will be fired up.
因為光看免費的教材投影片就可以學到很多,不知道教材免費提供的用意為何?
這個repo有68人watch,789人打星,2000+人Fork,無法確定這些人是不是都付費購買了此課程?
對於已購買的學生而言,
因為已經是2年前的課程,留言區的討論也並非每則都會回覆。
如果教材視頻只是朗讀投影片並稍作講解,再加上用kibana demo的話,大概沒有必要再花錢購買課程。
很想退費。
windows下没有Mac下面的字体, 导致PDF文字复制乱码, 老师能不能贴一下Word
扩容之后,我在discovery.zen.ping.unicast.hosts增加了全部节点,重启之后,数据同步非常慢,请问有什么好办法吗
阮老师好:
我通过stats聚合获取max和min来算用量,在query中使用的terms query,用terms aggregation来分组,但是发现使用date_histogram 将12月的数据sum 和 直接interval 为年的数据相差很大,但是课程里面讲的观察"doc_count_error_upper_bound" 发现值又是0 就不太明白会是什么地方的问题
"aggs": {
"date": {
"date_histogram": {
"field": "timestamp",
"interval": "month" or "year"
},
"aggs": {
"device": {
"terms": {
"field": "label.deviceId",
"show_term_doc_count_error": true
},
"aggs": {
"stats": {
"stats": {
"field": "value"
}
}
}
}
一鸣哥,我买了你视频,能把github的内容放到一个云盘吗,github真的down不下来
下载 :7.x-docker-2-es-instances/docker-compose.yaml
执行:docker-compose up
生成的2个容器 es7_01 和 es7_02只能启动一个,当启动es7_01时es7_02自动运行结束,当启动es7_02时es7_01自动结束
启动的时候报错,一直在滚动报:
./kibana
[14:57:36.428] [warning][stats-collection] Unable to fetch data from spaces collector
error [14:57:46.510] [warning][stats-collection] [index_not_found_exception] no such index [.kibana], with { resource.type="index_or_alias" & resource.id=".kibana" & index_uuid="na" & index=".kibana" } :: {"path":"/.kibana/_search","query":{},"body":"{"track_total_hits":true,"query":{"term":{"type":{"value":"space"}}},"aggs":{"disabledFeatures":{"terms":{"field":"space.disabledFeatures","include":["discover","visualize","dashboard","dev_tools","advancedSettings","indexPatterns","savedObjectsManagement","timelion","graph","monitoring","ml","apm","maps","canvas","infrastructure","logs","siem","uptime"],"size":18}}},"size":0}","statusCode":404,"response":"{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [.kibana]","resource.type":"index_or_alias","resource.id":".kibana","index_uuid":"na","index":".kibana"}],"type":"index_not_found_exception","reason":"no such index [.kibana]","resource.type":"index_or_alias","resource.id":".kibana","index_uuid":"na","index":".kibana"},"status":404}"}
at respond (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/transport.js:315:15)
at checkRespForFailure (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/transport.js:274:7)
at HttpConnector. (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/src/lib/connectors/http.js:166:7)
at IncomingMessage.wrapper (/usr/local/kibana-7.3.0-linux-x86_64/node_modules/elasticsearch/node_modules/lodash/lodash.js:4929:19)
at IncomingMessage.emit (events.js:194:15)
at endReadableNT (_stream_readable.js:1103:12)
at process._tickCallback (internal/process/next_tick.js:63:19)
ES如何实时同步mysql的数据?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.