Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To understand the interest, you need to understand the moving parts:

Logstash is a sort of pipeline for data you want to log: you can define multiple inputs, transform/filter the data, and then define multiple outputs.

Example 1: read in your apache logs (input), attach geoip data (transform), and then push the resulting data to elasticsearch (output).

Example 2: read from syslog (input), grep on the input to ignore certain files (filter), then push to graphite for graphing (output).

you can have multiple inputs, multiple transforms/filters, and multiple outputs. You can also chain logstash instances together, so you can have "roll up" logs. Logstash itself is a bit heavy in terms of CPU/RAM (it is written in Java), so there are a few, lighter weight "shippers", and you can ship into a Redis instance to proxy events.

Elasticsearch is a java-based search engine with a great REST API and a _lot_ of features. It is built on top of Lucene. It doesn't have a built in GUI. It also scales out super easily.

Kibana is front-end to Elasticsearch, which lets search/visualize your log events.

Ok, those are the parts, why this is interesting: As other commenters have pointed out, this is a powerful combination for understanding your log data. You can ship logs from apps, services and hosts, visualize what's going on, search, correlate, etc.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: