The current world is heavily dependent on data. Everyone is generating large amount. It is becoming challenge reading large amount of data and then process it and finally perform some action on that data.

In this post we will be creating a data pipeline where in we will be performing three responsibilities

Read data from Kafka topic
Process it using Logstash
Dump the data to elastic search and then visualize the data using Kibana

Links :
- Elasticsearch and Kibana Installation
http://selftuts.in/elasticsearch-and-...
   • Install Elasticsearch and Kibana usin...  

- Logstash Installation
http://selftuts.in/install-logstash-o...
   • Install Logstash on Ubuntu 18 04 | EL...  

- Kafka Installation
http://selftuts.in/install-kafka-and-...

- Kafka for beginners
   • Part 1 - What is Kafka | Kafka for be...  

- Data pipeline using Kafka and elasticsearch
http://selftuts.in/create-data-pipeli...