This repo mostly contains code related to my Pycon Sweden 2020 talk on "Building Production Ready Search Engine using Python and Elasticsearch"
-
Syncing database with the Elasticsearch. Two ways:
-
Using JDBC driver with Logstash to sync my PostgresDB with my Elasticsearch server.
-
Bulk indexing based on pre-defined mappings in the Elasticsearch and structuring nested data.
-
-
Analyzing Elasticsearch data using Kibana to understand how our search will be returning results to the client on a search query.
This repo will be covering some use-cases covered during the talk.
- Elasticsearch 7.9
- Python 3.8
- Kibana 7.9
- Logstash 7.9
To run all the services together on local, make sure all the prerequisites mentioned above are downloaded.
Elasticsearch, Kibana and Logstash can be launched via downloading the zip from their official website and run bin/<binary-name> where <binary-name> can be kibana or elasticsearch.
Logstash config file can be referred from this repository. Once donwload of Logstash zip is complete, service can be started using bin/logstash -f logstash.conf command.
👤 Harshit Prasad
Twitter: @HarshitPrasad8 Github: @harshit98 Website: harshitprasad.com
Contributions, issues and feature requests are welcome!
Give a ⭐️ if you think this project is awesome!
Copyright © 2020 Harshit Prasad. This project is Apache License licensed.