Elasticsearch presentation at Devoxx Greece 2023

In May 2023 the first ever Devoxx Greece took place over 3 days, with 60+ speakers, 70+ sessions and 1000+ attendees, in the Athens Megaron International Conference Center. It was an honor to be one of the speakers!

My presentation was titled “Finding needles in ever increasing haystacks - Scalability with Elasticsearch”. The abstract of the presentation is:

The Elastic Stack tackles modern-day observability & security demands of fast-paced searches in ever-increasing data volumes. Elasticsearch, sitting at the core of the Elastic Stack, is a leading distributed search and analytics engine. In this talk, we give an overview of what makes Elasticsearch distributed, efficient and resilient both on bare-metal and on the cloud. This includes an overview of advancements made in recent years. You will learn how: (a) data is ingested, sharded and replicated, (b) searches and aggregations are distributed, (c) recovery works in the event of failures. We conclude with the serverless cloud vision of Elasticsearch for unparallel scalability.

You can access the video recording of the presentation here:

The slides of the presentation are available here to download in PDF format.

The agenda of the presentation revolves around the topics:

• What is Elastic.
• What is Elasticsearch, Apache Lucene and inverted indices.
• How Elasticsearch scales out with primary and replica shards.
• How distributed searches & aggregations are executed on multiple machines.
• Shard recovery when a machine fails.
• How core information metadata on cluster state is coordinated with consensus across the cluster machines.
• Scaling with data streams for append-only time series data.
• Scaling with Index Lifecycle Management (ILM) across tiers of data nodes with different cost/performance characteristics.
• Future vision on scaling with serverless.

More videos from Devoxx Greece 2023 are available on their Youtube playlist, and photos from the event on Flickr (1, 2, 3).

Enjoy and feel free to share your feedback!