How (not) to Scale Elasticsearch for Data Analytics!


3rd December 2020
Speaker Date: 3rd December 2020
Speaker Time: IST: 16:00-16:30
Attendee Date: 3rd December 2020
Attendee Time: IST: 16:00-16:30 | SGT: 18:30-19:00 | AEDT: 21:30-22:00
Duration: 25 mins
Aishwarya Sankaravadivel
Senior Software Engineer, PayPal

Search is ubiquitous - From booking a cab on Ride sharing platforms to searching for a job on LinkedIn, Elasticsearch has emerged as a prominent solution for extensive data analytics and searches. Due it’s distributed nature and ability to offer powerful visualizations, it serves as a key tool for deriving actionable insights. And, the recent advancements in Elasticsearch using ML stands out due to its simplicity in data analytics.

While Elasticsearch’s out of the box defaults works for smaller implementations, the nuances of handling a massive deployment in order to scale for petabytes of data and billions of ingests & searches per day requires a deeper knowledge on Elasticsearch internals.

In this talk, we will cover:

  • Learnings from our experiences in managing and scaling enterprise grade
  • Elasticsearch clusters with specific details around the things that can go wrong and how we could mitigate them.
  • Our inhouse security plugin that saved us 1 Million$ licensing cost.
  • Gaining actionable insights using ML
  • Demo of the features that we built on the top of Elasticsearch for scaling it.

You may also be interested in

26th, November

Time
10x productivity for Developers and Architects

Productivity is key to success in software development. We will be exploring different principles, so you do not have to...

26th, November

Time
Principles of Productive Software Developers

When working as a software developer, as well as in any other job, it’s important to be productive and to...

3rd, September

Time
Pull My Code: Effective Code Review

We need to talk about code reviews. Having a strong, effective code review process is the key-stone of quality, culture, learning...

26th, November

Time
Systems Thinking

Albert Einstein once said — “We cannot solve our problems with the same thinking we used when we created them.” As...

3rd, September

Time
Imposter Syndrome: Overcoming Self-Doubt in Success

Impostor Syndrome is the domain of the high achiever. Those who set the bar low are rarely it’s victim. What...

26th, November

Time
Identifying And Removing Impediments

Executing a software project has many challenges. For a team to function smoothly and deliver working solution we have to...