Searching for Time Series Patterns at Big Data Scale


3rd December 2020
Speaker Date: 3rd December 2020
Speaker Time: AEDT: 12:00-13:00
Attendee Date: 3rd December 2020
Attendee Time: IST: 06:30-07:30 | SGT: 09:00-10:00 | AEDT: 12:00-13:00
Duration: 50 mins
Ananth Gundabattula
Senior Architect, Commonwealth Bank of Australia

Time series patterns are pretty common in everyday life. Extracting patterns on these data sets and providing interactive search responses has immense value across many software systems. This talk presents an overview of how such a search system can be built for very large time series data points.

This talk focuses on the STAMP algorithm (Scalable Time Series Anytime Matrix profile) to showcase how time series patterns can be extracted for big data sets. The talk covers concepts of Matrix profile and how motifs/patterns are detected. Once the patterns are analyzed, the results are converted into a document format that is amenable for indexing via a search engine. The session then proceeds to extend the idea to detecting time series across multiple dimensions. A part of the session also covers the distributed approach to extract these time series patterns to tackle big data sets. Further, you will also learn about mechanisms to calculate time series segmentations, time series chains and discords or anomalies thereby enabling ideas for users to search for anomalies and segments of time series.

Dask, Stumpy and Elasticsearch stack is used to describe a reference implementation.

You may also be interested in

26th, November

Time
Designers + Developers = Best Friends Forever?

How is the relationship between your design team and your development team? Is it highly functional? Or 'just professional'? Maybe...

3rd, September

Time
Do You Know Da Wae

We build development teams based on individual ability to write code but development of a software project of any significance...

26th, November

Time
Principles of Productive Software Developers

When working as a software developer, as well as in any other job, it’s important to be productive and to...

3rd, September

Time
Hiring and Training the Next Generation of Amazing Developers

This talk covers a current problem that we face in all companies: it's hard to find, let alone hire great...

26th, November

Time
10x productivity for Developers and Architects

Productivity is key to success in software development. We will be exploring different principles, so you do not have to...

26th, November

Time
Mental Bookmarks and the Fractal Nature of Success

Good discussions are supposed to diverge from their intended path. Free association is a feature, not a bug, and helps...