Introduction to Data Streaming


3rd December 2020
Speaker Date: 3rd December 2020
Speaker Time: CET: 10:00-11:00
Attendee Date: 3rd December 2020
Attendee Time: IST: 14:30-15:30 | SGT: 17:00-18:00 | AEDT: 20:00-21:00
Duration: 50 mins
Nicolas Frankel
Developer Advocate, Hazelcast

While software is eating the world, those who are able to manage the huge mass of data will emerge out on the top.

The batch processing model has been faithfully serving us for decades. However, it might have reached the end of its usefulness for all but some very specific use-cases. As the pace of businesses increases, most of the time, decision makers prefer slightly wrong data sooner, than 100% accurate data later. Stream processing matches this usage: instead of managing the entire bulk of data, manage pieces of them as soon as they become available.

In this talk, Nicolas will define the context in which the batch processing model was born, reasons behind the new stream processing one, how they compare, what are their pros and cons, and a list of existing technologies implementing the latter with their most important characteristics. Nicolas' talk will conclude by describing one possible use-case of data streaming that is not possible with batches: display in (near) real-time all trains in Switzerland and their position on a map. He will go through all requirements and design and finally, using an OpenData endpoint and the Hazelcast platform, he will try to impress you with a demo of it.

You may also be interested in

26th, November

Time
Systems Thinking

Albert Einstein once said — “We cannot solve our problems with the same thinking we used when we created them.” As...

26th, November

Time
10x productivity for Developers and Architects

Productivity is key to success in software development. We will be exploring different principles, so you do not have to...

3rd, September

Time
Leading & Guiding Development Teams

By definition, a tech leader is responsible for leading and guiding development teams. In this session we will take a...

3rd, September

Time
Uncovering your Personal Values

We regularly review our code and attend retros, but what about tracking and reviewing our personal identity? We all know...

26th, November

Time
Slowdown to Gain Speed: Technical practices that take time but save time

As a software development manager or a technical leader you are eager to remove impediments so your team can produce...

3rd, September

Time
Design Principles for the Effective Developer

How many design patterns and principles can you name as developer? Are they important? Should we not rather focus on...