Introduction to Data Streaming


Duration: 50 mins
Nicolas Frankel
Developer Advocate, Hazelcast

While software is eating the world, those who are able to manage the huge mass of data will emerge out on the top.

The batch processing model has been faithfully serving us for decades. However, it might have reached the end of its usefulness for all but some very specific use-cases. As the pace of businesses increases, most of the time, decision makers prefer slightly wrong data sooner, than 100% accurate data later. Stream processing matches this usage: instead of managing the entire bulk of data, manage pieces of them as soon as they become available.

In this talk, Nicolas will define the context in which the batch processing model was born, reasons behind the new stream processing one, how they compare, what are their pros and cons, and a list of existing technologies implementing the latter with their most important characteristics. Nicolas' talk will conclude by describing one possible use-case of data streaming that is not possible with batches: display in (near) real-time all trains in Switzerland and their position on a map. He will go through all requirements and design and finally, using an OpenData endpoint and the Hazelcast platform, he will try to impress you with a demo of it.

You may also be interested in

25 mins
Writing Professionally

The most important thing you do in your job is write. It's in every email you send, every commit you...

25 mins
Eliminating Hero Culture on our Engineering Teams

Hero Culture can be found within any company dominated by employees that are constantly rewarded for going the extra mile,...

50 mins
Leading & Guiding Development Teams

By definition, a tech leader is responsible for leading and guiding development teams. In this session we will take a...

25 mins
Dealing with Noobs: How to Work with Non-Technical People

The secret to being the hero of your story? Helping others be the hero of theirs. Take a business problem you...

50 mins
Build Your Own Tech Radar, Capture Your Org's Tech Posture

Software industry changes at a crazy speed. There are always new things coming in and going out of the eco-system...

50 mins
All That Glitters Ain't Gold

Let’s use Kafka, everywhere! Let’s try event driven architecture! How about Rust for this service? Let’s use Elixir for this!...