Solving Analytical Problems using Apache Spark


Duration: 50 mins
Rohit Bhardwaj
Senior Architect, Cloud-native Expert in cloud-native solutions

In this talk, we will explore why Spark is the most prominent solution as compared to just Hadoop. We will look at MapReduce and how Spark makes the creation of Big Data algorithms simple and faster. Next, we will explore Spark Context and how Resilient Distributed Dataset (RDD) to help with the establishment of Directed Acyclic Graph (DAG); Transformations using map and filter; Actions using collect, count and reduce. Later we will explore the Spark Cassandra connector. We will look at Spark API and Spark SQL. We will also discuss how DataStax helps give a high level of stability to open source Apache Spark and Apache Cassandra projects. Key takeaways from this talk will be for a developer and architect to understand how Apache Spark and Apache Cassandra helps in implementing enterprise level analytical solutions. It is 100x faster than Hadoop!

You may also be interested in

180 mins
Foundations of Tech Leadership

According to a CareerBuilder study, only 40% of new engineering leaders receive formal training when they become a boss for...

50 mins
10x productivity for Developers and Architects

Productivity is key to success in software development. We will be exploring different principles, so you do not have to...

50 mins
So You’ve Just Become a Tech Lead - Great! Now What?

You have just been promoted to a Tech Lead role - Congratulations! But something is wrong :(. Suddenly, you’re struggling...

25 mins
Developer is 'King' - Unleashing Innovation by Unblocking your Developers

As each industry is disrupted by the wave of digital transformation, harnessing and unlocking new ideas can only be done...

50 mins
Imposter Syndrome: Overcoming Self-Doubt in Success

Impostor Syndrome is the domain of the high achiever. Those who set the bar low are rarely it’s victim. What...

25 mins
How to Validate your Startup Idea Quickly

I work at Facebook's Innovation Lab as an Engineering Lead. As part of that, I help with rapidly prototyping and...