If you have used LinkedIn, Facebook, Airbnb, Pinterest, Uber and Netflix, whether you know it or not you have used the power of Apache Kafka
Just take the case of Netflix: In around April 2020 its Monthly Active Users(MAU) were around 93 Million. By October 2020 it is around 195 Million MAU.
From the engineering and business growth point of view Netflix is a “Data Driven Company”. The world uses its Movies and shows OTT. The operating income of $1.2 billion as of 2020 is the result of data analytics.
Now imagine the volume of user event data being captured and processed. As per the Evolution of Netflix Data Pipeline (2016) there are around 500 billion events. which amounts to 1.PB per day
Apache Kafka has played a key role in the analytics for Netflix. Apache Kafka, AWS S3, apache Hadoop and Elastic search play a key role its data achitecture.
Similarly here is the architecture for Pinterest
Michelle Wetzler has more info in her blog
Recent Comments