We can all agree that the name “Kafka” can be intimidating, but it’s no big deal. Data pipelines can happen in two different ways : Batch or Stream. Batch pipelines process the data by chunk, and they run periodically in general. Stream pipelines on the other hand process the data

For every data professional, the worst thing that can happen is having no data about the problem they are trying to solve. Sometimes the problem is so complex you can’t even afford to spend time worrying about collecting and processing data, you need it in a ready-to-use state ASAP.

Knowledgeable? or just gathering information?Nowadays, it’s very easy to be overwhelmed by the huge amount of information thrown at us through the internet, but surprisingly, even though the information is widely accessible to almost everyone, very few people are knowledgeable. Being knowledgeable about a subject is understanding it

In data science, 80% of the resources ( time, energy.. ) are spent on data collection, processing and cleaning, and only 20% is spent building AI models and analyzing data. I am currently working as a Data Scientist and I spend a good part of my time doing Data Engineering before getting

In my experience as a software engineer and Data science enthusiast, I've been fascinated by how many insights you can get by analyzing the right data. I started to download datasets and trying to process and visualize them. But sometimes I wanted to work with specific data on the internet