Pinned<domain_goes_here> Engineering 101Announcement for series on articles related to tech and engineering with occasional cinema and meme references, to make it more bearable.Jan 23, 2022Jan 23, 2022
How to Be a Developer in a Post-AI WorldI recently explored what it feels like to write code with AI and finish tasks without writing a single line of code. Here’s what I learnt5d ago5d ago
2024: A retrospectiveIt’s been too long a year, I feel. Quite a lot happened in the last 365 days, and I’m here to discuss the ones that fit here.Jan 1Jan 1
Using poetry, and never going back to virtualenvsIn this edition of 3 act engineering, let’s go back in time back in ’07. Its the year when virtualenv was born.Oct 20, 2024Oct 20, 2024
Spark Listener, and how to setup yours [3AE]Unleashing the power of sparklistener and log important metrics about every spark job you run, today, tomorrow, forever.May 26, 2024May 26, 2024
Apache Arrow, making Spark even faster [3AE]Nowadays, as part of my daily job, I have to ask more “Why is this working?” and less of “What is this?” or “How did you do that?”. This…Mar 29, 20241Mar 29, 20241
Data Quality + Orchestration — Part II [3AE]Leveraging Data Quality frameworks like great-expectations to build solid and reliable data pipelines on AirflowFeb 5, 2024Feb 5, 2024
Data Quality, Orchestrated — Part I [3AE]Data Quality (great expectations), Orchestrated (Airflow)Dec 13, 2023Dec 13, 2023
Caching in Python [3AE]Exploring Python inbuilt and outbuilt cache methods an easier wayJul 19, 2023Jul 19, 2023
Building a distributed framework in Go - 1 [3AE]Because, why not? And sibling to Spark, I’m calling it Flicker.Apr 23, 20231Apr 23, 20231