PinnedAman Jaiswal<domain_goes_here> Engineering 101Announcement for series on articles related to tech and engineering with occasional cinema and meme references, to make it more bearable.Jan 23, 2022Jan 23, 2022
Aman JaiswalSpark Listener, and how to setup yours [3AE]Unleashing the power of sparklistener and log important metrics about every spark job you run, today, tomorrow, forever.May 26May 26
Aman JaiswalApache Arrow, making Spark even faster [3AE]Nowadays, as part of my daily job, I have to ask more “Why is this working?” and less of “What is this?” or “How did you do that?”. This…Mar 291Mar 291
Aman JaiswalData Quality + Orchestration — Part II [3AE]Leveraging Data Quality frameworks like great-expectations to build solid and reliable data pipelines on AirflowFeb 5Feb 5
Aman JaiswalData Quality, Orchestrated — Part I [3AE]Data Quality (great expectations), Orchestrated (Airflow)Dec 13, 2023Dec 13, 2023
Aman JaiswalCaching in Python [3AE]Exploring Python inbuilt and outbuilt cache methods an easier wayJul 19, 2023Jul 19, 2023
Aman JaiswalBuilding a distributed framework in Go - 1 [3AE]Because, why not? And sibling to Spark, I’m calling it Flicker.Apr 23, 20231Apr 23, 20231
Aman JaiswalKafka with Python: Part 2 [3AE]Streaming with some more pythonic swagOct 31, 2022Oct 31, 2022
Aman JaiswalKafka with Python: Streaming with some pythonic swag - Part 1 [3AE]How to setup Kafka with Python for your next data engineering/data science project.Sep 9, 2022Sep 9, 2022