Category: Data Engineering

  • Building an End-to-End Vector Search Pipeline with Azure + LangChain

    Building an End-to-End Vector Search Pipeline with Azure + LangChain

    ✍️ 𝐁𝐲 𝐀𝐛𝐡𝐢𝐬𝐡𝐞𝐤 𝐊𝐮𝐦𝐚𝐫 | #FirstCrazyDeveloper 💡 Why This Matters More Than Ever Traditional keyword search engines match exact text terms but often fail to capture semantic meaning. For example, searching for “legal agreement termination” should also surface results mentioning “contract cancellation”, even if the exact words differ. This is where Vector Search shines. By…

  • Banned Pandas: Building Fast, Scalable Data Pipelines with DuckDB + SQL on Azure

    Banned Pandas: Building Fast, Scalable Data Pipelines with DuckDB + SQL on Azure

    ✍️ By Abhishek Kumar | #FirstCrazyDeveloper 🧠 Why This Change Matters Our data pipelines were fast — until they weren’t.Large joins started crashing memory, inconsistent datetime types caused nightly job failures, and debugging hidden Python logic in Jupyter notebooks became a nightmare. So, we did something radical. We banned pandas.Every transformation now runs in DuckDB,…

  • Event-Driven Agentic Architecture: From Events to Intelligence

    Event-Driven Agentic Architecture: From Events to Intelligence

    ✍️ By Abhishek Kumar | #FirstCrazyDeveloper In today’s world of intelligent automation and AI-driven operations, event-driven agentic systems are becoming the architectural backbone for enterprises integrating AI, microservices, and human workflows. These systems are not just reactive—they are autonomous, adaptive, and context-aware, capable of executing tasks intelligently across diverse environments. This blog explores the transformative…