subhadip mitra

Welcome to my binary odysseys! I’m Subhadip Mitra, your guide through the exhilarating world of Data, AI, and Cloud technologies. For the past 15+ years, I’ve been coding, architecting, and leading transformative projects for industry titans and innovative startups alike.

Currently, I’m leading the Data & Analytics practice for Southeast Asia at Google. My work spans from designing advanced Data & AI platforms to spearheading multimillion-dollar project portfolios across Southeast Asia, while also crafting and executing go-to-market strategies for our Data Practice. This dynamic role combines technical innovation, strategic leadership, and delivery excellence to drive transformative outcomes for major enterprises in the region.

Off the clock, I’m a constellation chaser, asphalt surfer, startup dreamweaver, and meme connoisseur. You might find me laughing uproariously at Family Guy, lost in the endless scroll of 9gag, or meandering through the midnight cityscape with my trusty canine companion, Astro. My entrepreneurial tech tale began with a humble website, truckaurbus.com, and evolved into a passion for open-source projects.

what I do

Software / Data Engineering: I design and build internet-scale, service-oriented, distributed applications, specializing in low-latency real-time data processing and ML engineering. My toolkit includes Java, Python, and Node.js, with proficiency in technologies like Apache Spark, Kafka, Hadoop, Hive, and BigQuery. I architect robust data pipelines and platforms, handling petabytes of data, building global Data Lakes, and engineering real-time in-memory platforms processing millions of events per second.

Machine Learning & AI: From developing fraud detection systems to creating self-service ML workbenches, I bring ML models from concept to production. I’m deeply involved in Generative AI, fine-tuning Large Language Models, and implementing advanced techniques like Retrieval Augmented Generation (RAG) and Reinforcement Learning from Human Feedback (RLHF). My expertise extends to Multi-Agent Systems and ML Infrastructure, enabling scalable and efficient AI solutions.

Cloud Architecture: As a Google Cloud Certified Professional in multiple domains, I design and implement multi-cloud solutions, lead cloud migrations, and optimize cloud-native architectures for performance and cost-efficiency.

Technology Consulting: Leveraging my hands-on experience and strategic insight, I assist organizations in innovating, managing risks, reducing costs, and securing competitive strategic differentiation. I provide C-level advisory services grounded in practical, implementable solutions.

Research Interests:
I’m perpetually curious, exploring - Algorithms, Distributed Systems, and Parallel Computing. My fascination extends to Machine Intelligence, the enigmatic realms of Large Language Models, and the pioneering frontiers of Quantum Computing.

Embark on this adventure with me as I unveil the arcane, explore the unknown, and share tales from the tech frontier. Expect a blend of insight, imagination, and a dash of whimsy—right here, where technology meets creativity.

latest posts

May 04, 2024	Introducing ETL-C (Extract, Transform, Load, Contextualize) - a new data processing paradigm
Apr 20, 2024	(Part 2/3) Rethinking ETLs - How Large Language Models (LLM) can enhance Data Transformation and Integration
Apr 15, 2024	(Part 1/3) Rethinking ETLs - How Large Language Models (LLM) can enhance Data Transformation and Integration

selected publications

Data Monetization Strategy for Enterprises

Subhadip Mitra

2023

Abs Bib

This paper presents an in-depth exploration of Data Monetization for Enterprises that would enable them to effectively transform their data assets into significant economic value. The paper introduces: (a) Data Monetization Framework - that encompasses key strategic technical capabilities, collaborative Data Product development, agile experimentation, product incubation, delivery model, pricing model and privacy/security by design; and (b) Activation of the Data Monetization Strategy - a 12-month long structured approach is discussed to implement, operationalize, scale, and sustain the strategy-through a Data COE. Data Product Development, Pricing Strategy, Delivery Mode and prioritization is also discussed through a Value-effort study. Technology strategy is discussed in detail with MoSCoW scoring. The paper delves into the role of emerging technologies such as generative AI (large language models), big data analytics, artificial intelligence, and machine learning in enhancing data monetization efforts. It also addresses the challenges and opportunities presented by these technologies, including issues related to data privacy, security, and ethical considerations.
@article{mitra2023datamonetization, title = {Data Monetization Strategy for Enterprises}, author = {Mitra, Subhadip}, year = {2023}, publisher = {Birla Institute of Technology And Science, Pilani}, doi = {10.13140/RG.2.2.33756.36481}, url = {https://www.researchgate.net/publication/376557741_Data_Monetization_Strategy_for_Enterprises}, }
Open Location Proof (OLP)

Subhadip Mitra

More Information can be found here , 2021

Abs Bib

A privacy aware open protocol to prove without repudiation an entity’s point-in-time presence, participation and location in physical or virtual space. GoLocate.Me is a planned implementation node demonstrating the protocol.
@article{mitra2022olp, title = {Open Location Proof (OLP)}, author = {Mitra, Subhadip}, year = {2021}, }
OConsent: Open Consent Protocol for Privacy and Consent Management with Blockchain

Subhadip Mitra

More Information can be found here , 2021

Abs Bib

In the current connected world - Websites, Mobile Apps, IoT Devices collect a large volume of users’ personally identifiable activity data. These collected data is used for varied purposes of analytics, marketing, personalization of services, etc. Data is assimilated through site cookies, tracking device IDs, embedded JavaScript, Pixels, etc. to name a few. Many of these tracking and usage of collected data happens behind the scenes and is not apparent to an average user. Consequently, many Countries and Regions have formulated legislations (e.g., GDPR, EU) - that allow users to be able to control their personal data, be informed and consent to its processing in a comprehensible and user-friendly manner.This paper proposes a protocol and a platform based on Blockchain Technology that enables the transparent processing of personal data throughout its lifecycle from capture, lineage to redaction. The solution intends to help service multiple stakeholders from individual end-users to Data Controllers and Privacy Officers. It intends to offer a holistic and unambiguous view of how and when the data points are captured, accessed, and processed. The framework also envisages how different access control policies might be created and enforced through a public blockchain including real time alerts for privacy data breach.
@article{mitra2021oconsent, title = {OConsent: Open Consent Protocol for Privacy and Consent Management with Blockchain}, author = {Mitra, Subhadip}, year = {2021}, publisher = {Birla Institute of Technology And Science, Pilani}, doi = {10.48550/arXiv.2201.01326}, url = {https://arxiv.org/abs/2201.01326}, }