subhadip mitra

hi@subhadipmitra.com

Singapore

Welcome to my binary odysseys! I’m Subhadip, a seasoned technologist with 15+ years of experience wrangling data, crafting AI magic, and navigating the cloud. Currently, I lead Google’s Data & Analytics practice in Southeast Asia, where we build cutting-edge solutions for the region’s biggest players.

what I do

Software & Data Engineering: I engineer internet-scale applications, data pipelines, and platforms that handle petabytes of data and millions of events per second. My toolkit includes Java, Python, Spark, Kafka, and more.
Machine Learning & AI: I bring ML models to life, from fraud detection systems to generative AI applications. I’m passionate about Large Language Models, RAG, RLHF, and Multi-Agent Systems.
Cloud Architecture: I design and implement multi-cloud solutions that are optimized for performance and cost.
Technology Consulting: I provide C-level advisory services, helping organizations leverage technology to drive innovation, manage risk, and achieve strategic goals.
Research Interests: I’m perpetually curious, exploring - Algorithms, Distributed Systems, and Parallel Computing. My fascination extends to Machine Intelligence, the enigmatic realms of Large Language Models, and the pioneering frontiers of Quantum Computing.

beyond the code

When I’m not immersed in the digital world, you’ll find me stargazing, drifting or conjuring up the next startup idea. You might find me laughing uproariously at Family Guy, lost in the endless scroll of 9gag, or meandering through the midnight cityscape with my furry friend, Astro

join the adventure

Let’s explore the intersection of technology and creativity. Expect a blend of insights, ideas, and a sprinkle of fun – right here, where the bits meet the imagination.

latest posts

Aug 02, 2024	Data Pipelines Gone Wild - 10 WTF Moments That'll Make You Rethink Your Architecture
May 04, 2024	Introducing ETL-C (Extract, Transform, Load, Contextualize) - a new data processing paradigm
Apr 20, 2024	(Part 2/3) Rethinking ETLs - How Large Language Models (LLM) can enhance Data Transformation and Integration

selected publications

Data Monetization Strategy for Enterprises

Subhadip Mitra

2023

Abs Bib

This paper presents an in-depth exploration of Data Monetization for Enterprises that would enable them to effectively transform their data assets into significant economic value. The paper introduces: (a) Data Monetization Framework - that encompasses key strategic technical capabilities, collaborative Data Product development, agile experimentation, product incubation, delivery model, pricing model and privacy/security by design; and (b) Activation of the Data Monetization Strategy - a 12-month long structured approach is discussed to implement, operationalize, scale, and sustain the strategy-through a Data COE. Data Product Development, Pricing Strategy, Delivery Mode and prioritization is also discussed through a Value-effort study. Technology strategy is discussed in detail with MoSCoW scoring. The paper delves into the role of emerging technologies such as generative AI (large language models), big data analytics, artificial intelligence, and machine learning in enhancing data monetization efforts. It also addresses the challenges and opportunities presented by these technologies, including issues related to data privacy, security, and ethical considerations.
@article{mitra2023datamonetization, title = {Data Monetization Strategy for Enterprises}, author = {Mitra, Subhadip}, year = {2023}, publisher = {Birla Institute of Technology And Science, Pilani}, doi = {10.13140/RG.2.2.33756.36481}, url = {https://www.researchgate.net/publication/376557741_Data_Monetization_Strategy_for_Enterprises}, }
Open Location Proof (OLP)

Subhadip Mitra

More Information can be found here , 2021

Abs Bib

A privacy aware open protocol to prove without repudiation an entity’s point-in-time presence, participation and location in physical or virtual space. GoLocate.Me is a planned implementation node demonstrating the protocol.
@article{mitra2022olp, title = {Open Location Proof (OLP)}, author = {Mitra, Subhadip}, year = {2021}, }
OConsent: Open Consent Protocol for Privacy and Consent Management with Blockchain

Subhadip Mitra

More Information can be found here , 2021

Abs Bib

In the current connected world - Websites, Mobile Apps, IoT Devices collect a large volume of users’ personally identifiable activity data. These collected data is used for varied purposes of analytics, marketing, personalization of services, etc. Data is assimilated through site cookies, tracking device IDs, embedded JavaScript, Pixels, etc. to name a few. Many of these tracking and usage of collected data happens behind the scenes and is not apparent to an average user. Consequently, many Countries and Regions have formulated legislations (e.g., GDPR, EU) - that allow users to be able to control their personal data, be informed and consent to its processing in a comprehensible and user-friendly manner.This paper proposes a protocol and a platform based on Blockchain Technology that enables the transparent processing of personal data throughout its lifecycle from capture, lineage to redaction. The solution intends to help service multiple stakeholders from individual end-users to Data Controllers and Privacy Officers. It intends to offer a holistic and unambiguous view of how and when the data points are captured, accessed, and processed. The framework also envisages how different access control policies might be created and enforced through a public blockchain including real time alerts for privacy data breach.
@article{mitra2021oconsent, title = {OConsent: Open Consent Protocol for Privacy and Consent Management with Blockchain}, author = {Mitra, Subhadip}, year = {2021}, publisher = {Birla Institute of Technology And Science, Pilani}, doi = {10.48550/arXiv.2201.01326}, url = {https://arxiv.org/abs/2201.01326}, }