projects
Open-source frameworks and protocols advancing AI, privacy, and distributed systems
Open Source Projects
Building frameworks and protocols that advance AI safety, privacy engineering, and distributed systems
Production-Ready Frameworks
UPIR: Universal Plan Intermediate Representation
Framework for automated synthesis and verification of distributed systems - bridging the gap between high-level specifications and provably correct implementations.
- Compositional verification with proof caching (274x speedup)
- CEGIS-based synthesis for automated implementation generation
- Constrained RL with PPO for optimization under correctness guarantees
- First framework to unify synthesis, verification, and optimization
AI Metacognition Toolkit
Production-ready Python framework for detecting and analyzing metacognitive capabilities in AI systems - enabling transparent, systematic reasoning at scale.
- Bayesian situational awareness detection with KL divergence measures
- Counterfactual chain-of-thought analysis for causal attribution
- Real-time production monitoring with automated alerting
- 275 tests, 95% code coverage, production-hardened
Speculative Decoding
Reference implementation of LLM inference acceleration techniques - achieving faster generation through speculative decoding, tree speculation, EAGLE, Medusa, KV-cache compression, and diffusion efficiency optimizations.
- 1.10x speedup with exact target distribution guarantee
- Six major techniques: speculative decoding, tree speculation, EAGLE, Medusa
- KV-cache compression with H2O, sliding window, and INT8/INT4 quantization
- Production-quality code with comprehensive benchmarks and interactive demos
Triton Kernels for LLM Inference
High-performance GPU kernels for LLM inference operations using OpenAI Triton. Educational implementations demonstrating memory-bandwidth optimization techniques for transformer operations on A100 GPUs.
- RMSNorm kernel: 8.1x faster than PyTorch, achieving 88% of A100 peak bandwidth (1365 GB/s)
- Fused RMSNorm+Residual: 6.0x speedup through operation fusion
- SwiGLU activation: 1.6x improvement with custom kernel
- INT8 GEMM: 2x memory savings through weight quantization
LLMConsent
Privacy-preserving consent management protocol for LLM training data - enabling transparent opt-in/opt-out mechanisms with cryptographic verification.
- Decentralized consent registry on public blockchain
- Cryptographic proof of consent status
- Real-time opt-out enforcement for AI training
- GDPR-compliant privacy controls for GenAI era
OConsent Protocol
Open-source blockchain-based protocol for transparent personal data consent management - enabling granular control and tamper-proof audit trails.
- Published research paper (2021, BITS Pilani)
- Transparent consent lifecycle management
- GDPR-compliant with automated compliance reporting
- Real-time privacy breach alerts
Open Location Proof Protocol
Privacy-aware open protocol for non-repudiable location verification in physical or virtual spaces - with cryptographic proof and decentralized architecture.
- Cryptographically secure location attestation
- Privacy-preserving proof mechanisms
- Fully decentralized, tamper-resistant
- Complete technical specifications published
Want to Contribute?
These projects are open source and welcome contributions. Whether you want to report issues, suggest features, or submit pull requests - your input helps advance the field.