Projects

ModulaRL: Reinforcement Learning Library

An open-source, modular reinforcement learning library designed for rapid prototyping and reproducible experimentation. Built with PyTorch and designed for extensibility.

PythonPyTorchReinforcement LearningOpen Source

Diet Recommendation System

A personalized diet recommendation web application orchestrating front- and back-end services. Reached over 20,000 unique users and earned 250+ GitHub stars.

Scikit-LearnFastAPIStreamlitDocker ComposeMachine Learning

Photo Enhancer App

A web application featuring manual and RL-based editing with color histograms for photographers. Achieved state-of-the-art RL methods in tonal adjustment on the MIT-Adobe FiveK dataset.

Computer VisionReinforcement LearningDockerPython

Beam Pattern Reinforcement Learning

Reinforcement learning algorithms to optimize adaptive beamforming in mmWave and THz MIMO systems. Published in IEEE Transactions on Communications.

PythonPyTorchReinforcement Learning6G/THz

Emergent Flocking with Reinforcement Learning

Trains a Deep Double DQN agent to exhibit emergent flocking behavior (cohesion, separation and alignment).

PythonPyTorchReinforcement LearningMulti-Agent

pyBanania

A faithful Pygame recreation of the classic 1992 Windows 3.x game "Banania". Includes full game logic, sprite handling, and PyInstaller executable generation.

PythonPygameGame Development

AI Portfolio Chatbot

An interactive RAG chatbot that answers questions about my professional background. Built with a FAISS vector index, SentenceTransformers embeddings, and a Groq/Gemini LLM with streaming responses.

Next.jsFastAPIRAGFAISSDocker