Chef Mate AI - Smart Culinary Copilot
An AI-powered kitchen assistant that transforms pantry photos into personalized recipes and manages culinary inventory.
Project Overview
A full-stack AI application built with FastAPI and the Gemini/Groq ecosystem. Chef Mate AI allows users to upload images of their fridge or pantry items, uses advanced vision models to detect ingredients, and generates detailed, step-by-step recipes. The platform features a real-time conversational UI with voice-to-text capabilities, persistent session tracking, and AI-driven recipe visualization.
Key Features
Image-to-Recipe detection using Gemini Vision models
Detailed implementation of this feature ensured optimal user experience and performance.
Real-time voice-to-text input for hands-free kitchen interaction
Detailed implementation of this feature ensured optimal user experience and performance.
Dynamic AI image generation for every generated recipe
Detailed implementation of this feature ensured optimal user experience and performance.
Personalized meal prep instructions based on available ingredients
Detailed implementation of this feature ensured optimal user experience and performance.
Persistent chat history storage with MySQL session tracking
Detailed implementation of this feature ensured optimal user experience and performance.
Responsive, premium dark-mode interface with micro-animations
Detailed implementation of this feature ensured optimal user experience and performance.
Project Gallery


Challenges & Solutions
Visual Ingredient Parsing
Accurately identifying multiple ingredients from low-light or cluttered pantry photos.
Leveraged Gemini 1.5 Flash's vision capabilities to perform zero-shot object detection, successfully extracting ingredient lists from complex images.
Hands-Free Interaction
Allowing users to interact while cooking without needing to touch their devices.
Integrated the Web Speech API for real-time voice-to-text, enabling a seamless 'Conversational Chef' experience.
Real-time Visualization
Providing a visual representation of AI-generated recipes to increase user engagement.
Connected the Pollinations.ai API to dynamically generate high-quality food photography matching the unique recipe titles in real-time.