Witmo — AI-powered personal gaming coach

Witmo is your friendly AI-powered gaming coach: it captures gameplay images, analyzes your situation, and gives you specific, spoiler-aware advice — just like a pro gamer buddy.

✨ Key features

• 📸 Screen capture: Connects to your Android phone via USB to capture gameplay images
• ✂️ Auto-cropping: Crops captures to focus just on the game screen
• 🔍 Image analysis: Uses cloud-based LLMs to understand what's happening in your game
• 💬 Contextual advice: Provides tips and insights specific to your current situation and your request
• 🙈 Spoiler control: Customizable spoiler levels to avoid ruining your gaming experience
• 🎵 Audio feedback: Optional text-to-speech and sound notifications
• 📝 Conversation history: Maintains context of your previous questions
• 🎮 Game-specific prompts: Tailored prompts for supported games
• 🖥️ Terminal-based interface: No other UI (whether you call that a feature or not is up to you...)

🚀 How to use

Check out the Github repo for much more information including information on how to install and run. Witmo currently is a Python application you can run locally.

🌱 Genesis & contributing

I created Witmo after picking up Elden Ring and constantly running into questions mid-game. I wanted a tool that would let me quickly get advice based on a screenshot — without having to type long explanations for an LLM or repeatedly pull out my phone to retype the same prompt. So, instead of playing, I built Witmo.

Witmo is fully functional and I use it regularly, but there’s still room for improvement. Beyond being a useful app, it’s also a playground for experimenting with LLMs, image processing, and other technologies that might enhance gaming experiences.

Contributions, ideas, and feedback are welcome! If you have suggestions, bug fixes, or want to add features or additional prompt packs, please open an issue or pull request.