making my own ai waifu app that can teach me any language.
A developer named aziib built a custom AI waifu app from scratch that can hold voice and video conversations in any language, using Google's open-source Gemma model, a self-made 3D avatar, and a homemade text-to-speech API. This matters because a single developer just assembled c...
Reddit user aziib, posting in the LocalLLaMA subreddit, shared details of a fully functional AI waifu application built entirely from open-source and self-made components. The project combines Google's Gemma-4-E4B-it language model, a custom text-to-speech system called OmniVoice, a hand-built FastAPI wrapper, and a 3D avatar created in Vroid Studio. The app supports image uploads, live web search, voice calls, and video calls, making it arguably the most feature-complete solo-built AI language tutor to surface from the LocalLLaMA community in recent memory.
Why This Matters
The fact that one developer assembled a multimodal, animated, voice-enabled AI language tutor without a team, a startup budget, or proprietary APIs is the clearest signal yet that the barrier to building serious AI applications has collapsed. Duolingo hit 500 million users in 2024 and still cannot hold a genuine open-ended conversation with a learner. This project, built by a single person on Reddit, can. The open-source AI tooling stack has matured fast enough that personal projects are now competing on features with venture-backed edtech products.
Daily briefing from 50+ sources. Free, 5-minute read.
The Full Story
Aziib's project is not a simple chatbot wrapped in an anime skin. The architecture is layered and intentional. At the core sits Gemma-4-E4B-it, the instruction-tuned variant of Google's Gemma model series, which Google released in early 2024 targeting developers who want capable models that can run on consumer hardware without cloud API costs. Aziib noted something significant: the model follows custom prompts reliably without needing any jailbreaking or uncensoring. That is a real practical win, because many developers working with local models spend hours wrestling with content filters that either block legitimate use cases or require modifications that introduce instability.
For voice, aziib built a text-to-speech layer using OmniVoice TTS and wrapped it in a FastAPI server, creating a standalone audio service the application can call over HTTP. This separation of concerns is solid engineering. By treating the voice component as an independent API rather than a baked-in module, the developer can swap, upgrade, or extend the TTS system without rebuilding the whole app. FastAPI's automatic documentation and validation features mean that service is also testable and potentially shareable with other developers.
The visual layer runs through a 3D avatar built in Vroid Studio, a free character creation tool popular in the VTuber community. The result is an animated face the user interacts with during video calls, not a static image or a plain text chat window. Combined with the voice calling feature, the experience mimics something closer to a video tutoring session than a traditional chatbot, which matters a great deal for language learners who need to practice speaking and listening in realistic conversational contexts.
The language learning application angle is where this gets genuinely interesting for educators and edtech watchers. The app supports image uploading, so a learner could photograph a menu, a street sign, or a product label and ask the AI to explain it in the target language. Web search integration means the assistant can reference current events, real vocabulary in context, and up-to-date cultural information rather than being limited to training data. These are not gimmick features. They address real gaps that rigid language learning apps have never solved.
Aziib's choice to build on the LocalLLaMA stack also means the entire application can run locally, which has privacy implications that matter to some users and cost implications that matter to everyone. No per-query API fees, no data leaving the device, no subscription required. That is a meaningful differentiator compared to AI tutoring tools built on top of OpenAI or Anthropic's paid APIs.
Key Details
- Developer: Reddit user aziib, posting in r/LocalLLaMA
- Core language model: Gemma-4-E4B-it by Google, released in early 2024
- Text-to-speech: OmniVoice TTS, served via a custom FastAPI wrapper
- 3D avatar tool: Vroid Studio, a free character creation application
- Supported features: image uploads, web search, voice calls, video calls
- Comparable reference app cited by developer: Grok Ani, an anime-style AI assistant
What's Next
The logical next step for this project is structured language lesson content, where the AI follows a curriculum rather than purely free conversation, which would make it competitive with formal learning tools. Aziib has already demonstrated that the architecture handles multiple I/O modes cleanly, so adding lesson plans, vocabulary tracking, or spaced repetition logic would not require rebuilding from scratch. Watch the LocalLLaMA subreddit for follow-up posts, as aziib's update cadence and community response suggest this project is actively developing.
How This Compares
This project sits in a growing lineage of solo and small-team AI waifu builders, but it stands out technically. Back in August 2023, a YouTube channel called OneReality published an installation guide for an open-source AI waifu project hosted at the GitHub repository DogeLord081/OneReality. That project required Ubuntu Linux WSL on Windows and depended on OpenAI API keys, meaning recurring costs and external data dependency. Aziib's 2025 build is fully local and self-contained, which represents a real maturation of what one person can assemble from open-source components in under two years.
In September 2024, a YouTube tutorial titled "Building Your Own ChatGPT Anime Waifu is Easy Actually" from Just Rayen pulled in roughly 19,240 views and 934 likes across a 52-minute walkthrough. That level of interest confirms public demand for this category of AI tools, but most tutorials at that time still relied on ChatGPT as the backend brain. Aziib's project removes that dependency entirely by running Gemma locally, which is a meaningful technical step forward that the earlier tutorials could not demonstrate because the open-source models were not capable enough yet.
NotJust.dev published a nearly four-hour tutorial in December 2024 covering AI language learning apps built with ChatGPT integration. That video reached 7,154 views and focused on peer-to-peer language practice augmented by OpenAI's API. Compared to that approach, aziib's project is more ambitious on the interface side, adding 3D avatars and video calling, while also being more independent on the infrastructure side by avoiding commercial API reliance. The direction these projects are heading is clear: more immersive interfaces, more capable open-source models, and full local deployment. Aziib's build is simply ahead of where most tutorials are pointing right now.
FAQ
Q: What is Gemma-4-E4B-it and why use it? A: Gemma-4-E4B-it is an instruction-tuned language model from Google, part of the Gemma series released in early 2024. It is designed to run efficiently on consumer hardware without requiring expensive cloud subscriptions. Developers in the LocalLLaMA community choose it because it follows custom prompts reliably and can operate entirely offline, which cuts costs and keeps user data private.
Q: Can this app actually teach a language or is it just for fun? A: It has genuine teaching potential. The app supports image uploads for real-world vocabulary practice, web search for current and contextual information, and both voice and video calling for conversational practice. Those features directly address the biggest weakness of traditional language apps, which is the inability to hold an open-ended, adaptive spoken conversation with a learner.
Q: Do you need expensive hardware to run something like this? A: Not necessarily. The Gemma model series was designed with consumer hardware in mind, and the broader LocalLLaMA community regularly shares guides for running quantized models on mid-range GPUs. The total hardware requirement depends on the specific model size and quantization settings, but a modern gaming PC with 8 to 16 gigabytes of VRAM is a reasonable starting point for a project like this.
Aziib's build is a useful reminder that the most interesting AI development right now is not always happening in a corporate lab. Individual developers combining open-source models, free creative tools, and solid API design are assembling genuinely capable applications on their own timelines. Subscribe to the AI Agents Daily weekly newsletter for daily updates on AI agents, tools, and automation.
Get stories like this daily
Free briefing. Curated from 50+ sources. 5-minute read every morning.
