PILOT
control android apps by voice: agents navigate the UI for you
- year
- 2026
- status
- complete
- outcome
- 1st prize, IEEE EDT
- built with
- Kotlin, FastAPI, Groq
what it does
A multi-agent voice assistant that uses Android Accessibility Services to navigate and control mobile apps from natural-language commands. Won 1st prize at IEEE EDT (March 2026).
how it works
An Android client in Kotlin talks to a FastAPI backend that runs Groq-hosted LLMs.