Running Guide Agent

Running is a fundamental form of exercise and freedom, yet for people with vision impairment, it often requires dependency on a sighted guide or a guide dog. Developed in collaboration between Google DeepMind and bit.studio, the Running Guide Agent is a groundbreaking technology that marks a massive leap from simple path-following to real-time environmental understanding, empowering blind and low-vision (BLV) runners to run independently and unassisted.

Because running is a high-speed activity that requires real-time computation, the system relies on a chest-mounted Pixel 10 Pro and a hybrid, dual-path architecture. The first path features a low-latency, on-device segmentation model that runs entirely offline to guarantee immediate safety. It delivers instant "STOP" alerts and directional ticking sounds for steering, ensuring runners stay on track even without cellular service. The second path utilizes Gemma 4 E4B for advanced reasoning, processing complex multimodal inputs directly on the device to deliver rapid, high-level scene understanding and guidance.

Official blog post : https://blog.google/innovation-and-ai/models-and-research/google-deepmind/running-guide-agent