NightSight Tourism Translator
(2026)Android app for real-time translation with sensor-based accessibility features.
KotlinJetpack ComposeCameraXML KitAndroid SDK
More Details
Developed for the Mobile and Multisensorial Computing course, this app helps tourists translate real-world text (menus, signs) with a focus on accessibility for users with hand tremors or in low-light environments.
Key Features
- Sensor-Driven Automation: Uses the Accelerometer to prevent blurry captures by locking the shutter during movement and the Light Sensor to auto-activate the flash in dark settings (< 15 Lux).
- Smart Processing: Integrates Google ML Kit for Optical Character Recognition (OCR) and dynamic translation.
- Modern UI: Built entirely with Jetpack Compose, featuring real-time visual feedback based on device stability.
Technical Implementation
- CameraX: Managed Preview and ImageCapture use cases.
- Asynchronous Pipeline: Decoupled image processing from the UI thread using ImageProxy and Bitmaps to prevent frame drops.
- Offline Capability: Manages on-device language model downloads for translation.