Project Impact

Developed and showcased a proof-of-concept of an innovative touchless kiosk system that reimagined how commuters interact with public transit information. The project demonstrated the potential of gaze detection AI to create more intuitive and accessible public interfaces, garnering significant attention at Cloud Expo Asia 2018.

The Challenge

Traditional digital public transit kiosks face several limitations:

• Touch interfaces raise hygiene concerns

• Multiple screens create visual clutter

• Generic content fails to engage users

• Information overload reduces the effectiveness

Innovation Solution

As the sole designer and developer, I created a smart kiosk that used AI-powered gaze detection to:

• Display personalised content based on user attention

• Enable touchless interaction for improved hygiene

• Seamlessly blend practical information with engaging advertising

• Adapt to user behaviour in real-time

Technical Implementation

Core Features

• Precision Gaze Mapping: Engineered calibrated gaze zones for both vertical and horizontal orientations

• Multi-User Intelligence: Developed an algorithm to handle simultaneous users through concentrated gaze prioritization

• Dynamic Content Switching: Created a responsive system that smoothly transitioned between:

  • Real-time bus arrival updates

  • Location-based advertising

  • Interactive promotional content

  • Emergency announcements

Technical Architecture

• Front-End Development: Built using modern web technologies for optimal performance on large HD displays

• Gaze Detection Integration: Collaborated with the AI researcher to implement precise eye-tracking capabilities

• Real-Time Processing: Engineered system to handle multiple data streams with minimal latency

AI-Powered Interactive Kiosk: Revolutionising Public Transit Information

Key Learnings

1. Technical Innovation: Demonstrated how AI can transform everyday public interfaces

2. User-Centered Technology: Proved that complex technology can create simpler user experiences

3. Public Communication: Developed ability to explain technical concepts to diverse audiences from various industries

4. Integration Expertise: Gained valuable experience combining AI, UX, and public infrastructure

The prototype continued to influence discussions about the future of smart city infrastructure and touchless solution during COVID-19 pandemic.

Challenges & Solutions

1. Technical Precision

• Challenge: Needed extremely accurate gaze detection for reliable interaction

• Solution: Developed a calibration system with the AI researcher that mapped precise quadrants for different kiosk orientations

• Outcome: Improved accuracy in gaze detection across various lighting conditions

2. Multi-User Complexity

• Challenge: Multiple users created conflicting interaction signals

• Solution & Outcome: Implemented a smart queue system that:

  • Tracked gaze concentration over time

  • Prioritised sustained attention

  • Managed smooth content transitions

3. User Engagement Balance

• Challenge: Needed to balance practical information with advertising content

• Solution & Outcome: Designed an intelligent content scheduling system that:

  • Prioritised essential transit information

  • Integrated advertisements during natural viewing gaps

Disclaimer: To comply with my non-disclosure agreement, confidential details have been excluded, and the screenshots have been altered accordingly.

Designer & Developer | Cloud Expo Asia 2018 Showcase