Project Description
a ChatGPT-4 API-powered Chrome extension to enhance web browsing accessibility for the visually impaired and overcome shortcomings of screen readers. The tool intelligently interprets web content, providing contextualized audio-visual summaries and enabling interactive, conversational engagement for deeper content insights.
Feature 1
Contextual Summary of the entire web page to get started
Feature 2
Recommendations of follow up questions & conversational analysis
Feature 3
Accessible, Inclusive User Experience
for all. Design of contrasting colors to accommodate visually impaired and color blind users.
for all. Design of contrasting colors to accommodate visually impaired and color blind users.
How it Works
Feature Prototyping and Testing.
Demonstration of Implementing page scanning and image caching (for multimodal LLM processing). View automated full page scrolling, imaging and caching via web browser console.
Role
- AI/ML Engineer on MIT-Google Hackathon Team
Completed rapid prototype of web extension to demonstrate features of the solution. View code repository here (Look out for README.me on GitHub file for walkthrough code and demo.
Developed extension utilizing JavaScript and HTML for client-side serving application module.
Teammates
Prachi Mehta (Product Design), Sangyu Xi (Project Managment), Hesan Hedghat
