Envision Glasses: The future of personalized AI and GPT integration

Inclusive Innovations, hosted by Envision and Lighthouse for the Blind and Visually Impaired, brings together some of the most talented and creative minds from around the world to share their ideas and innovations for improving the lives of people with visual impairments. 

In 2023, the theme centered around "The Future of Accessible Work". As part of the event, Karthik Kannan, Envision's CTO, delivered a presentation on what lies ahead for Envision glasses. He discussed two main topics: personalizing AI and integrating GPT (Generative Pre-trained Transformer) into the Envision glasses.

Personalizing AI

Currently, AI apps can help users detect different, pre-programmed objects around them. However, Envision is working on personalizing AI in a way that allows users to teach the AI to recognize specific objects from their surroundings. For example, users can teach the AI to recognize their coffee cup versus their partner's. Users can also teach the AI to recognize their phone case in a sea of other objects.

According to Karthik, object recognition is more challenging than face recognition because objects are not as similar to each other as human faces and can look different under different lighting conditions. However, Envision is working on this technology, and users can expect it to be available on the glasses and the app in the coming months.

Integrating GPT

Envision is also working on integrating GPT into the glasses. GPT is a language model that uses machine learning to generate human-like responses to text prompts. With GPT integration, users can scan a document and ask the glasses questions about the content. For example, they can ask for a summary of the text or ask specific questions about the information in the document.

During the presentation, Karthik demonstrated the GPT integration. He scanned a document about the floor plan of a building, and the glasses read the text aloud. He then asked the glasses specific questions about the information in the document, such as the total occupancy of the mingling area. The glasses were able to provide an accurate response.

Karthik also demonstrated a fun feature of the GPT integration. He asked the glasses to create a rap song out of the text on the page in the style of Dr. Dre. 

This exciting feature will soon be available to all Envision Glasses users, and we can't wait to hear all the interesting use cases you come up with.

Don’t have Envision glasses yet? You can schedule a free demo call and discover the full range of features, including the new 'Ask Envision' functionality.

Conclusion

Envision is dedicated to continuously enhancing our glasses to provide our users with greater independence and functionality. Personalizing AI and integrating GPT are just two examples of the exciting new features that users can expect in the near future. We have many other exciting features in the pipeline, so we encourage everyone to stay tuned for further updates.

Watch Karthik’s entire presentation at Inclusive Innovation in the video below.