# OpenGlass: Turn any glasses into AI-powered smart glasses

Source: https://github.com/BasedHardware/OpenGlass
Kiwi News: https://news.kiwistand.com/stories/OpenGlass-Turn-any-glasses-into-AI-powered-smart-glasses?index=0x6641c753e0b5e49ff2eb5a5a0e40931bfc2ff8e58c3800cfb5f6da3b881637d7f36c2d5b
Submitted by dylsteck.eth on 2024-05-13 UTC, 8 upvotes, 1 comment

## Summary

OpenGlass is an open-source project for turning existing glasses into hackable smart glasses using less than $25 of off-the-shelf components. The build uses a Seeed Studio XIAO ESP32 S3 Sense board, a 3.7V 250mAH EEMB LP502030 battery, and a 3D-printed glasses mount. The software is an Expo project that uses API keys for Groq and OpenAI, or a self-hosted Ollama REST API running the moondream:1.8b-v2-fp16 model. The page notes that the project has moved to the Omi repository and that the current repo is no longer supported.

## Article

ℹ️ 🔴 We moved this project to Omi repository. Current repo isn't supported anymore =>

ℹ️ 🔴 We moved this project to Omi repository. Current repo isn't supported anymore =>

ℹ️ 🔴 We moved this project to Omi repository. Current repo isn't supported anymore =>

OpenGlass - Open Source Smart Glasses

Turn any glasses into hackable smart glasses with less than $25 of off-the-shelf components. Record your life, remember people you meet, identify objects, translate text, and more.

Video Demo

Want a Pre-built Version?

We will ship a limited number of pre-built kits. Fill out the interest form to get notified.

Community

Join the Based Hardware Discord for setup questions, contribution guide, and more.

Getting Started

Follow these steps to set up OpenGlass:

Hardware

Gather the required components:

Seeed Studio XIAO ESP32 S3 Sense

EEMB LP502030 3.7v 250mAH battery

3D printed glasses mount case

3D print the glasses mount case using the provided STL file.

Open the firmware folder and open the .ino file in the Arduino IDE.

If you don't have the Arduino IDE installed, download and install it from the official website.

Alternatively, follow the steps in the firmware readme to build using arduino-cli

Follow the software preparation steps to set up the Arduino IDE for the XIAO ESP32S3 board:

Add ESP32 board package to your Arduino IDE:

Navigate to File > Preferences, and fill "Additional Boards Manager URLs" with the URL: https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json

Navigate to Tools > Board > Boards Manager..., type the keyword esp32 in the search box, select the latest version of esp32, and install it.

Select your board and port:

On top of the Arduino IDE, select the port (likely to be COM3 or higher).

Search for xiao in the development board on the left and select XIAO_ESP32S3.

Before you flash go to the "Tools" drop down in the Arduino IDE and make sure you set "PSRAM:" to be "PSRAM: "OPI PSRAM"

Upload the firmware to the XIAO ESP32S3 board.

Software

Clone the OpenGlass repository and install the dependencies:

git clone https://github.com/BasedHardware/openglass.git cd openglass npm install

You can also use yarn to install, by doing

Add API keys for Groq and OpenAI in the keys.ts file located at https://github.com/BasedHardware/OpenGlass/blob/main/sources/keys.ts.

For Ollama, self-host the REST API from the repository at https://github.com/ollama/ollama and add the URL to the keys.ts file. The URL should be http://localhost:11434/api/chat

go to terminal and type "ollama pull moondream:1.8b-v2-fp16"

Start the application:

If using yarn start the application with

Note: This is an Expo project. For now, open the localhost link (this will appear after completing step 5) to access the web version.

License

This project is licensed under the MIT License.

ℹ️ 🔴 We moved this project to Omi repository. Current repo isn't supported anymore =>

## Comments

**0x3e6c...F760**: Although Meta x Ray Ban glasses seem cool, I'd not buy them because of the privacy risks. The v1 of these glasses looks clunky and I'd never wear them, but maybe that would put some extra pressure on Meta.