Go to file
Bently 24505a17c9
Merge pull request #34 from francip/francip-misc
Small fixes
2024-06-19 23:12:38 +01:00
assets feat: commit without keys 2024-05-12 11:51:27 -07:00
firmware Update readme with specific esp32 version 2024-05-30 13:29:20 -07:00
prompts feat: commit without keys 2024-05-12 11:51:27 -07:00
public feat: commit without keys 2024-05-12 11:51:27 -07:00
sources fixing everything 2024-06-13 19:36:18 -07:00
.gitignore Updating Expo SDK to v51 2024-05-25 12:16:20 -07:00
App.tsx feat: commit without keys 2024-05-12 11:51:27 -07:00
LICENSE feat: commit without keys 2024-05-12 11:51:27 -07:00
README.md Update README.md 2024-06-13 19:38:40 -07:00
app.json feat: commit without keys 2024-05-12 11:51:27 -07:00
babel.config.js feat: commit without keys 2024-05-12 11:51:27 -07:00
image.png Updated Readme 2024-05-13 01:17:19 +01:00
package.json Updating Expo SDK to v51 2024-05-25 12:16:20 -07:00
tsconfig.json feat: commit without keys 2024-05-12 11:51:27 -07:00
yarn.lock feat: commit without keys 2024-05-12 11:51:27 -07:00

README.md

OpenGlass - Open Source Smart Glasses

Turn any glasses into hackable smart glasses with less than $25 of off-the-shelf components. Record your life, remember people you meet, identify objects, translate text, and more.

OpenGlass

Video Demo

OpenGlass Demo

Want a Pre-built Version?

We will ship a limited number of pre-built kits. Fill out the interest form to get notified.

Community

Join the Based Hardware Discord for setup questions, contribution guide, and more.

Getting Started

Follow these steps to set up OpenGlass:

Hardware

  1. Gather the required components:

  2. 3D print the glasses mount case using the provided STL file.

  3. Open the firmware folder and open the .ino file in the Arduino IDE.

    • If you don't have the Arduino IDE installed, download and install it from the official website.
    • Alternatively, follow the steps in the firmware readme to build using arduino-cli
  4. Follow the software preparation steps to set up the Arduino IDE for the XIAO ESP32S3 board:

    • Add ESP32 board package to your Arduino IDE:
      • Navigate to File > Preferences, and fill "Additional Boards Manager URLs" with the URL: https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json
      • Navigate to Tools > Board > Boards Manager..., type the keyword esp32 in the search box, select the latest version of esp32, and install it.
    • Select your board and port:
      • On top of the Arduino IDE, select the port (likely to be COM3 or higher).
      • Search for xiao in the development board on the left and select XIAO_ESP32S3.
  5. Before you flash go to the "Tools" drop down in the Arduino IDE and make sure you set "PSRAM:" to be "PSRAM: "OPI PSRAM"

Like this

  1. Upload the firmware to the XIAO ESP32S3 board.

Software

  1. Clone the OpenGlass repository and install the dependencies:

    git clone https://github.com/BasedHardware/openglass.git
    cd openglass
    npm install
    

    You can also use yarn to install, by doing

    yarn install
    
  2. Add API keys for Groq and OpenAI in the keys.ts file located at https://github.com/BasedHardware/OpenGlass/blob/main/sources/keys.ts.

  3. For Ollama, self-host the REST API from the repository at https://github.com/ollama/ollama and add the URL to the keys.ts file. The URL should be http://localhost:11434/api/chat

  4. go to terminal and type "ollama pull moondream:1.8b-v2-fp16"

  5. Start the application:

    npm start
    

    If using yarn start the application with

    yarn start
    

    Note: This is an Expo project. For now, open the localhost link (this will appear after completing step 5) to access the web version.

License

This project is licensed under the MIT License.