I'm Building a 100% Private AI-Powered Voice Assistant - Say Hello, HomeX!

Introduction

Hello everyone! After much anticipation, I'm excited to finally share my project with you all: a prototype I've been diligently working on called HomeX. While many creators on YouTube have dabbled in AI-powered devices, I aim to carve out a unique niche—one that emphasizes privacy and local operation.

HomeX Satellite and Server Overview

The HomeX system consists of two powerful components—the HomeX Satellite and the HomeX Server. Together, they form a fully local, AI-powered voice assistant designed to seamlessly control your smart home.

HomeX Satellite

The HomeX Satellite is built on a Raspberry Pi and features a Matrix Voice, which is equipped with seven microphones capable of beamforming and audio echo cancellation. Additionally, it includes an ESP32 chip with Bluetooth capabilities that allows for presence detection of devices, such as watches and smartphones. I'm also working on integrating a millimeter wave sensor for accurate human presence detection, making this satellite an all-in-one voice assistant with multiple sensor capabilities.

HomeX Server

On the server side, we have the Jetson Orin Nano, which I've upgraded with a 512 GB NVMe SSD. This hardware is like a Raspberry Pi on steroids, with GPU capabilities. It operates on a specialized version of Ubuntu, known as Jetson OS. A single Docker container runs LLama CPP and functions as a function calling API to communicate with Home Assistant, enabling users to easily turn their smart devices on and off.

Development Updates

Before we dive deeper into the functionality, I have a couple of requests. If you know anyone experienced in rapid hardware prototyping, Python or C programming, or any aspects of LLM fine-tuning, please connect them with me. I'm eager to collaborate. Secondly, I'm trying to gauge interest—if you are interested in purchasing something like HomeX, how much would you be willing to pay? Please let me know through the link below!

As we move forward with the demo, I have to mention the documentation is still in the works. We're ironing out some bugs, and once everything is running smoothly, I'll provide a detailed step-by-step guide to help you build your own setup.

User Interaction & Functionality

In my home setup, I manage my devices through Home Assistant and the Jetson Orin Nano seamlessly. The voice assistant can process various commands like “turn on the lights” while accurately identifying the specific room. The prompt used for function calls contains device information and context.

You’ll be glad to know that I have achieved significant performance improvements through batching and optimizing GPU usage. The responses from the voice assistant are both quick and accurate—whether querying the time or controlling smart devices.

I also conducted a friendly test for real-world functionality. The system responded accurately even from the opposite end of the room. With the aim of making the experience as intuitive as possible, the assistant demonstrated good awareness of room context.

Hardware Specifications

For those interested in the hardware specifics: the Jetson Orin Nano retails around $ 499. While it’s possible to install an operating system via SD card, my recommendation is to use an SSD for optimal performance.

I opted for LLama CPP after experimenting with several language models. It's designed to function similarly to OpenAI's models, providing a reliable local option for AI functionalities.

Matrix Voice

As for the Matrix Voice, securing one and ensuring it's operational can be tricky. The original company is no longer in business, so I advise caution. However, a project called ESP Home Matrix IO provides a solution to reprogram the Matrix Voice and make it usable within your HomeX system.

Looking Ahead

In conclusion, building HomeX has been a rewarding journey. My vision is to create a product that's easy to use—just plug it in and have an AI assistant ready to serve your needs with robust privacy features. Please provide any feedback or express interest in a product like this!

If you're seeking smart home consulting, feel free to visit futureproofhomes.net to schedule a meeting.

Thank you for your time, and I'll keep you updated on future progress. Have a fantastic day!

Keywords

HomeX, AI-powered voice assistant, local operation, HomeX Satellite, HomeX Server, Raspberry Pi, Jetson Orin Nano, presence detection, LLama CPP, Home Assistant.

FAQ

Q: What is HomeX?
A: HomeX is a local, AI-powered voice assistant designed to manage smart home devices while prioritizing privacy.

Q: What hardware do I need to build HomeX?
A: You'll need a Raspberry Pi for the HomeX Satellite and a Jetson Orin Nano with an NVMe SSD for the HomeX Server.

Q: Can HomeX run without internet access?
A: Yes, HomeX operates entirely locally, meaning it can function without any internet connection.

Q: How can I assist in the development of HomeX?
A: If you or someone you know has expertise in rapid hardware prototyping or programming, please connect with me!

Q: Will there be documentation available?
A: Yes, detailed documentation will be provided once the system is stable and functional.