Local Voice Assistance with Wake Word in Home Assistant

Local Voice Assistance with Wake Word in Home Assistant - Bye bye Alexa and Google Home

Home Assistant has recently made a significant advancement by supporting local voice assistants with customizable wake words. This feature allows you to control your smart devices locally, offering more privacy and reducing reliance on cloud services like Google Home and Alexa. In this tutorial, we will explore how to set up a local voice assistant using the ESP32 S3 Box 3 in Home Assistant to control your devices through voice commands.

Requirements

To begin, ensure you have Home Assistant Cloud set up or a local assist pipeline ready. If you choose to use Nabu Casa, you can jump right into this tutorial. For a local assist pipeline, follow the prerequisite setup video I'll link below.

Compatible Devices

While I will use the ESP32 S3 Box 3 for this tutorial, the steps also apply to the ESP32 S3 Box and ESP32 S3 Box Light. Links to purchase the ESP32 S3 Box 3 can be found in the video description, but be aware that these devices may be in high demand.

Setting Up Wake Word in Home Assistant

Install ESPHome Add-on
Ensure you have the ESPHome add-on installed in Home Assistant. Navigate to Settings > Add-ons, search for ESPHome, and install it if necessary.
Enable Wake Word
Go to Settings > Add-ons > Add-on Store, search for "Open Wake Word," install it, and then enable Watchdog and auto-update. After starting the add-on, proceed to Settings > Devices and Services. If everything is set up correctly, you will see an Open Wake Word integration.
Configure Voice Assistant
Go to Settings > Voice Assistant. Click "Add Assistant," give it a name (e.g., Nabu), select the appropriate language (American English), and choose "Open Wake Word" as your wake word engine. Select your preferred wake word; I opted for "Okay Nabu."
Install ESP32 S3 Box 3
To connect the S3 Box, use a USB cable to set it up with your PC. Be sure to connect to the box directly rather than via the docking station initially. Follow the prompts to complete the firmware installation, enter your Wi-Fi credentials, and connect it to Home Assistant.
Test the Wake Word
Now, using the wake word set earlier, test the functionality. Commands like "Okay Nabu, turn the office back off" should work seamlessly.

Creating a Custom Wake Word

To create a custom wake word, visit the provided model training site. Spell the word phonetically if needed, and after training, download the files. To integrate this into Home Assistant:

Use SEMA to connect to your Home Assistant server.
Transfer the relevant TF Lite files to the open wake word folder within your Home Assistant’s share directory.
Go back to Settings > Voice Assistants to add a new voice assistant with the new wake word.

Your setup should now respond to your custom wake word!

Conclusion

This user-friendly setup enhances your Home Assistant experience by providing local voice control over your devices. By using the ESP32 S3 Box 3 and engaging with the Open Wake Word feature, you can enjoy a more private and customizable smart home experience without depending on major tech companies.

Keyword

Home Assistant
Local Voice Assistant
Wake Word
ESP32 S3 Box 3
Nabu Casa
ESPHome
Custom Wake Word
Smart Home

FAQ

Q1: What is the benefit of using a local voice assistant with Home Assistant?
A1: Using a local voice assistant enhances privacy, reduces reliance on companies like Google and Amazon, and allows for faster device control without cloud latency.

Q2: Can I use devices other than the ESP32 S3 Box 3 for this setup?
A2: Yes, the setup is also compatible with the ESP32 S3 Box and ESP32 S3 Box Light.

Q3: Do I need to install the ESPHome add-on before following the tutorial?
A3: It’s advisable to install the ESPHome add-on beforehand to ensure compatibility and ease of setup.

Q4: How do I create a custom wake word?
A4: Visit the model training site, input your desired wake word phonetically, run the training process, and then integrate the resulting files into Home Assistant.

Q5: What commands can I issue using my voice assistant?
A5: You can control smart devices by issuing commands like "turn on lights" or "set thermostat to 70 degrees," depending on what is configured within your Home Assistant instance.