Posted by Glen Shires, Google Assistant SDK Tech Lead
Text-based queries and responses
Voice-in and voice-out was a natural first step for the Google Assistant SDK, but we have heard from many developers that other input and output mechanisms are needed. Today we’re happy to announce that the Google Assistant SDK now supports text-based queries and responses. Both of these updates build upon the already-supported voice query and voice response API.
When we first launched the Google Assistant SDK one of the most prominent questions we received was “how can I ask the Assistant to control my device?” With the latest SDK, you can utilize the new Device Action functionality to build Actions directly into your Assistant-enabled SDK devices.
When you register a device you can now specify what traits the device itself supports – on/off or temperature setting, for example. When users then ask the device, “Ok Google, set the temperature to 78 degrees,” the Google Assistant will turn such queries into structured intents via cloud-based automated speech recognition (ASR) and natural language understanding (NLU). All you need to provide is the client-side code for actually fulfilling the Device Action itself – no other code is needed. The SDK supports a set of device traits that are supported by Smart Home.
To help get you up and running with Device Actions, we are launching a new management APIto help you register and manage your SDK devices. With this API you are able to easily register, unregister, and see all devices that you have registered. We’re also introducing a device model which represents a set of devices with the same type and traits.
Get started with all this new functionality, by checking out the documentation and samples.
If you’re interested in building a commercial product with the Google Assistant, we encourage you to reach out and contact us.
As always, there are great conversations happening within StackOverflow, as well as the Assistant SDK and hackster.iocommunities. We encourage everyone to take part!