With the recent acquisition by Facebook of voice-recognition company Wit.ai, all four major players in the post-PC market — Apple, Google, Microsoft and Facebook — now have a significant infrastructure for hands-free communication with your device.
But what will that mean for our communication with our devices? Is voice just another method to talk to your computer, or are we on the cusp of a revolution in computer communication?
The humble computer mouse was created in the 1960s by engineer Doug Engelbart. The keyboard, through its ancestor the teleprinter, is even older, having been developed in the early 1900s by mechanical engineer Charles Krum and connected to a video display terminal that owes its ancestry to a device developed in the 1930s.
Despite the age of these devices, they still remain the main input devices for your personal computer on your desk or laptop.
Sure, they have more buttons, or more colours, or higher resolution, but the basic input mechanism for the average home computer is the same now as it was in 1984 when the Macintosh became the first commercially available computer to provide a graphical user interface and mouse and keyboard input.
Even the multi-touch screen, made famous by the iPhone and other devices in 2007, could be considered a direct descendant of the mouse, simply moving control of the pointer from an indirect method on your desk to a more direct method on the screen.
But perhaps that is all about to change, with voice recognition technology finally becoming important to the main players and other technology changing the way we interact with computers.
Like the mouse and keyboard, voice recognition technology has been around for a number of years. Commercial voice recognition software has been available for computers since the early 1990s.
But it was only with the advent of technologies such as Apple’s Siri and Google’s Voice Search around 2010 that voice recognition became part of many people’s lives.
Through a natural language, context-aware interface that is always connected to the Internet, technologies such as Siri allow users to address a vast range of needs while skipping touching their device altogether. Instead, they rely on their voice to set timers, check the weather, find movie times and even query where to hide a body.
In 2014, Microsoft introduced Cortana, a Siri-like competitor, meaning that all three leading smartphone platforms had voice recognition. Also in 2014, Apple introduced the “Hey Siri” feature in iOS 8, allowing users to “hail” a smartphone from across the room (as long as it’s plugged in) and ask it a question without touching any buttons at all.
Finally, in 2012 Google released Google Now, an extension to Google Voice Search that provides users with contextual information prior to them requesting it, such as providing traffic information as you leave the office or a list of good restaurants to eat at when you arrive in a new town.
And it’s widely rumoured that both Google and Apple have plans for voice-recognition technology in their television products as well.
While these solutions sometimes have a way to go (John Malkovich surely remains the only person in history to get Siri to correctly interpret “Linguica”), they present a starkly different view from the mouse-keyboard combination of old.
It surely won’t be long before users can have a standard conversation with their device, talking it through a problem rather than frantically tapping the on-screen keyboard or clicking the mouse.
The revolution extends beyond our voice to other devices as well. It would appear that along with replacing old-fashioned input devices, output devices like the monitor are slowly being phased out.
Earlier this year, before it acquired Wit.ai, Facebook made news for acquiring pioneering virtual reality company, Oculus VR for a staggering US$2,3bn. The major product of Oculus VR is the Oculus Rift, a virtual reality headset that immerses you fully in a 3D virtual experience.
Using positional sensors, the Oculus Rift can track your head movements to allow you to look around the environment. The device is still in development. Given the cost of the development kit at around $330, it’s expected that the final product will retail for about $400, bringing virtual reality to the everyday consumer.
Even if you don’t want full immersion, new output products are making it easier for us to step in and out of a digital world without needing a computer monitor.
Google Glass, still in development but having been in beta for a number of years, provides a small display that you can view while wearing the glasses. Products such as the new Android Wear watches from Motorola and others, as well as the Pebble smartwatch and upcoming Apple Watch, provide us with small, customised views into the digital world.
These can all put notifications, music control, sleep and activity monitoring and all the power of those voice-control systems literally at our fingertips, all without the need to use a full input or output device.
Even in your car, Android Auto and Apple’s CarPlay provide a glanceable, touchscreen and voice-controlled interface to your smartphone to ensure you’re always connected to the cloud.
Beyond these standard options, input devices and data-gathering devices are continuing to pop up in places that we don’t expect, making it easier to interact with your devices and control your digital world.
At International CES this year, gadgets using Bluetooth Low Energy for communication with your home network abounded, from a smart chair that helps you work out to a pot for your plants that monitors their vitals and allows you to apply water with a touch of a button.
These add to items from the last year such as the connected toothbrush that monitors your brushing time and style and reports on how you’re doing and the Vessyl cup, a smart cup that can tell you the calorie and caffeine content of your beverages as well as keep track of your daily water intake.
No longer are we tied to our keyboard and mouse to look up and record this data. Our devices will now do it for us automatically and let us know when something needs to be changed.
This trend towards the Internet of Things has been brewing for a number of years, but if CES is any indication, this year shows a real explosion in external input devices that collect data about us and feed it into the cloud.
It could be argued that the new ways of communicating with your computer are already here, although just beginning.
Perhaps it won’t be long before we are speaking to our device using natural language while wearing a VR headset and being instantly alerted about the status of our plants and how much activity, sleep and caffeine we’ve had so far today.
With all of these solutions, perhaps finally the old mouse and keyboard are looking mighty old-fashioned.
- Michael Cowling is senior lecturer and discipline leader for mobile computing and applications at Central Queensland University
- This article was originally published on The Conversation