What Augmented Reality Cars Might Look Like

Car firms hope to turn windscreens into giant computer displays that overlay the real world with useful information, such as directions or even social media feeds.

The dangers of talking on a mobile phone or texting whilst driving are well known.  So adding what, on first glance, look like added distractions may not seem like the best idea.

But researchers and car firms are increasingly looking to give drivers enhanced, or augmented reality (AR) that adds extra information ranging from directions to social media feeds to the view through the windscreen. And, perhaps the most unintuitive part of it is that it is designed to make the roads more secure for all of us.

“The biggest way augmented reality can be useful is in supporting safe driving,” says Professor Anind Dey, of the Human-Computer Interaction (HCI) Institute at Carnegie Mellon University. “The ability to enhance information around us that might otherwise be opaque to us is invaluable.”

AR is usually considered to be a live view of the real world, onto which extra data â€" usually pulled from the internet - is layered or superimposed. It is similar to the view of the world that Arnold Schwarzenegger had in the Terminator movies.  

The technology is already well established elsewhere. For example, there are numerous smartphone apps that allow users to overlay the view from their camera with everything from directions and transport options to restaurant reviews and house prices. Point your phone at something of interest, power up your app and you are away. 

Companies like Google are taking it one step further. Earlier this year the search giant unveiled its Google Glass project, a pair of minimal glasses that overlay a person’s vision with everything from weather data, location and diary appointments.   It is an idea that has been seized upon by other firms, such as Microsoft.

And now AR is making its way into cars. It builds on so-called “heads up display” (HUD) technology that is commonly used in fighter planes and began to make its way into high-end cars in the late 1990s. These HUDs are frequently used to project directions or speed onto the windscreen in the driver’s line of sight to minimize the amount of time the driver takes their eyes off the road. But augmented reality could allow these displays to go much further than that.

Looking glass

Car manufacturers such as BMW, Toyota, Mercedes and GM have shown off various prototypes in recent years. For example, a Mercedes concept unveiled earlier this year and known as Dice allowed drivers to conjure up information about passing places of interest by merely pointing at them while friends driving past the car show up as an icon on the windscreen, alongside their social network status.

Another concept from GM, known as the enhanced vision system, uses an array of sensors and cameras mounted inside and outside the vehicle to monitor the environment around the car and the driver’s eye and head movements. This information is then used to overlay the view from the windscreen with relevant information about driving conditions â€" such as the location of the building you are trying to find or dangers that you may not be aware of, such as an animal or child at the side of the road. Another mode marks the edges of the road when fog obscures the drivers view.

Other concepts take AR even further. Japanese car maker Toyota has shown off a prototype of “enhanced car windows” that would allow passengers to zoom in on places and objects of interest that they are passing.

However, the most extreme concept comes from designers at Keio University in Japan, who are working on technology that will make the back seat of a car appear transparent, so that when drivers are reversing they can see everything around them.