Artificial intelligence: The future of autonomous driving

Artificial intelligence: The future of autonomous driving Árpád Takács is an outreach scientist for AImotive. AImotive is the leader in AI-powered motion, and the first company who will bring Level 5, self-driving technology with a camera first sensor approach to the global market. Árpád's fields of expertise include analytical mechanices, control engineering, surgical robotics and machine learning.


Artificial intelligence has experienced rapid advancements in the last five years, enabling new technologies previously only imagined in Hollywood films or best-selling novels.

The advent of deep learning – high performance computing combined with big data and sophisticated neural networks – has spurred an avalanche effect in AI development for a variety of product domains.

As technology improves, researchers then design prototypes, algorithms are subsequently created, and developers begin looking to optimise hardware solutions to help enable these new technologies.

This new AI sophistication has led to a natural cohesiveness between AI and autonomous driving. For years the prevailing wisdom was that Advanced Driver Assistance Systems (ADAS) would gradually evolve into self-driving capabilities, but the industry has found that innovation at this level is limited.

In order to proceed to a truly self-driving world, vehicles must do more than operate independently – they must be able to think and reason much like the human mind can do.

AI for self-driving vehicles isn’t limited to a Knight Rider-like driving experience where your vehicle anticipates your needs and acts accordingly.

For true L5 self-driving, the car will have to solve the door-to-door transportation task, which means the entire system will have to be integrated and supervised by AI.

That AI will take many forms – everything from detection, to decision making, to supervision. In the real world, AI is a critical component for two very important requirements: recognition of the world around the car and propelling the car into motion.

Training AI to recognise

The first step with AI technology in automobiles is detection and recognition. As with anything involving machine learning, the AI must be trained to put context and meaning behind images, obstacles and various scenarios one might encounter behind the wheel – this is the recognition layer, a necessary precursor to decision-making.

While it’s straightforward enough to teach AI the difference between another vehicle, or pedestrian, or bicycle or building, there is much greater difficulty in training AI for the very real possibility of inclement weather, adverse driving conditions, unexpected obstacles or car accidents.

A significant challenge lies in the acquisition of quality, representative, diverse and well-labeled data, and since most of these situations happen at random, it is nearly impossible to find real-world ways of exposing AI to the types of road scenarios that drivers encounter everyday.

There are solutions to these problems, and advancements in a wide range of technologies have helped to make training AI much easier.

Rather than relying on real world happenstance to expose AI to various driving conditions, at AImotive we use video games, an augmented simulation environment and the principles behind game mechanics to engage the AI hundreds, thousands and even millions of times to recognise everything a driver might find on the road and act accordingly.

Today, most of the data used in the training of AI is manually labeled (annotated), which is not scalable, but AImotive has taken a different approach – providing photorealistic images and scenarios that can enhance the data used for training.

Training the AI to drive

As sophisticated as AI training has become, the truly advanced part of using AI in autonomous driving is in the motion. Far beyond simply helping the car to drive, motion includes using AI to maneuver and function in the real world, and solve the dynamic driving task.

This is no easy task – it is one of the biggest questions plaguing the industry today.

Beyond the ability to simply see and recognise various traffic scenarios and issues on the road, in order to be truly autonomous vehicles will also need to immediately decide and react, much like a human would, yet with greater precision and enhanced agility.

AI has the power to recognise various obstacles and events in context – meaning it has an awareness of where the car is in relation to what is happening around it, and can maneuver the car using concrete terms around the its planned trajectory.

The result is that the AI is able to see and respond to everything around it, even more precisely than a human driver who can more easily be distracted.

This precise vehicle movement, or plan, is based on: what the AI has seen previously (the recognition), the prediction of the behavior of the object, and the free space detection (detection of the drivable surface).

At AImotive, we believe the solution lies in achieving the right balance between AI capabilities and traditional rule making. While AI is a crucial part of motion planning and decision making, it is imperative to follow very strict rules that will serve as a guideline for the AI.

For example, rules include everything from how to interpret red lights or stop signs, to managing speed limits and lane changes, to merging traffic or slowing through a school zone or construction area.

When deeply integrated into the autonomous system, the AI then allows for a better and more thorough understanding of how to react and respond to any situation given its deep knowledge of intrinsic traffic boundaries.

The AI of today will be the self-driving car of tomorrow

The future of autonomous driving is brighter than ever before.

While still in the early stages, never before has imagination merged so seamlessly with real world capabilities. OEMs are beginning to see themselves as more than just automotive designers and manufacturers, but also as technologists and developers, and this shift will help to facilitate a more natural environment for automobile technology to thrive.

AI is the key catalyst to creating the all-inclusive autonomous driving experience. Far beyond the automotive industry, AI is now all around us.

As we start to better trust the capabilities and sophistication of AI, we will find more valuable use cases. That trust, in turn, will spur development of all kinds of new technologies, and autonomous driving is at the top of the list. Interested in hearing industry leaders discuss subjects like this and sharing their use-cases? Attend the co-located IoT Tech Expo, Blockchain Expo, AI & Big Data Expo and Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam and explore the future of enterprise technology.

View Comments
Leave a comment

Leave a Reply

Your email address will not be published. Required fields are marked *