It would only be a matter of time before ChatGPT moved from your desktop and phone to your car.

Following a multibillion-dollar investment by Microsoft, OpenAI’s ChatGPT currently powers Microsoft’s Bing search, Snapchat’s chatbot, and various other chat applications. In 2024, the popular generative-AI (GenAI) model will power Volkswagen’s voice assistant, IDA.

At CES Las Vegas earlier this year, VW announced it will be the “first volume manufacturer” to use ChatGPT in its cars. It plans to roll out in Europe in the first half of 2024, across its ID electric models and the new models of the Tiguan, Passat, and Golf.

The automotive-grade version of ChatGPT will be enabled by Cerence Chat Pro, and integrated into VW’s voice assistant to offer consumers more than what IDA currently does, like controls for infotainment, navigation, climate and to answer general knowledge questions.

A ChatGPT-enabled IDA in future will provide additional information, according to VW, such as enriching conversations, clearing up questions, interacting in intuitive language and receiving vehicle specific information.

“Hello IDA”

The company says nothing will change for the driver; it does not require a new account or app installation. It will be accessible when activating the voice assistant through the trigger words “Hello IDA” or pressing the button on the steering wheel.

Whatever IDA cannot answer, it will be forwarded anonymously to the AI, but IDA’s familiar voice will respond. VW says ChatGPT does not gain access to vehicle data, and that questions and answers are “deleted immediately to ensure the highest possible level of data protection”.

The potential revolution lies in the unique offerings of in-car GPT, surpassing the capabilities of contemporary smartphones. – Natalie Raphil, Robots Can Think

Cerence’s large language model (LLM) on VW’s cloud server facilitates this, which can handle more than 10 000 open-ended questions and answers, and is using Nvidea GPUs. It will also roll out mid-2024 on Škoda vehicles, on its voice assistant Laura, which is part of the Volkswagen Group.

Despite VW’s claims of being a “first volume manufacturer” to roll out ChatGPT in its vehicles, in June 2023, Mercedes- Benz announced it was testing ChatGPT on its “Hey Mercedes” voice assistant. It forms part of an optional beta programme in the US market, available to over 900 000 vehicles equipped with its MBUX infotainment system.

The rollout was via an over-the-air update from Microsoft Azure’s OpenAI Service, with data privacy and IT processes managed by Mercedes-Benz. Customers can ask “Hey Mercedes” to suggest a recipe for dinner, answer complex questions and receive more comprehensive answers, according to the company.

BMW has partnered with Amazon’s Alexa to make the driving experience more interactive.

Regarding privacy, Mercedes says customers know “at all times” what information is being collected and for what purpose, and are free to make their own decisions.

Not far behind in the LLM space, powered by AI, is BMW’s partnership with Amazon’s Alexa. At CES, Amazon and BMW showcased Alexa’s LLM powered capabilities that provide a “more natural way” of getting to know your car.

BMW’s assistant can help with information instead of referring to the car manual; recommend drive modes and activate them; and you can ask how features work, like parking assistance and hear explanations that are more simplified – in the BMW assistant’s voice.

Stringent measures

TomTom navigation also showcased its GenAI and LLM capabilities at CES, through a partnership with Microsoft for its new in-car assistant. Drivers can ask for directions, restaurants, price comparisons, or the location of EV chargers, for

instance, using normal language. It will be built into the TomTom Digital Cockpit, a modular in-vehicle infotainment platform that can be integrated into any vehicle through its SDK, according to the Dutch developer.

TomTom has introduced GenAI and LLM capabilities in its new in-car assistant.

“Armed with extensive EV charger data, our assistant should reduce this range anxiety for drivers by integrating deeply with their vehicle and understanding their charging needs and preferences,” says Ivan Diaz, principal software engineer at TomTom.

Natalie Raphil, founder of the Robots Can Think fintech company, says GenAI in vehicles ushers in hyper-personalisation, tailored to individual drivers, funded by subscription fees that may redefine car ownership costs.

“However, this personalisation poses a challenge for drivers managing driver nuances of a commute and AI-generated alerts. Consumers can expect improved vehicle service efficiency with quicker fault detection and streamlined maintenance processes,” she says, but also asks: “Is it a necessity?”

Raphil says the integration of in-car GenAI raises concerns about data privacy, and will need proper safeguards.

Originally published in Brainstorm March 2024 edition.