260 McNuggets? McDonald’s Ends A.I. Drive-Through Tests Amid Errors

In the nearly three years since McDonald’s announced that it was partnering with IBM to develop a drive-through order taker powered by artificial intelligence, videos popped up on social media showing confused and frustrated customers trying to correct comically inaccurate meals.

“Stop! Stop! Stop!” two friends screamed with humorous anguish on a TikTok video as an A.I. drive-through misunderstands their order, tallying up 240, 250 and then 260 Chicken McNuggets.

In other videos, the A.I. rings up a customer for nine iced teas instead of one, fails to explain why a customer could not order Mountain Dew and thought another wanted to add bacon to his ice cream.

So when McDonald’s announced in a June 13 internal email, obtained by the trade publication Restaurant Business, that it was ending its partnership with IBM and shutting down its A.I. tests at more than 100 U.S. drive-throughs, customers who had interacted with the service were probably not shocked.

The decision to abandon the IBM deal comes as many other businesses, including its competitors, are investing in A.I. But it exemplifies some of the challenges companies are facing as they jockey to unlock the revolutionary technology’s potential.

Other fast-food companies have had success with A.I. ordering. Last year, Wendy’s formed a partnership with Google Cloud to build out its A.I. drive-through system. Carl’s Jr. and Taco John’s have hired Presto, a voice A.I. firm for restaurants. Panda Express has approximately 30 automated order takers at its windows through a partnership with the voice A.I. firm SoundHound AI.

Another SoundHound partner, White Castle, has A.I. assistants taking orders in 15 drive-throughs and plans to roll out 100 more, spokeswomen for the two companies said. The technology completes almost 90 percent of orders without human involvement, works efficiently with staff and reduces wait times for customers during rush hour, Jamie Richardson, a vice president at White Castle, said.

“It’s great for customers; it’s equally great for team members,” he told The New York Times. “I am not able to speculate why others wouldn’t invest in similar technology but we’ve been really happy with ours.”

Keyvan Mohajer, the chief executive and co-founder of SoundHound, thinks the departure by McDonald’s is simply an example of a failed partnership.

“It was very clear that they are abandoning IBM, they are not abandoning voice A.I.,” he said. “They are very quickly pursuing other vendors.”

McDonald’s confirmed its intention to eventually return to this technology, writing in the internal email that “a voice-ordering solution” would be in the chain’s future.

In a statement, IBM said it looks forward to continuing to working with McDonald’s, adding that it is “in discussions and pilots” with several restaurants that are interested in building out their automated order technology. McDonald’s confirmed the termination of its A.I. drive-throughs to The Times, but neither company would answer more specific questions.

Several researchers and experts in the industry see the McDonald’s exit as an example of how the new technology is not yet meeting expectations. They doubted that the company would make a speedy return to testing A.I. ordering in its drive-throughs.“A.I. systems often have this very large upfront cost,” said Neil Thompson, the director of FutureTech, a research project at M.I.T.’s computer science and artificial intelligence laboratory. (FutureTech has worked with IBM but Mr. Thompson said that he had no inside knowledge of the deal with McDonald’s).

Currently, voice A.I. is inaccurate often enough that it requires some level of human oversight, which decreases cost savings, Mr. Thompson said. And McDonald’s has a strong alternative offering with higher profit margins: its mobile app.

“The app saves 100 percent of that labor involved in taking that order in a way these A.I. systems, at least currently, are not able to do for them,” Mr. Thompson said. “That makes it just much more economically attractive for them to be using the app than to be using the A.I.”

McDonald’s has not ditched all of its A.I. investments. In December 2023, the company announced that it was working with Google Cloud. A spokesman for the tech giant said it would be applied to “business use cases,” declining to be more specific.

Alex Imas, a behavioral science and economics professor at the University of Chicago, predicted that McDonald’s will watch from the sidelines as its competitors explore the technology.

The McDonald’s business model is not based on saving on the cost of a few drive-through workers, Mr. Imas said. “I think they are going to want to wait and make sure this thing is ready for commercial use.”

He expects McDonald’s to use A.I. in other ways, perhaps by following the example of Target, which recently announced that it was using the technology to assist its employees.

Gee Lefevre, the interim chief executive of Presto, acknowledged that the technology is very new — “less than 0.5 percent of all U.S. drive-throughs” are testing the use of A.I. to take voice orders, he said.

But he also noted that many early attempts have been successful.

Wendy’s, in an email to The Times, said that its A.I. drive-throughs operate without human help on 86 percent of orders. And Presto has had a roughly 90 percent rate with most of its clients, Mr. Lefevre said.

He believes McDonald’s struggled because it used the wrong type of A.I.

“The IBM model was still based on natural-language understanding,” Mr. Lefevre said, explaining that the model works like a tree. When the A.I. hears the customer’s order, it has a limited number of branches to follow that dictate its responses and actions.

This works really well when everything is going right, Mr. Lefevre said. But in a drive-through, where indecisive customers frequently change their orders, he said, chains would be better off using the type of large-language model that powers chatbots like ChatGPT.

As companies continue to test their A.I. drive-through technologies, expect to see more videos of people getting bacon ice cream, condiments instead of food or enough nuggets to feed a sports team.

But ask Mr. Mohajer where voice A.I. is going and he’ll tell you why SoundHound has partnered with car companies like Kia and Jeep.

Picture this.

You’re driving home from work when all the sudden the car asks, “Are you hungry?”

After a few minutes of chatting with your vehicle, you decide on a burger, fries and a shake. The car finds the nearest greasy spoon, places your order for you and plugs in the directions. In three minutes, you pull up and there’s dinner, sitting patiently in a pickup lane, waiting for you to arrive.