When it first happens to you, you think you’re crazy. You wander into a cafe and look at a menu with a variety of bagel sandwiches, but each illustration looks eerily flawless, precisely symmetrical, and oddly smooth, eliciting a visceral sensation that something isn’t right. You might think you’re paranoid, but you’re not losing your mind. Generative AI menus have hit the restaurant business courtesy of models trained on a narrow, “pleasing” aesthetic that feels wrong even when you can’t articulate why.
“It’s almost like an alien trying to make a pizza without understanding its core principles,” Reality Defender CTO Alex Lisle told TechCrunch. (Reality Defender itself is part of a growing category of startups selling AI-detection and content-verification tools — a business that exists in part because of issues like this one.)
Large language models (LLMs) and diffusion models — the kinds of AI models that make seemingly omniscient chatbots and image generators like ChatGPT and Midjourney possible — are trained on vast quantities of data. The models then identify patterns in the datasets to predict what a user is looking for when they ask something like, “Make me a menu for a burger restaurant.”
“A lot of this stuff looks like a Chili’s menu from 2015, and there’s a reason for that,” Lisle said. “That was the corpus of work from which [the models] drew their function.”
“Model collapse is almost like a mad cow disease… when you feed the outputs from one model back into itself, eventually the inbreeding becomes too much, and the whole thing collapses,” Lisle explained. “What we see here is convergence, which isn’t necessarily model collapse.”
Convergence is a bit less extreme, degrading the quality of an AI’s outputs without making it entirely useless.
If someone asks an AI model to generate a menu for a fast food restaurant, the model will likely reference menus from Wendy’s, Burger King, McDonald’s, or another popular chain. These menus already share a similar style, which means that the AI-generated outputs will mimic that same style, only to further reinforce it further if the AI-generated menu ends up back in training data.
But menus and advertisements for food will always look better than the real thing, like a Big Mac in a McDonald’s commercial where each layer of the sandwich is arranged by a prop designer to look maximally appetizing. This effect can become even more pronounced in AI outputs.