What 500 Shopify stores look like to a machine

Before any agent run, we assembled a panel of 500 real Shopify stores across apparel, food and beverage, wellness, home, footwear, and accessories.

To a human, these stores look fine. To a machine, they are wildly uneven. Some expose clean structured data for every product. Others hide the price behind three interactions and a script that never settles.

A few early observations from assembling the panel, offered as preliminary until the first full run completes:

• Variant information is the first casualty. Size and color often exist only as pixels.
• Product feeds disagree with product pages more often than we expected.
• Add-to-cart is the most fragile common element we measured.

The benchmark results will quantify all of this. This note is simply a warning: the storefront you designed for a person is not the storefront an agent sees.