Visa Study Finds AI Agents Succeed in 57% of Purchases
Visa tested 22 AI agents on everyday purchases, finding a 57% success rate with Google and Meta models performing the best.
Visa conducted a first-of-its-kind study testing 22 AI agents on their ability to purchase a TV, a laptop, and a hair appliance. The study revealed an overall success rate of approximately 57%, noting that agents frequently failed to gather necessary information from shoppers or bought the wrong products.
Google's Gemini (Aragon 4 version) and Meta's Making (Wonder version) achieved the highest success rates at 82%. A Claude agent followed at 76%, while an OpenAI agent succeeded 64% of the time.
Rubail Birwadker, Visa's Global Head of Growth, stated that technology and trust are not yet sufficient for mainstream delegation, though the field is advancing rapidly. Visa and Mastercard are currently developing secure payment tools for agentic commerce. However, legal questions regarding fraud and liability for rogue purchases remain unresolved.
