One former ecommerce CEO achieved a 100% win rate on website optimization tests, seven successful experiments out of seven attempts, by building an AI agent system that generates, executes, and analyzes tests autonomously. The achievement signals a shift in how brands approach website personalization.
"Cody is probably one of the most advanced experimenters, personalizers we've seen, and I think is like the all-time leader in win rate on tests," Drew Marconi, CEO and cofounder of Intelligems, said during the ecommerce event Grow NY this month. The typical win rate for ecommerce optimization tests hovers around 30%, making the perfect success rate particularly notable.
The experimenter behind that record is Cody Plofker, former CEO of Jones Road Beauty. He built a system powered by AI agents that manages testing autonomously, from ideation through implementation, and industry observers describe it as the future of website optimization: sites that adapt automatically to individual visitors.
AI agents are outperforming traditional testing approaches
The experimentation system Plofker developed operates with minimal human intervention, using AI to identify optimization opportunities, design tests, and execute them across the website.
Traditional A/B testing requires significant manual effort. Marketing teams must brainstorm test ideas, design variants, implement changes, monitor results, and analyze outcomes. This process typically yields a 30% success rate, meaning seven out of ten tests fail to produce meaningful improvements.
Plofker's AI-driven approach inverted these economics. By achieving seven consecutive wins, the system demonstrated that machine-generated hypotheses and automated execution can outperform human-led testing programs.
The divide between AI-powered optimization and traditional methods is widening. Brands still relying only on manual testing risk falling behind competitors that deploy autonomous systems, which test faster, learn continuously, and personalize at scale.
The future of personalization is already here
Website optimization is evolving from periodic A/B tests to continuous, visitor-specific adaptation. Rather than showing all visitors the same experience, advanced systems can now tailor content, layout, and offers to individual users in real time.
"The future of your website is going to be agentically optimized for each visitor," Marconi said. "I think that future is here; it's just not evenly distributed."
The shift changes ecommerce strategy. Instead of optimizing for average performance across all visitors, brands can now maximize conversion for each individual based on their behavior, preferences, and context.
The technology already exists; most brands just haven't implemented it. That delay compounds. Early adopters like Plofker accumulate more data and refine their systems while everyone else waits, building an advantage that gets harder to overcome with every test they run.
From operator to advisor
Following his success at Jones Road Beauty, Plofker has transitioned from operational leadership to advisory roles. He now serves on company boards, consults with multiple brands, and is launching a new venture.
The move puts the experimentation frameworks and AI systems he built in front of a much wider set of companies. That is how a single 7-for-7 record stops being an outlier and becomes a playbook other ecommerce brands can copy.
The discussion was part of an industry conversation hosted by Intelligems, a platform focused on ecommerce experimentation and optimization.
This was originally featured in the Retail Daily newsletter. For more marketing insights, statistics, and trends, subscribehere.
You've read 0 of 2 free articles this month.
685 Third Avenue21st FloorNew York, NY 100171-800-405-0844
1-800-405-0844[email protected]