February 21, 2018

Percent of Their A/B Tests that Produce a Statistically Significant Result According to Professionals Worldwide, Jan 2018 (% of respondents)


Professionals working in design, user experience (UX), marketing and product management were asked about A/B test results. This chart shows the percent of A/B tests that produce a result that is statistically significant.


Data is from the February 2018 UserTesting "CX Goes Mainstream: The Customer Experience (CX) Industry Report, 2018." 3,900 professionals in Canada, Europe and the US from various industries were surveyed during December 11, 2017-January 8, 2018. Respondents' ages were under 18 (0.7%), 18-25 (12.2%), 26-34 (35.9%), 35-45 (30.2%), 46-69 (19.7%), 70+ (0.6%) and rather not say (0.8%). Respondents' roles were business owner (8.7%), a consultant working for an agency (4.8%), employee (79.3%), independent consultant (5.7%) or other (1.5%). Roles include design/UX, marketing, market researchers and product management. UserTesting is a user experience research and testing platform.