Classification of the feature
With Shopify SimGym, Shopify is introducing a new app in the AI Research Preview that makes it possible to test themes against each other—without exposing real visitors. Instead of sending real users into experiments, AI agents with human-like buyer profiles go through the storefront and compare two themes: the current live theme and an unpublished theme from the theme library. The goal is to make data-driven decisions about which theme performs better—in navigation, product discovery, and add-to-cart. As of today, SimGym is a preview feature, available to all eligible merchants with no waitlist. This means its feature set, accuracy, and availability may still change.
What the feature is – and what it isn’t
Individually test page elements or sections in isolation – for that you need a complete duplicate theme
Simulate checkout, prices, discounts, or campaigns – that’s outside the scope
Support headless or Hydrogen storefronts
Replace real A/B tests with live traffic
Requirements & Data Basis
SimGym doesn’t require any historical Shopify data, tracking, or conversion data. The AI agents simulate purchasing behavior based on the storefront itself.
Relevant prerequisites:
An active theme that is currently live
At least one other unpublished theme in the theme library that you want to test
The SimGym app, installed from the Shopify App Store
An eligible Shopify account (availability according to the current preview status)
SimGym is currently only available in the AI Research Preview and requires joining a waitlist. Not every shop with SNI has immediate access.
How to use it concretely in the Shopify admin
The process runs through the SimGym app, which is installed separately from the Shopify App Store:
Search for and install the SimGym app in the Shopify App Store
Open the app
Select an unpublished theme from the theme library that you want to test
Start a simulation against the current live theme
Wait until the AI agents have gone through the storefront
Read the report: navigation, product discovery, add-to-cart friction, performance indicators
Review the recommendation: SimGym tells you which theme performs better
Important: There are no fields for price scenarios, campaign variants, or target groups. The test runs based on the storefront as it is visible to every visitor.
Practice logic that determines costs and quality
Known limitation in the research preview: The AI shoppers may misinterpret certain theme structures, such as mega menus or drawer carts. Results should be treated as an initial signal, not as a final basis for decision-making. Stores with sufficient traffic should always prioritize running parallel tests with real data.
Typical practical applications
Check theme redesign before launch
Before a new theme goes live, SimGym can be used to test whether AI agents navigate and purchase better in it than in the current theme.
Evaluate structural UX changes
When navigation, product page layout, or collection structure are modified, SimGym shows whether the new paths are more intuitive for shoppers.
Testing seasonal themes
Before switching to a seasonal theme (e.g. Black Friday design), you can check whether the new theme performs better or worse in the add-to-cart flow than the default theme.
Note: Pricing strategies, discount scenarios, or campaign variants cannot be tested with SimGym. The tool only evaluates the storefront experience at the theme level.
Text and template examples
Brief and to the point, since simulation often involves messaging:
- “Today only: 20% off your favorite products”
- Your cart is still waiting for you
- “Now available again – get it quickly”
Note:
Short texts under 90 characters are often more stable because they can be interpreted more clearly.
Mistakes to avoid
Treat simulation as truth
If you adopt results 1:1 without testing, you risk making wrong decisions.
Changing too many variables at once
If you don’t know what caused the effect, you can’t learn anything from it.
Ignore bad data
If tracking isn’t clean, any simulation is worthless.
Technical implications for larger shops
For enterprise shops, SimGym is primarily a matter of data structure and governance.
Relevant points:
- Data from various sources must be consolidated consistently (Shopify, CRM, ads)
- Integrations should be cleanly aligned (no duplicate events)
- Test cases should be defined (what counts as success?)
- Access and use should be regulated (not everyone should run their own simulations).
When multiple teams work at the same time, conflicting models quickly emerge.
Moving Primates Perspective
In projects we often see simulations being used too early. A typical mistake: teams start with complex scenarios even though the data foundation is still unstable. This leads to results that appear precise but are actually unreliable. Another risk is failing to separate target groups. When new customers, existing customers, and VIPs are modeled together, you end up with averages that don’t allow for any operational decisions. A practical approach: first check data quality, then test simple scenarios, and only then gradually increase complexity. Simulation should always be understood as preparation for real-world tests, not as a replacement.
10-point checklist before go-live
- Tracking works completely
- Consent setup is cleanly implemented
- Data base sufficiently large
- Target segment clearly defined
- Scenario is isolated (not too many variables)
- Realistic expectations
- Comparison scenario available
- Results are documented
- Follow-up test scheduled
- Responsibilities within the team clarified
Summary
SimGym is an AI-powered theme testing app, not a data or campaign simulator
AI agents with human-like profiles move through the storefront
The current live theme is compared with an unpublished theme
The report highlights weaknesses in navigation, product discovery, and add-to-cart
SimGym recommends which theme is likely to perform better
Historical store data, tracking, or conversion events are not required
You cannot use it to simulate pricing strategies, discounts, or campaigns
Available as an app from the Shopify App Store for eligible merchants
It does not replace A/B tests with real users
The results are directional indicators, not guarantees
FAQ
How much does SimGym cost?
As of now, there are no clearly published prices. Since it is a research preview, the model may still change.
Which data do I need?
Clean conversion data, tracking events, and sufficient history. Without this foundation, the simulation is not very meaningful.
Does SimGym replace A/B tests?
No. Simulation helps with preparation, but it does not replace real user tests.
How accurate are the results?
They point you in a direction rather than giving exact values. Accuracy depends heavily on the quality of the data.
When is SimGym not suitable?
If you launch new products without data or have very little traffic.
Do I need technical integration?
As a rule, SimGym uses existing Shopify data. However, for larger setups, clean integrations are crucial.
Links
Shopify Changelog – SimGym Announcement
https://changelog.shopify.com/posts/shopify-simgym-is-now-available-in-ai-research-preview-for-all-eligible-merchants
Shopify Changelog Overview
https://changelog.shopify.com
Shopify Developer Documentation
https://shopify.dev
