Type Variants Audience Goal Details
Store
acme — acme-outdoors.myshopify.com
northbound — northbound-gear.example.com
Test type
Theme
Split traffic between the live theme and a whole variant theme.
Only one theme test can run at a time. The live theme is always Arm A.
Template
Split traffic between the live template and an alternate JSON template.
The alternate template file is created automatically when the test launches.
URL
Redirect a share of visitors from a path to a different destination URL.
The destination must be on the same store — cross-domain redirects are rejected.
Control (Arm A) — locked to the live theme
Acme Outdoors — Spring 2026
Variant (Arm B) theme
Choose a theme…
Acme Outdoors — Free shipping banner (UNPUBLISHED) Acme Outdoors — Spring 2026 (copy) (UNPUBLISHED) Holiday 2025 (UNPUBLISHED)
Theme tests require a theme selected for both the control and the variant.
The variant theme must already exist — Shopify's app scope does not allow Dorris to duplicate a theme automatically here yet.
Duplicate the live theme in Shopify Admin
Click-through rate
Visitors who click a CSS selector you choose (e.g. an add-to-cart button).
Add-to-cart rate
Visitors who add anything to cart, detected automatically.
Conversion rate
Visitors whose visit ends in a completed order.
Average order value
Mean order value among purchasers in each arm.
Revenue per visitor
Total revenue divided by all visitors — the blended metric.
Name
Hypothesis
Results stay hidden behind "Collecting Data" until both minimums are met — this is the anti-peeking gate.
Fix before saving
Theme tests require a theme selected for both the control and the variant.