A/B Testing: QA & Troubleshooting

A checklist to ensure variants apply reliably and results are trustworthy.

Visual editor preview
Screenshot placeholder
1200×720px • /docs-images/ab-testing/visual-editor-preview-1200x720.png
Add a file at this path to replace the placeholder.
Uvisual editor selecting an element and applying a change.

QA Checklist (Before Launch)

  • Preview the variant live in the visual editor before you launch
  • Test desktop + mobile
  • Prefer the visual editor—it picks a stable selector for you. If you type selectors by hand, avoid random/hashed class names.
  • Confirm anti-flicker reveals the page within the configured timeout
  • Verify conversions you care about are being tracked

Variants Aren’t Applying

Zolvio tracks a delivery-health signal (were the selectors found, and did the change apply?) and holds back a decision-ready winner if a variant isn’t applying reliably. Common causes:

  • The element loads late (Zolvio watches for it, but very late content can still miss)
  • The selector is too specific (theme changes break it)—re-pick it in the visual editor
  • The element exists only on some templates/variants

Visitors See a Flash

See Anti-Flicker for timeout tradeoffs and mitigation strategies.

If you suspect the wrong pages are modified

Pause the test immediately. Run a targeted QA session to confirm the URL matching rules and scope settings.