Skip to main content
ComponentsEngineRUM JS

What GermainUX Watches

Sales, experience and change signals

Find the Cause

Four worked examples

Alert and Act

Catch it next time

Set It Up

Funnel, relationships and alerts

Overview

Conversion fell this week, and everyone asks the same question: was it the site, the traffic or something else? eCommerce managers, marketing teams and developers each look at their own reports, and each sees only part of the answer. A conversion dashboard shows that the rate moved, not why. The cause can be a payment provider that times out, a theme release that slows the product page, or a campaign that brings shoppers who were never going to buy. Each needs a different team and a different fix. GermainUX answers the question from the data. It compares the period with its baseline, ranks the segments that moved with it, overlays the releases and related signals on the same timeline, and rules out what stayed normal. Then it shows you the sessions behind the drop, so you see what shoppers saw.
Conversion DropAggregate AnalysisLeading Factor or MarkerSession Replay
This page uses a Shopify store as the example. The same approach works for any online store that GermainUX monitors.

Questions It Answers

  • Why did conversion fall this week?
  • Is it one device, market, campaign or release, or every shopper?
  • Is something broken, or did the traffic change?
  • Which release made the store slower or harder to use?
  • Which checkout step lost the shoppers, and what did they see?
  • Did the fix bring conversion back?

What GermainUX Watches

GermainUX collects the signals that explain a conversion change in one place, so the analysis can compare them with each other.

Find the Cause

The investigation follows the same path every time, whatever the cause turns out to be:
  1. Open Aggregate Analysis on the conversion or checkout KPI, for the period when it dropped. GermainUX compares the period with a baseline from the time before it.
  2. Read the Leading Factors. A segment classified DEGRADED shows where the drop is concentrated. A segment classified BETTER shows who wasn’t affected.
  3. Check Relationships and Related KPIs for the signals and releases that changed at the same time.
  4. Rule out the signals that stayed normal. They tell the team what not to fix.
  5. Open one affected session in Session Replay as evidence.
The four examples below come from simulated store data, and their numbers belong to the example. Each one ends at a different kind of answer.

Example: A Payment Gateway Starts Timing Out

One morning, the payment provider’s API starts timing out. In this example, 40% of started checkouts convert that day, against 72% over the previous days.
1

Spot the drop

Open the analysis of the checkout KPI for the day. Vs Recent shows conversion 44% below the previous days, and Relationships show user-facing errors climbing from mid-morning as conversion falls.
Shopify Checkout analysis showing 40.4% converted, 44.1% below the previous days, with user-facing errors rising on the Relationships chart and four related KPIs below

Checkout Conversion Drop with User-Facing Errors - GermainUX

2

Read the related KPIs

Related KPIs show what moved with it: payment processing takes 5.5 seconds against a 0.5-second baseline, 11 times normal. Checkout errors are 4 times normal, frustration at checkout 2.6 times, and abandonment is up 26%.
3

Find the failing call

Add the outbound request to the payment API and the top checkout error to the Relationships chart. They rise together, and the top error is “Payment processing failed: gateway timeout”.
Relationships chart where the payment API response time and gateway timeout errors rise together while checkout conversion falls, with the checkout errors table below

Payment API Calls and Gateway Timeouts on the Relationships Chart - GermainUX

4

Rule out the rest

The address step, page load and every other outbound host, including the store’s own APIs, stay at their baseline. Only the payment call changed.
5

Watch one session

Click the error message and open its worst instance, then its Session Replay: the shopper enters the card, clicks Pay now, waits, retries and leaves.
The fix belongs to the payment provider. Once it’s in place, run the same analysis on the following hours to confirm that conversion and the payment API’s response time are back at their baseline.

Example: A Theme Release Slows the Product Page

A storefront theme release rebuilds the product page. The deployment succeeds and nothing errors, so no health check fires. But the page gets slower, the layout shifts, and fewer shoppers add products to the cart.
1

Spot the slowdown

Open the analysis of Page Largest Paint for the days after the release. Pages take 3.2 seconds to show their main content, 54% slower than the 2.1 seconds of the period before.
2

Find the release

Releases appear as markers on the Relationships chart. Hover over each one to see which release lines up with the change. Here, layout shift jumps right after a storefront theme release and stays high.
Page Largest Paint analysis with release markers, one release selected showing its name, duration and system, and layout shift rising after it

Theme Release Marker on Page Largest Paint - GermainUX

3

Read what changed with it

Related KPIs show browser freezes at 2.1 seconds against a 0.2-second baseline, clicks taking 2.6 seconds instead of 0.6, and layout shift (CLS) four times its baseline.
4

See what the release changed

Open the release from its marker. Its details list the files it changed: the product page template, the variant picker, the product form script and the theme’s stylesheet.
Instance analysis of one release, showing its name, duration and system, and the list of theme files it changed

Release Details with the Changed Files - GermainUX

5

Rule out the rest

Outbound hosts, user-facing errors and the checkout steps stay at their baseline. The problem is on the product page, not in checkout.
6

Watch one session

Open a session from after the release in Session Replay: the page shifts as it loads, and the shopper clicks the size selector several times before giving up.
Fix or roll back the changed files, then compare the days after the fix with the days after the release.

Example: A Campaign Brings Traffic That Doesn’t Buy

The marketing team retargets a paid social campaign at a broader audience. Its traffic keeps arriving, but these shoppers browse without adding to the cart. In this example, store conversion falls from about 10.4% to 8.0%.
1

Spot the drop

Open the analysis of conversion for the two weeks after the change. Conversion is lower every day, with no single moment when it broke.
2

Read what ranks

Leading Factors rank the campaign at the top as DEGRADED. Its sessions convert at about half the rate of the other channels. Search, email and organic traffic convert as before.
3

Rule out the rest

User-facing errors, page load, session friction, script loading and browser freezes are flat for the campaign’s shoppers, and identical to the other channels. Nothing on the site is broken.
4

Watch one session

Open a session from the campaign in Session Replay: the shopper lands, browses a few products and leaves early, without trying to buy.
This answer goes to the marketing team, not the developers. Adjust the campaign’s audience, then compare its conversion with the other channels again.

Example: A Checkout Fix Brings Conversion Back

For weeks, shoppers in some countries were told to “enter a valid ZIP code” when their address was correct. The team ships a checkout release that fixes the validation. The same analysis that finds a drop shows whether the fix worked.
1

Spot the rise

Open the analysis of the checkout KPI for the week after the release. In this example, 72% of started checkouts convert, 20% more than the week before. Checkout errors fall by 82%, frustration at checkout by 67% and abandonment by 13%.
Shopify Checkout analysis showing 71.9% converted, 20.2% above the previous week, with user-facing errors falling after a release marker and related KPIs down

Checkout Conversion After the Fix - GermainUX

2

Match it to the release

The checkout release marker sits on the day the user-facing errors drop. The address validation error that topped the checkout errors before is now rare.
3

Read what ranks

Leading Factors show where the change landed. The payment step, which shoppers only reach after a valid address, is classified BETTER: 92% of shoppers who reach it now convert, against 72% overall.
Leading Factors of the checkout analysis, with the address validation error in the checkout errors table and the payment step classified as better

Leading Factors After the Checkout Fix - GermainUX

4

Watch one session

Open a checkout from after the release in Session Replay: the shopper enters the address once and moves straight on to payment.
Share the result with the team that shipped the fix, and keep an alert on the checkout errors so a regression shows up quickly.

Alert and Act

Each example points to a signal you can watch from now on:
  • SLAs and outlier detection on conversion and checkout completion, so the next drop raises an alert
  • Alerts on the response time and failures of your payment provider and other third-party calls
  • Synthetic user scenarios that place a test order on a schedule, so a broken checkout shows up before shoppers meet it
  • Scheduled reports on conversion by campaign, device and release, for the marketing and eCommerce teams

Set It Up

The analysis needs the store’s data, the checkout funnel, and relationships that tell GermainUX which signals belong together.
1

Monitor the store

Deploy Shopify monitoring with RUM JS on the storefront and checkout, so GermainUX collects sessions, commerce events, page performance and outbound calls.
2

Configure the checkout process

Configure a business process for checkout, with one step per checkout stage, so GermainUX measures completion and the step where shoppers stop.
3

Relate the signals to conversion

Configure KPI relationships from your conversion and checkout KPIs to the signals that explain them: page performance, user-facing errors, rage clicks and outbound requests. When one provider matters on its own, such as your payment provider, limit that relationship to its host, so a slowdown isn’t lost among other requests. Show releases as markers.
4

Set SLAs and alerts

Set SLAs on conversion and checkout completion, and alerts on the signals that matter most to your store.

Additional Resources

Analysis Dashboard

Aggregate and instance analysis

Shopify Monitoring

Sessions, conversion and checkout

Use Cases

More Use Cases

Get Help

Every store has its own funnel, providers and release process. The GermainUX team can help you set up the checkout process, the KPI relationships and the alerts that fit your store.

Contact GermainUX Support

The GermainUX team helps you get up and running faster, empower your team, turn data into actionable insights, and optimize performance to deliver measurable business outcomes.

Can't Find What You Need?

Search all GermainUX docs with Ctrl + K, or use the feedback buttons at the bottom of this page to tell us what is missing.

The content of this document is proprietary to GERMAIN SOFTWARE.