Welcome to the Payment Recovery Dashboard
The Payment Recovery dashboard in Stay's merchant portal shows you data about subscriptions currently in dunning, top causes of failed billing, recoveries and dunned subscriptions cancelled per day, your daily first time billing failure rate, subscription recoveries, and subscriptions canceled from and during dunning.
What is Dunning?
Dunning is the process of recovering a subscription after a billing attempt fails. Stay AI offers tools for automatically retrying payment methods under your Billing Settings.
Each time a payment fails, the failure is recorded in the Billing Failures tab, and Stay AI creates a Recovery ID or applies the failure to an existing Recovery ID on that subscription.
Each recovery is tracked by a Billing Recovery ID which is recorded in our Payment Recovery Dashboard until a subscription is recovered or cancelled.
Why Track Recoveries?
A subscription can fail to bill and recover OR fail to bill, get cancelled, and be reactivated multiple times in a time period. By tracking each recovery to it's conclusion we can show each one of these events for all subscriptions instead of just relying on what is currently happening or last happened for analytics. This gives you the clearest picture of what is happening when your payment processor declines a subscription.
Breaking Down the Analytics
When you first open the Payment Recovery page, we display the last two months of data (*except for the Subscriptions in Dunning graph).
Main Dashboard Highlights
At a glance, we highlight the number of times subscriptions have been recovered after failed billing, the total revenue captured from those recoveries, and the number of "Out of Stock" billing errors during the selected time period.
"Out of Stock" Billing Errors
Since "Out of Stock" billing errors are managed by a process separate from billing failures, they are not included in the dunning graphs below. Please ensure that you are keeping track of your inventory in Shopify.
Subscriptions in Dunning*
This graph shows the total number of subscriptions currently in dunning in your store, grouped by how many times they've failed since their last successful billing attempt. This allows you to monitor the current health of your recovery process.
*This graph is not affected by the date range to provide you with the most current data.
Export
The export for this graph contains the following information.
Header | Description |
Recovery ID | The set of billing failures that resulted in a recovery. Subscriptions can have more than one in an export. |
Billing Attempt # | The number of Failed Billing Attempts associated with the Recovery ID. |
Last Billing Attempt | The currency of the recovery. |
Date of Initial Failure | The date when the Recovery ID was generated through a failed billing attempt. |
Initial Error Code | The Initial Error Code that generated the Recovery ID. |
Initial Error Message | The Initial Error Message that generated the Recovery ID. |
Subscription ID | The ID of the Subscription which was Recovered. A subscription will show up for each Recovery ID it has. |
Customer Email | The email associated with the subscription. |
Customer Name | The customer name associated with the subscription. |
Projected Sales | The currently value on the subscription. |
Currency | The currency of the subscription. |
Top Causes of Failed Payments
This pie chart aggregates the error message data from the Billing Failures table into an easy-to-digest format. It highlights the top nine reasons for billing failures and groups the remaining reasons into a tenth slice titled "Other."
For most stores, the top error messages typically are "Your card was declined" and "Your card has insufficient funds."
You’ll likely also see a message titled "credit_card_not_found," which is a generic message from Shop Pay. While the exact origin of the error isn't always clear, Shopify has informed us that it typically indicates the card is either expired, has insufficient funds, is not supported, or has information that doesn't match with the bank's records.
Recoveries and Cancellations By Day
The Recoveries and Cancellations By Day graph displays the number of attempted recoveries that ended in a successful billing or cancellation (through dunning auto-cancel OR by a user).
The Cancellations are separated into two categories:
Automatic Cancel - These subscriptions reached the maximum number of retries are were cancelled by Stay AI’s dunning system to prevent further failures from damaging your reputation with your payment processor.
Manual Cancel - These subscriptions were In Dunning when they were canceled through the merchant portal, customer portal, the API, the bulk updater, etc. These were canceled by a person or external app.
First Time Billing Failure Rate
The First Time Billing Failure Rate Graph shows average and daily percentages of recurring billing failure on first attempt.
Subscriptions that enter dunning are found by looking at the Billing Failures with a Date of Initial Failure which match the date of the Billing Failure.
Existing subscriptions that are successfully billed without entering dunning represent the other first time.
The formula is calculated by:
“Billing Recovery IDs Generated AKA Subscriptions that Entered Dunning”
_______________________________________________________________________________________
(“Billing Recovery IDs Generated or Subscriptions that Entered Dunning” + Recurring Orders - Recoveries)
We focus on first-time billing attempts because they provide a clearer measure of payment success. As shown in the Recovery by Attempt and Dunned Subscriptions Cancelled graphs, subscriptions in dunning generate a high volume of failures, with many never recovering. Including these failures inflate your overall failure rate without offering meaningful insights into initial billing success, which is the more critical metric.
Please note Subscriptions that were declined due to out of stock reasons or non-payment-related errors are not included in this graph.
Export
The export for this graph contains the following information.
Header | Description |
Date | The date grouping the First Time Billing Failures and Billing Attempts not in Dunning (Recurring Orders |
First Time Billing Failures | Billing Recovery IDs Generated AKA Subscriptions that Entered Dunning |
Billing Attempts not in Dunning | Recurring Orders - Recoveries |
Percentage of Billing Failures | First Time Billing Failures / (First Time Billing Failures +Billing Attempts not in Dunning) |
Recovery by Attempt
The Recovery by Attempt graph shows the number of recoveries (successful billing attempts following failures) grouped by the number of failed billing attempts before the subscription was recovered.
Metric | Definition |
Recovery Rate | This metric highlights how effectively you are recovering subscriptions compared to failures. It is calculated as follows:
Recoveries / (Recoveries + Cancellations) × 100%.
This number will always be the inverse of the Cancellation Rate. |
Recoveries | The total number of recoveries. |
Subscriptions Recovered | Since a subscription can fail and be recovered multiple times, this metric highlights that aspect. It will always be equal to or smaller than the number of recoveries. A larger difference suggests that the same subscriptions are failing and recovering repeatedly. |
Export
The export for this graph contains the following information.
Header | Description |
Date | The date grouping the First Time Billing Failures and Billing Attempts not in Dunning (Recurring Orders |
First Time Billing Failures | Billing Recovery IDs Generated AKA Subscriptions that Entered Dunning |
Billing Attempts not in Dunning | Recurring Orders - Recoveries |
Percentage of Billing Failures | First Time Billing Failures / (First Time Billing Failures +Billing Attempts not in Dunning) |
Dunned Subscriptions Cancelled
The Dunned Subscriptions Cancelled graph shows the number of cancellations for subscriptions in dunning, grouped by the number of failed billing attempts before the subscription was canceled. The bars are also segmented by Manual Cancel and System Cancel.
Metric | Definition |
Manual Cancel | Subscriptions where billing failed which were canceled by the customer, the merchant, or an API before successful billing attempts could recover them. |
System Cancel | Subscriptions canceled by Stay AI after reaching the maximum number of failed billing attempts. |
Cancellation Rate - Cancellation Rate | This metric highlights how cancellations for subscriptions in dunning compare to failures. It is calculated as follows: Cancellations / (Recoveries + Cancellations) × 100%. This number will always be the inverse of the Recovery Rate. |
Cancellations | The total number of cancellations for subscriptions in dunning. |
Subscriptions Cancelled | Since a subscription can fail and be canceled multiple times within the same period, this metric highlights that aspect. It will always be equal to or smaller than the number of cancellations. A larger difference suggests that customers are reactivating without resolving payment method issues or encountering different payment method issues after reactivation. |
Export
The export for this graph contains the following information.
Header | Description |
Subscription ID | The ID of the Subscription which was Recovered. A subscription will show up for each Recovery ID it has. |
Cancellation Date | The set of billing failures that resulted in a recovery. Subscriptions can have more than one in an export. |
Cancellation Type | Manual or System Cancel. |
Cancellation Reason | The Cancellation Reason. “Billing Attempt Failed - Subscription Auto-cancelled” = cancelled from Max Retries. |
Recovery ID | The set of billing failures that resulted in a recovery. Subscriptions can have more than one in an export. |
Failed Billing Attempt # | The number of Failed Billing Attempts before it was Recovered. |
Initial Error Code | The Initial Error Code that generated the Recovery ID. |
Initial Error Message | The Initial Error Message that generated the Recovery ID. |
Date of Initial Failure | The date when the Recovery ID was generated through a failed billing attempt. |
Date of Last Failure | The currency of the recovery order. |
Customer Email | The email associated with the subscription. |
Customer Name | The customer name associated with the subscription. |