Skip to main content
APIContext
Talk to salesStart free
Start HereGuidesConceptsCLIReferenceChangelog

What is the CASC Score?

Key Concepts​

The CASC (Cloud API Service Consistency) score is a simple, easy-to-understand credit rating-like metric that blends together a number of metrics for each API (including availability, latency, and number of outliers) using proprietary machine learning technology benchmarked against APImetrics unrivaled dataset of historical API test call results to give a single number between 0 and 9.99 that indicates the relative quality of the API over a given period. The CASC score allows you at a glance to see the quality of an API, whether it is getting better or worse and how it compares to other APIs.

Scoring​

Scores are generated on a weekly (Monday-Sunday) and calendar month basis.

What does a score mean?​

Over 8.0

You'll have few issues with your API, indicating things are generally doing well and we would expect you'll have no more than 1-4, typically minor incidents a month tying up no more than 400 hours of engineering investigation effort.

Between 6.0-7.99

The API is underperforming, with significant performance periods where users are impacted. The lower the score in this area and the more likely the incidence of serious API problems is. This could end up tying up up to 1,200 hours of effort a year or more.

Below 6.0

Unacceptable performance from the API leading to significant performance issues impacting users. Expect to have engineers working full time on issues.

Quality Analytics Reporting​

Quality Analytics are accessed from the main navigation menu. You can pick weekly or monthly data from the tabs.

For your current project the URL for the Quality Analytics reports will always be: https://client.apimetrics.io/insights/

See at a glance how well the quality of an API

You can compare instantly compare the quality of different API in a particular period, whether it is trending up or down or if an individual API is performing worse than other.

The Quality Analytics Summary page​

The CASC score is shown on the far right with links to access the full report, edit the monitor or access the detailed current statistics for the API.
Clicking on the API name OR the CASC score will also access the Quality Analytics reports.

Quality Analytics Analysis​

The Quality Analytics analysis for a monitor is presented as a single consolidated Insights Report. Reading top to bottom, it covers:

  1. The CASC Score for the monitor, alongside a Factors affecting CASC score panel that summarizes what is driving the score and any issues our systems have observed.
  2. Pass Rate and Effective Pass Rate, with a plain-language note on how many API calls were analyzed and the resulting estimated downtime.
  3. Most failures and Most outliers, each broken down by Cloud, Region, Country, and Node so you can see exactly where problems are concentrated.
  4. Latency analysis — Mean Latency, Standard deviation, Slowest locations, and Most variation — to highlight which locations affect the customer experience.

The Factors affecting CASC score panel at the top of the report explains the score in context — whether the monitor is performing perfectly or near to it, how it compares to the previous period, and any minor or major issues such as outliers or elevated latency.

The Most outliers panel reports the outlier rate broken down by Cloud, Region, Country, and Node, so you can identify exactly which data center, region, or country is producing results that fall outside normal performance parameters.

The Most failures and Most outliers panels sit side by side and break results down by the location the calls originated from, indicating which cloud and data center combinations might provide a better customer experience.

See also​