Skip to main content

Metrics

Overview

In this section, we will walk through the endpoints related to metrics in CAIP Inference API. These endpoints allow you to retrieve and manage metrics for your inference applications, providing insights into their performance and resource utilization.

Description of endpoints

1. Get Metrics

To retrieve metrics for a specific inference application, based on space_id, you can use the following endpoint:

  • GET Metrics (/v1/spaces/<space_id>/metrics/)
note

Currently this endpoint just returns the total number of requests made to the live inference application, but in the future we plan to expand it to include other metrics.