Cost to Serve

Workspace-level cost-to-serve visibility covering LLM inference and infrastructure, sourced from the monthly cost-allocation close.

The platform exposes workspace-level cost-to-serve data so Amigo staff can understand what it costs to operate each workspace. Two separate views cover distinct cost domains, each with its own accuracy characteristics.

LLM Inference Cost

LLM inference cost uses recorded workspace token usage and the rate-card tier effective on each usage date. It is a calculated cost, whose completeness depends on emitted usage, cache counters, and pricing coverage. It does not establish the amount invoiced by a provider or owed by a customer.

Each model used by the workspace is reported individually with:

• Input, output, and cached token counts.
• Dollar cost, when the applicable rate-card entries and required usage counters are available.
• A pricing status flag. Usage that cannot be priced remains visible with token counts and a null cost. The response-level total excludes unpriced usage and flags that the total may understate actual spend.

Review unpriced usage before relying on the total for a cost comparison.

Infrastructure Cost

Infrastructure cost represents the workspace's usage-weighted share of pooled compute and storage. Components include pipelines, model serving, warehouse, storage, and related resources.

Shared-resource figures depend on the allocation method and available usage weights. Review those assumptions separately from the token-metering and pricing coverage used for inference cost.

Each component reports:

• The infrastructure component category.
• How the cost was determined: a usage-weighted share of a pooled resource, or spend tagged directly to the workspace.
• The dollar amount for the month.

Components with no spend in a given month are omitted rather than shown as zero.

Data Source and Availability

Both views are sourced from a monthly cost-allocation close that reconciles the full vendor bill to zero residual. Data is available after the close job completes, typically within a few days of month end. Only closed months can be queried.

Account-level overhead that cannot be attributed to any single workspace is excluded at the data layer and never appears in workspace-level results.

Access Restrictions

Cost-to-serve data is restricted to Amigo staff. Workspace administrators - even those with full admin permissions - cannot access these endpoints. This is deliberate: the data represents Amigo's cost structure and margins, not the customer's bill or contracted price.

Authentication requires an Amigo identity credential. API-key-authenticated callers are rejected because API keys do not carry the identity information needed for staff verification.

Relationship to Other Analytics

Cost-to-serve is separate from the workspace analytics and metric store surfaces. It is not available as an agent-reachable tool or through data access integrations. The data serves internal operational visibility, not customer-facing reporting.

For the separately restricted staff interface, see Cost to Serve in the Developer Guide. For customer-facing operational reporting, see Analytics and Dashboards.