Modelunverified
Inference cost model
Computes marginal cost per token or request from serving efficiency, batching and hardware cost.
extends
1The source model is built on top of the target. The dependency tree descending from the three-statement model is the most legible thing in the graph.
Relationships pointing at this node.
produced by
3The modeling object or downloadable deliverable the task creates.