Skip to main content

Inference benchmark

Compare one frozen model and input set across CPU, GPU, and edge targets.

Inference benchmark

Activity responsibilities

ActivityResponsibility
freeze-model-and-inputsExecute the freeze model and inputs stage and publish its declared outputs for downstream activities.
benchmark-cpuExecute the benchmark CPU stage and publish its declared outputs for downstream activities.
benchmark-gpuExecute the benchmark GPU stage and publish its declared outputs for downstream activities.
benchmark-edgeExecute the benchmark edge stage and publish its declared outputs for downstream activities.
normalize-measurementsExecute the normalize measurements stage and publish its declared outputs for downstream activities.
compare-cost-and-latencyExecute the compare cost and latency stage and publish its declared outputs for downstream activities.

Inputs

  • Model and inputs
  • Benchmark protocol
  • Target scopes

Outputs

  • Raw traces
  • Normalized metrics
  • Comparison

Provenance to preserve

  • Hardware and runtime
  • Warm-up policy
  • Batch and concurrency

Runnable example

This is the complete checked-in bundle for this pattern. Download the environment, scope, topology, workflow, input, container recipe, runner, and validation contract from this page before executing it.

Verified local execution

These captures and the output manifest were produced by the fixture's local Docker run and validator. They are published with the same bundle as the runnable files.

Inference benchmark workflow execution evidence
Workflow evidence
Inference benchmark execution evidence
Execution evidence
Inference benchmark output evidence
Output evidence
Open verified output manifest ↓

Execution considerations

Separate cold-start from steady-state measurements and preserve the execution scope for every observation.

AkôFlow boundary: the engine schedules, deploys, executes, transfers data, and records evidence. The ML or agent framework remains an implementation choice inside each activity.