Skip to main content

Model conversion and quantization

Create hardware-specific variants and validate compatibility and quality.

Model conversion and quantization

Activity responsibilities

ActivityResponsibility
load-trained-modelExecute the load trained model stage and publish its declared outputs for downstream activities.
export-onnxExecute the export ONNX stage and publish its declared outputs for downstream activities.
export-torchscriptExecute the export TorchScript stage and publish its declared outputs for downstream activities.
quantize-cpuExecute the quantize CPU stage and publish its declared outputs for downstream activities.
quantize-gpuExecute the quantize GPU stage and publish its declared outputs for downstream activities.
validate-outputsExecute the validate outputs stage and publish its declared outputs for downstream activities.
publish-variantsExecute the publish variants stage and publish its declared outputs for downstream activities.

Inputs

  • Canonical model
  • Target formats
  • Tolerance policy

Outputs

  • Optimized variants
  • Compatibility report
  • Registry entries

Provenance to preserve

  • Converter versions
  • Calibration data
  • Target hardware

Runnable example

This is the complete checked-in bundle for this pattern. Download the environment, scope, topology, workflow, input, container recipe, runner, and validation contract from this page before executing it.

Verified local execution

These captures and the output manifest were produced by the fixture's local Docker run and validator. They are published with the same bundle as the runnable files.

Model conversion and quantization workflow execution evidence
Workflow evidence
Model conversion and quantization execution evidence
Execution evidence
Model conversion and quantization output evidence
Output evidence
Open verified output manifest ↓

Execution considerations

Conversion branches can use different images. Validate optimized artifacts on representative target hardware before publication.

AkôFlow boundary: the engine schedules, deploys, executes, transfers data, and records evidence. The ML or agent framework remains an implementation choice inside each activity.