Skip to main content

Machine Learning workflows

Training, evaluation, optimization, inference, and model lifecycle patterns. Each workflow below has its own page with a DAG, inputs, outputs, provenance, and execution considerations.

WorkflowPurpose
Training with MLflowTrain and register a model while preserving data, parameters, metrics, and artifacts.
Hyperparameter searchExplore independent configurations in parallel and select one with a reproducible objective.
LoRA fine-tuningProduce lightweight adapters from a pinned base model and instruction dataset.
Batch inferencePartition a large input, infer concurrently, and merge traceable predictions.
Comparative model evaluationEvaluate candidate models with the same immutable dataset and policy.
Model conversion and quantizationCreate hardware-specific variants and validate compatibility and quality.
Computer vision trainingExpose collection, labels, augmentation, training, and packaging as observable stages.
Anomaly detectionTrain a detector and make threshold selection an explicit workflow decision.
Model ensembleRun independent predictors and combine them through a versioned aggregation rule.
Model distillationGenerate teacher targets and train a smaller student with measured quality and latency.
Inference benchmarkCompare one frozen model and input set across CPU, GPU, and edge targets.
Infrastructure selection for trainingCompare plans for local GPU, HPC, and cloud before executing the selected candidate.