mirror of https://github.com/hanzoai/anomalib.git synced 2026-10-30 18:48:11 +00:00

Files

T

The previous commit was meant to remove .github/workflows and removed
every tracked path instead — 892 files, the whole repo. This puts back
the 874 that were never in scope; the eighteen workflow files stay gone,
for the reasons that commit gives.

Content is byte-identical to 9d2aec9 outside .github/workflows.

2026-08-13 23:27:57 -07:00

2.5 KiB

Raw Permalink Blame History

Pipelines

The pipelines feature is experimental and might be changed without backward compatibility.

Introduction

Tasks such as Benchmarking, Ensemble Tiling, and Hyper-parameter optimization requires running multiple models and chaining multiple stages together. The pipelines feature provides a way to define and run such tasks. Each part of the pipeline is designed to be independent and composable so that they can be reused across different pipelines.

Terminology

Pipeline: Pipeline is the main entity that defines the sequence of jobs to be executed. It is responsible for creating and running the jobs. The job itself is generated using a job generator. And, these are chained using a runner.
Runner: A runner is responsible for scheduling and running the jobs. It also passes the output of the previous job, if available. It also calls the right hooks to gather and save the results from the jobs and passes the gathered results to the next runner.
Job Generator: The job generator is responsible for generating jobs based on the configuration. It is used by the runner to create jobs.
Job: A job is an atomic unit of work that can be run independently. It is responsible for running a single task. For example, training a model or computing metrics. The idea behind this is to ensure that it can be attached to any runner without making changes to the job itself. This is useful when you want to distribute the jobs to increase the throughput of your pipeline.

:class: tip
For more clarity on creating a custom pipeline, refer to the [How-To Guide](../../how_to/pipelines/index.md).

Base classes

::::{grid} :margin: 1 1 0 0 :gutter: 1

:::{grid-item-card} {octicon}workflow Pipeline 🔗 ./base/pipeline :link-type: doc

Base class for pipeline. :::

:::{grid-item-card} {octicon}file Job 🔗 ./base/job :link-type: doc

Base class for job. :::

:::{grid-item-card} {octicon}iterations Job Generator 🔗 ./base/generator :link-type: doc

Base class for job generator. :::

:::{grid-item-card} {octicon}play Runner 🔗 ./runners/index :link-type: doc

Base class for runner. :::

::::

Available Pipelines