Advanced topics#

Pages here cover packaging, images, checkpoints, tokenizer tarballs, and running several operations inside one stage.

Guides#

Page

What it covers

Code upload

Tar layout, upload_modules, upload_paths, wrappers

Docker

docker_image, registry auth, GPU images

Checkpoints

Single-file model upload + mount

Tokenizer artifact

Tarball upload + env vars for processor trees

Multiple operations

Several run_* calls in one run()

Before you read#

When these pages matter#

Topic

Typical trigger

Code upload

Any stage with src/ in prod

Docker

Import errors for torch, CUDA, or system libs on workers

Checkpoints

ML inference map jobs needing a .pt / .bin

Tokenizer tarball

NLP models needing tokenizer.json plus vocab dirs

Multiple operations

One stage that maps then validates without splitting stages

See also#