Advanced Topics#

Advanced features and techniques for complex YT Framework pipelines.

Advanced Features#

Prerequisites#

Before diving into advanced topics, make sure you understand:

Pipelines and Stages - Basic pipeline structure
Configuration - Configuration system
Operations - Basic operation types

When to Use Advanced Features#

Code Upload#

Use when:

Your stages have src/ directories with Python code
You need to deploy custom dependencies
Working with complex codebases

Docker Support#

Use when:

You need GPU acceleration
Requiring specific system dependencies
Using custom runtime environments

Checkpoint Management#

Use when:

Running ML inference pipelines
Need to version model checkpoints
Managing large model files

Multiple Operations#

Use when:

Combining multiple operations in one stage
Reducing pipeline overhead
Optimizing execution flow

See Also#

Code Upload Guide - Complete code upload documentation
Docker Guide - Docker configuration guide
Checkpoints Guide - Checkpoint management guide
Multiple Operations Guide - Running multiple operations