Troubleshooting

Common issues and solutions for YT Framework pipelines.

This troubleshooting guide is organized by category to help you quickly find solutions to common problems.

• Pipeline Issues
• Operation Issues
• Configuration Issues
• Debugging Guide

Quick Navigation

• Pipeline Issues - Problems with pipeline setup, stages, and configuration

• Operation Issues - Issues with Map, Vanilla, YQL, S3, Docker, and Checkpoint operations

• Configuration Issues - Dev mode and Prod mode specific problems

• Debugging Guide - Debugging tips, getting help, and prevention strategies

Common Error Patterns

Most issues fall into these categories:

1. Configuration Errors: Missing or incorrect configuration values

2. File/Path Errors: Missing files, incorrect paths, permission issues

3. Operation Errors: Failed map/vanilla/YQL operations

4. Environment Errors: Missing dependencies, wrong Python version, etc.

5. Mode-Specific Errors: Issues that only occur in dev or prod mode

Quick Fixes

Pipeline won’t start

• Check enabled_stages in config

• Verify config file exists

• Check Python version (3.11+)

Operation fails

• Test in dev mode first

• Check operation logs

• Verify input tables exist

• Review resource limits

Can’t find files/tables

• Verify paths are correct

• Check file permissions

• Ensure previous stages completed successfully

Getting Started

If you’re new to troubleshooting:

1. Start with Pipeline Issues if your pipeline won’t run

2. Check Configuration Issues for mode-specific problems

3. Review Operation Issues for operation-specific errors

4. Use Debugging Guide for advanced troubleshooting

See Also

• Configuration Guide - Complete configuration reference

• Dev vs Prod - Understanding execution modes

• Operations Guide - Operation-specific documentation