Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
pydiverse.pipedag
pydiverse.pipedag
  • Quickstart
  • Parquet files as table store (incl. S3 support)
  • Examples
    • Quickstart
    • Simple pipeline
    • Database testing
    • Imperative Materialization / materializing subqueries
    • Interactive Development
    • DAG Visualization and Grouping Tasks/Stages
    • Stage Validation
    • More realistic pipeline
    • Multiple instances of a data pipeline: full, mini, midi
    • Raw SQL example pipeline
  • Table Backends
  • Database testing
  • Best Practices for data pipelines
    • Best practices: moving from Raw SQL over handwritten SELECT statements to programmatic SQL
    • Best practices: multiple instances: full_fresh, full_stable, mini_stable, midi_stable
    • Best practices: inline views, CTEs, and subqueries
  • Pipedag Config File
  • API
  • Command Line Utility

Development

  • Changelog
  • License
Back to top
Copyright © 2026, QuantCo, Inc
Made with Sphinx and @pradyunsg's Furo