backfilling

Here are 2 public repositories matching this topic...

praveen-neethipudi / Azure-Databricks-Spotify-Pipeline

End-to-end Azure data engineering pipeline using Spotify dummy data with Medallion Architecture, Databricks, Delta Live Tables, and incremental loading.

etl azure data-engineering databricks azure-databricks deltalake medallion-architecture backfilling scdtype2 deltalivetables incrementalloading

Updated Dec 28, 2025
Jupyter Notebook

al-matty / rest-api-to-s3-sync-pipe

Star

A self-hosted, lightweight ETL pipeline for orchestrated exports from REST API data to S3 with zero infrastructure overhead. Intelligent API batching, S3 optimization, retry logic, automatic S3 gap backfilling, customizable logging.

python aws data rest-api s3 orchestration data-engineering etl-pipeline kestra backfilling

Updated Dec 17, 2025
Python

Improve this page

Add a description, image, and links to the backfilling topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the backfilling topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly