Open
Conversation
…d narration - 02-data-quality-expectations: move files into pipeline/ to encapsulate the pipeline logic - 03-safe-ingestion-on-a-schedule: rename from wap-on-a-schedule, replace WAP lexicon with "safe ingestion", auto-generate branch name from username, add default args, make uv-compatible - 06-data-engineering-with-claude-code: move narration content from existing repo into this subproject - community/marimo: move pipeline files into pipeline/ subfolder Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- Replace pandas with polars in the Streamlit app - Remove --bauplan_user_name flag, auto-infer from authenticated client - Rename bpln_pipeline/ to pipeline/, update README paths - Remove public. prefix from spotify_playlists table references - Switch README setup from pip/venv to uv sync - Update streamlit command to use uv run python -m streamlit - Fix unused variable in mongo_utils.py Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…deps - Move bauplan files and marimo notebook into pipeline/ subfolder - Update models.py imports to use local pipeline.taxi_notebook - Update polars to 1.38.1 and marimo to 0.20.4 in bauplan decorators - Update README with correct paths and uv run python -m marimo command - Add bauplan run --project-dir pipeline instruction Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…username - Move src/app/ and src/bpln_pipeline/ to top-level app/ and pipeline/ - Remove src/setup_dataset/ (tables now loaded via standalone script) - Replace pandas with polars in Streamlit app - Remove --bauplan_username flag, auto-infer from authenticated client - Remove boto3 dependency, add polars and pyyaml - Fix yaml path reference from bpln_pipeline to pipeline - Update README with uv-based setup and correct paths - Fix unused variable in pinecone_utils.py Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…app/ - Replace scattered case_study_telemetry/, pipelines/, docker/, scripts/ with a single pipeline/ folder (models.py, expectations.py, bauplan_project.yml) - Add gold layer: signal_summary with hourly per-sensor aggregates - Add Streamlit dashboard (app/viz_app.py) querying the gold table - Update source to bauplan.telemetry_bronze (now in the lakehouse) - Update pyproject.toml: simplify deps, fix description - Bump polars to 1.38.1 in 02-data-quality-expectations Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Collaborator
|
@innazh I noticed that in many occasions we write bauplan instead of Bauplan. We standardized to the second. Let's make sure the docs are uniform. |
ciro-greco
reviewed
Mar 13, 2026
| @@ -0,0 +1,49 @@ | |||
| # Safe Ingestion with Bauplan and Prefect | |||
|
|
|||
| Implement the Write-Audit-Publish (WAP) pattern using [Prefect](https://www.prefect.io/) and bauplan to safely ingest data into the lakehouse on a recurring schedule. | |||
Collaborator
There was a problem hiding this comment.
I would add a line that says This example is implemented using Prefect, for other orchestration tools (e.g. Airflow, Temporal) see our integration guide https://docs.bauplanlabs.com/integrations/orchestrators/
ciro-greco
reviewed
Mar 13, 2026
| # Git for Data | ||
|
|
||
| This example showcases the power of Bauplan's git-for-data model through a series of SDK commands that go beyond basic pipeline runs. | ||
| A deep dive into bauplan's git-for-data model through a series of SDK commands that go beyond basic pipeline runs. |
Collaborator
There was a problem hiding this comment.
For an exhaustive introduction to the core concepts of git for data see https://docs.bauplanlabs.com/concepts/git_for_data
ciro-greco
reviewed
Mar 13, 2026
| @@ -1 +1 @@ | |||
| # Data Valentine Challenge | |||
Collaborator
There was a problem hiding this comment.
Can we change this title which is utterly unintelligible?
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
bauplan checkout -b branch-namecache_policy=NONEfor prefect because otherwise it seems to try to serialize bauplan’s client and this errors out in the console (looks ugly but still passes)