207 add support for iceberg tables#210

Merged

nwheeler81 merged 5 commits intomainfrom

207-add-support-for-iceberg-tables

Mar 12, 2026

Commits on Feb 26, 2026

Replaced the Parquet-based head/tail snapshot storage with Apache Iceberg tables registered in the AWS Glue Data Catalog. Each tile now has its own Iceberg table with built-in snapshot versioning, …
Nikolai Kolesnikov
committed

Commits on Feb 27, 2026

This design extends CQLReplicator's `--writetime-column` parameter to accept multiple comma-separated column names. The core insight is that Cassandra's `WRITETIME()` function only accepts a single…
Nikolai Kolesnikov
committed
Migrated the `recomputeTiles()` function and its helper `getCurrentTilesCount()` in `CQLReplicator.scala` from legacy Parquet/S3 to the per-tile Iceberg table architecture. Reuses existing Iceberg …
Nikolai Kolesnikov
committed

Commits on Mar 10, 2026

Updated CQLReplicator for S3 and DDB (migrated the ledger from Keyspaces to DDB). Updated resizing mechanism, Updated README.MD. Updated cleanup for old parquet files.
Nikolai Kolesnikov
committed

Commits on Mar 12, 2026

The bug was in executeDelete — the (1, 1) and (1, n) cases were using ddbPartitionKey (the DynamoDB attribute name, e.g., "pk") to look up values in effectiveAttributes, which is keyed by Cassandra…
Nikolai Kolesnikov
committed