🔄 Sync with upstream changes by h0lybyte · Pull Request #17 · KBVE/realtime

h0lybyte · 2025-10-13T06:09:38Z

Upstream Sync

This PR contains the latest changes from the upstream repository.

Changes included:

Synced from upstream/main
Auto-generated by upstream sync workflow

Review checklist:

Review the changes for any breaking changes
Check for conflicts with local modifications
Verify tests pass (if applicable)

This PR was automatically created by the upstream sync workflow

Also add binary payload test

Routes CRUD operations to master node when such is set via environment variable --------- Co-authored-by: Eduardo Gurgel <eduardo.gurgel@supabase.io>

we were not starting the replica processes properly so we would end up failing healthchecks.

we were using Realtime.Repo to build the required SQL to call tenants databases. as we move towards some regions only using Replicas we can remove fully this logic and rely on the Replica modules to build said queries

If the string size matches the uuid length we were parsing it to be uuid which created issues. To prevent it we now handle payload based on the relations provided and we further simplified the logic to not use send in our message handling

…ase#1631)

…#1635)

This approach prevents sending more information than needed reducing the amount of data send via gen_rpc. We also remove some unnecessary calls to primary in the delete controller operation

…1639) Only realtime.messages should be processed

Avoid using the same container over and over

…e#1650)

* Allow 3x more max heap size than other processes * Avoid compressing given that gen_rpc does this for us already * fix: remove limit_concurrent metric * fix: revert the way we fetched tenants to report on connected metric

* fix: remove tenant tag on RPC metrics * chore: bump version

…abase#1649)

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

…upabase#1820)

* feat: add PartitonedTables Peep.Storage implementation using N ETS tables with optional tag-based routing. Each metric write is routed to a specific table based on a `:routing_tag` option. If the routing tag is present in the metric's tags, `:erlang.phash2/2` is used to select the table. Otherwise, the first table is used. This reduces lock contention by routing different tag values (e.g. different tenants) to different ETS tables, without partitioning metrics within a table.

…1821)

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

…#1825)

Improve the local setup to make it straightforward to run the server: ``` mise run db-start mix setup mise run dev ``` - Introduce mise to manage tool versions, tasks, and envs - Removed .tool-versions and Makefile in favor of mise.toml - Introduce `Realtime.Env` to use in runtime.exs with tests and more validations to make it more resilient to avoid hard to debug errors in the server booting process - Group all envs together in `runtime.exs` to have better discoverability, especially for docs (self-hosting) and config - Break readme into dedicated docs to reduce noise in the main readme (easier to scan) - Add Code of Conduct and Contributing guides based on https://github.com/supabase/.github and https://github.com/supabase/supabase - Added env vars into ENVS.md: API_TOKEN_BLOCKLIST, CLUSTER_STRATEGIES, DB_MASTER_REGION, DB_HOST_REPLICA_FRA, DB_HOST_REPLICA_IAD, DB_HOST_REPLICA_SIN, DB_HOST_REPLICA_SJC, REGION, LOGS_ENGINE, LOGFLARE_LOGGER_BACKEND_URL, LOGFLARE_API_KEY, LOGFLARE_SOURCE_ID, JWT_CLAIM_VALIDATORS, METRICS_JWT_SECRET, METRICS_TOKEN_BLOCKLIST, MAX_GEN_RPC_CALL_CLIENTS, PROM_POLL_RATE, AWS_EXECUTION_ENV, JANITOR_MAX_CHILDREN, JANITOR_CHILDREN_TIMEOUT, LOG_THROTTLE_JANITOR_INTERVAL_IN_MS, MEASURE_TRAFFIC_INTERVAL_IN_MS, NO_CHANNEL_TIMEOUT_IN_MS, RPC_TIMEOUT - Removed stale env vars from ENVS.md: DISCONNECT_SOCKET_ON_NO_CHANNELS_INTERVAL_IN_MS, JANITOR_CLEANUP_MAX_CHILDREN, JANITOR_CLEANUP_CHILDREN_TIMEOUT

Used Elixir 1.20 type system to identify violations.

now we can setup otel to track performance of each test and have properly defined spans per test

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

edgurgel and others added 30 commits November 19, 2025 04:04

chore: fix flaky gen rpc pub sub test (supabase#1621)

9c1dcba

chore: use supabase-js@latest on integration tests (supabase#1622)

d266b54

Also add binary payload test

feat: tenant crud operations are region aware (supabase#1620)

55bac25

Routes CRUD operations to master node when such is set via environment variable --------- Co-authored-by: Eduardo Gurgel <eduardo.gurgel@supabase.io>

fix: replica module startup (supabase#1626)

d412b66

we were not starting the replica processes properly so we would end up failing healthchecks.

fix: remove Realtime.Repo requirements (supabase#1627)

253b6cc

we were using Realtime.Repo to build the required SQL to call tenants databases. as we move towards some regions only using Replicas we can remove fully this logic and rely on the Replica modules to build said queries

fix: replicate pg_output issue (supabase#1625)

c41c4fe

If the string size matches the uuid length we were parsing it to be uuid which created issues. To prevent it we now handle payload based on the relations provided and we further simplified the logic to not use send in our message handling

feat: v2 user broadcast push metadata (supabase#1629)

25a40df

fix: no-op when presence track is issued with the same payload (supab…

118dfc5

…ase#1631)

chore: fix integration test expectation (supabase#1630)

6bd29b8

chore: fix test telemetry attaching to only expected tenant (supabase…

1cd0319

…#1635)

fix: improve crud remote calls (supabase#1633)

6830a19

This approach prevents sending more information than needed reducing the amount of data send via gen_rpc. We also remove some unnecessary calls to primary in the delete controller operation

fix: change ReplicationConnection to ignore unknown tables (supabase#…

ac87c47

…1639) Only realtime.messages should be processed

fix: gather connected metrics for all tenants (supabase#1637)

40bf817

feat: peep storage for PromEx (supabase#1636)

395a097

chore: use lifo on poolboy for tests (supabase#1640)

46f2f0c

Avoid using the same container over and over

chore: fix promex tenant plugin test timing issue (supabase#1641)

f081221

fix: measure traffic at the websocket level (supabase#1632)

f4cf403

fix: master region does not start read replica (supabase#1642)

72c339b

chore: run docker build on PRs (supabase#1644)

ffe5366

chore: add a link to the license badge on README.md (supabase#1647)

acd9ee5

fix: update nodejs to latest (supabase#1645)

8f664f7

chore: use RateCounterHelper.tick! to avoid waiting on tests (supabas…

e1acf33

…e#1650)

fix: use default storage for peep (supabase#1651)

03e2f71

fix: speed up tenant connected metrics (supabase#1652)

5eca638

fix: Repo.Replica returns main Repo if master region (supabase#1653)

2994d65

fix: improve metrics handling (supabase#1654)

6a1d77a

* Allow 3x more max heap size than other processes * Avoid compressing given that gen_rpc does this for us already * fix: remove limit_concurrent metric * fix: revert the way we fetched tenants to report on connected metric

fix: remove tenant tag on RPC metrics (supabase#1655)

4588af5

* fix: remove tenant tag on RPC metrics * chore: bump version

feat: add /metrics/:region endpoint (supabase#1656)

93ce90a

fix: stream metrics data (supabase#1658)

79da9b6

fix: coalesce wal data if not available on list_changes function (sup…

5817c10

…abase#1649)

semantic-release-bot and others added 30 commits April 16, 2026 22:04

chore(release): 2.84.0 [skip ci]

da218b7

chore: update @supabase/supabase-js to v2.103.3 (supabase#1817)

29a443d

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

feat: cache node load to avoid excessive RPC calls (supabase#1816)

d048c9e

chore(release): 2.85.0 [skip ci]

314d8ad

fix: validate track payload (supabase#1811)

668a635

fix: livedashboard recon & node info (supabase#1810)

83b0d30

chore(release): 2.85.1 [skip ci]

7214f17

fix: Connect query_connection_info to run outside of a transaction (s…

8f14ef7

…upabase#1820)

chore(release): 2.85.2 [skip ci]

7280558

chore(release): 2.86.0 [skip ci]

a3538e9

fix: Subscriptions.create transaction should timeout early (supabase#…

45f02a9

…1821)

chore(release): 2.86.1 [skip ci]

a736c2a

chore: update @supabase/supabase-js to v2.104.0 (supabase#1822)

514388f

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

fix: update db_connection to solve slow db pool termination (supabase…

b1dc321

…#1825)

chore(release): 2.86.2 [skip ci]

5653f54

chore: fix flaky test (supabase#1826)

3dc49e1

fix: properly match nil errors on user socket (supabase#1827)

69ef415

chore(release): 2.86.3 [skip ci]

4ab775b

chore: clean up unused code (supabase#1829)

ee76679

Used Elixir 1.20 type system to identify violations.

chore: update @supabase/supabase-js to v2.104.1 (supabase#1830)

5c5cdee

chore: add otel support to e2e tests (supabase#1756)

b8e126b

now we can setup otel to track performance of each test and have properly defined spans per test

feat: add sql inspector to live dashboard (supabase#1832)

6dfc8f6

chore(release): 2.87.0 [skip ci]

0e52610

feat: improve observability on tenant migrations (supabase#1833)

086d615

chore(release): 2.88.0 [skip ci]

a9c3cb9

fix: bump up plug cowboy (supabase#1835)

a514b05

chore(release): 2.88.1 [skip ci]

72915c9

chore: update @supabase/supabase-js to v2.105.0 (supabase#1834)

9fd2b2d

Co-authored-by: supabase-workflow-trigger[bot] <266661614+supabase-workflow-trigger[bot]@users.noreply.github.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

🔄 Sync with upstream changes#17

🔄 Sync with upstream changes#17
h0lybyte wants to merge 334 commits intomainfrom
upstream-main

h0lybyte commented Oct 13, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

11 participants

Conversation

h0lybyte commented Oct 13, 2025

Upstream Sync

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

11 participants