ClickHouse Backup - RSYNC #1314
karthik-thiyagarajan
started this conversation in
General
Replies: 1 comment 12 replies
-
|
try to use increment backup instead of full snapshot (look readme.md about upload --diff-from-remote or |
Beta Was this translation helpful? Give feedback.
12 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I've a primary cluster and passive clickhouse cluster and i wanted to do daily / hourly synch from primary to passive cluster.
In our use case, clickhouse-backup takes approximately 2.5 hours to take backup and 2 hours to do the restoration for a volume size of 900 Gi total. However, when i do the rsync it is much faster that it takes hardly 10 to 15 seconds for 5 GB (though i understand that there might be some inconsistencies for the ongoing operations).
However, simple rsynch is unable to have the clickhouse in the passive cluster detect the new table data, and the select table does not detect new tables or table data . Can you let me know how do i make this happen ?
Beta Was this translation helpful? Give feedback.
All reactions