System keyspaces restored when restoring non system keyspace/table

[chrisjmiller1]

Project board link

Hi,

When completing a partial restore of a non system keyspace/table medusa 0.22.3 restores system keyspaces as follows.

Restore command:
medusa restore-cluster --backup-name backup6 --keyspace test --table backup_run --parallel-restores 3

Restore logs from medusa.log:
imail1@mxiad-tfdevmet02 /tmp/medusa-job-ae094dd4-a0b5-425b-b8f5-e7baa9c0f086 $ grep Restoring medusa.log [2024-11-26 10:56:41,507] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/available_ranges_v2-4224a0882ac93d0c889dfbb5f0facda0 -> /data/metadata/data/system/available_ranges_v2-4224a0882ac93d0c889dfbb5f0facda0 [2024-11-26 10:56:41,549] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/local-7ad54392bcdd35a684174e047860b377 -> /data/metadata/data/system/local-7ad54392bcdd35a684174e047860b377 [2024-11-26 10:56:41,587] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e -> /data/metadata/data/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e [2024-11-26 10:56:41,728] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/size_estimates-618f817b005f3678b8a453f3930b8e86 -> /data/metadata/data/system/size_estimates-618f817b005f3678b8a453f3930b8e86 [2024-11-26 10:56:41,766] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/table_estimates-176c39cdb93d33a5a2188eb06a56f66e -> /data/metadata/data/system/table_estimates-176c39cdb93d33a5a2188eb06a56f66e [2024-11-26 10:56:41,806] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca -> /data/metadata/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca [2024-11-26 10:56:41,847] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288 -> /data/metadata/data/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288 [2024-11-26 10:56:41,886] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/peers-37f71aca7dc2383ba70672528af04d4f -> /data/metadata/data/system/peers-37f71aca7dc2383ba70672528af04d4f [2024-11-26 10:56:42,003] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e -> /data/metadata/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e [2024-11-26 10:56:42,045] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895 -> /data/metadata/data/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895 [2024-11-26 10:56:42,087] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/indexes-0feb57ac311f382fba6d9024d305702f -> /data/metadata/data/system_schema/indexes-0feb57ac311f382fba6d9024d305702f [2024-11-26 10:56:42,130] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6 -> /data/metadata/data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6 [2024-11-26 10:56:42,174] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09 -> /data/metadata/data/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09 [2024-11-26 10:56:42,218] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f -> /data/metadata/data/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f [2024-11-26 10:56:42,261] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/triggers-4df70b666b05325195a132b54005fd48 -> /data/metadata/data/system_schema/triggers-4df70b666b05325195a132b54005fd48 [2024-11-26 10:56:42,303] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f -> /data/metadata/data/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f [2024-11-26 10:56:42,347] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/views-9786ac1cdd583201a7cdad556410c985 -> /data/metadata/data/system_schema/views-9786ac1cdd583201a7cdad556410c985 [2024-11-26 10:56:42,390] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/types-5a8b1ca866023f77a0459273d308917a -> /data/metadata/data/system_schema/types-5a8b1ca866023f77a0459273d308917a [2024-11-26 10:56:42,432] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_schema/functions-96489b7980be3e14a70166a0b9159450 -> /data/metadata/data/system_schema/functions-96489b7980be3e14a70166a0b9159450 [2024-11-26 10:56:42,477] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_auth/resource_role_permissons_index-5f2fbdad91f13946bd25d5da3a5c35ec -> /data/metadata/data/system_auth/resource_role_permissons_index-5f2fbdad91f13946bd25d5da3a5c35ec [2024-11-26 10:56:42,520] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_auth/roles-5bc52802de2535edaeab188eecebb090 -> /data/metadata/data/system_auth/roles-5bc52802de2535edaeab188eecebb090 [2024-11-26 10:56:42,602] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14 -> /data/metadata/data/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14 [2024-11-26 10:56:42,645] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627 -> /data/metadata/data/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627 [2024-11-26 10:56:42,714] DEBUG: Restoring /tmp/medusa-restore-f71bbbdd-dec9-4771-9e69-5ff07c32c0de/test/backup_run-486257d07f3a11efb60d75f6d577c6a5 -> /data/metadata/data/test/backup_run-486257d07f3a11efb60d75f6d577c6a5

Sample restored files with same timestamp as restore:
`sstable_activity-5a1ff267ace03f128563cfae6103c65e:
total 108
-rw-r--r-- 1 imail1 imail1 1476 Nov 26 10:56 nb-191-big-Index.db
-rw-r--r-- 1 imail1 imail1 56 Nov 26 10:56 nb-191-big-Filter.db
-rw-r--r-- 1 imail1 imail1 5071 Nov 26 10:56 nb-191-big-Statistics.db
-rw-r--r-- 1 imail1 imail1 185 Nov 26 10:56 nb-191-big-Summary.db
-rw-r--r-- 1 imail1 imail1 777 Nov 26 10:56 nb-191-big-Data.db
-rw-r--r-- 1 imail1 imail1 47 Nov 26 10:56 nb-191-big-CompressionInfo.db
-rw-r--r-- 1 imail1 imail1 92 Nov 26 10:56 nb-191-big-TOC.txt
-rw-r--r-- 1 imail1 imail1 10 Nov 26 10:56 nb-191-big-Digest.crc32
-rw-r--r-- 1 imail1 imail1 48 Nov 26 10:56 nb-190-big-Filter.db
-rw-r--r-- 1 imail1 imail1 1186 Nov 26 10:56 nb-190-big-Index.db
-rw-r--r-- 1 imail1 imail1 5031 Nov 26 10:56 nb-190-big-Statistics.db
-rw-r--r-- 1 imail1 imail1 206 Nov 26 10:56 nb-190-big-Summary.db
-rw-r--r-- 1 imail1 imail1 624 Nov 26 10:56 nb-190-big-Data.db
-rw-r--r-- 1 imail1 imail1 47 Nov 26 10:56 nb-190-big-CompressionInfo.db
-rw-r--r-- 1 imail1 imail1 10 Nov 26 10:56 nb-190-big-Digest.crc32
-rw-r--r-- 1 imail1 imail1 92 Nov 26 10:56 nb-190-big-TOC.txt
-rw-r--r-- 1 imail1 imail1 48 Nov 26 10:56 nb-189-big-Filter.db
-rw-r--r-- 1 imail1 imail1 546 Nov 26 10:56 nb-189-big-Index.db
-rw-r--r-- 1 imail1 imail1 5129 Nov 26 10:56 nb-189-big-Statistics.db
-rw-r--r-- 1 imail1 imail1 206 Nov 26 10:56 nb-189-big-Summary.db
-rw-r--r-- 1 imail1 imail1 389 Nov 26 10:56 nb-189-big-Data.db
-rw-r--r-- 1 imail1 imail1 55 Nov 26 10:56 nb-189-big-CompressionInfo.db
-rw-r--r-- 1 imail1 imail1 10 Nov 26 10:56 nb-189-big-Digest.crc32
-rw-r--r-- 1 imail1 imail1 92 Nov 26 10:56 nb-189-big-TOC.txt

size_estimates-618f817b005f3678b8a453f3930b8e86:
total 36
-rw-r--r-- 1 imail1 imail1 165 Nov 26 10:56 nb-188-big-Index.db
-rw-r--r-- 1 imail1 imail1 32 Nov 26 10:56 nb-188-big-Filter.db
-rw-r--r-- 1 imail1 imail1 4995 Nov 26 10:56 nb-188-big-Statistics.db
-rw-r--r-- 1 imail1 imail1 65 Nov 26 10:56 nb-188-big-Summary.db
-rw-r--r-- 1 imail1 imail1 3901 Nov 26 10:56 nb-188-big-Data.db
-rw-r--r-- 1 imail1 imail1 55 Nov 26 10:56 nb-188-big-CompressionInfo.db
-rw-r--r-- 1 imail1 imail1 92 Nov 26 10:56 nb-188-big-TOC.txt
-rw-r--r-- 1 imail1 imail1 10 Nov 26 10:56 nb-188-big-Digest.crc32
`

Regards,

Chris

┆Issue is synchronized with this Jira Story by Unito
┆Issue Number: MED-108