Skip to content

Old self-host VPS decommission, gated on validation sign-off #4334

Description

@JSONbored

Part of #4325.

Context

Per the epic's constraint, the old host is not decommissioned on a timer — only after the new host has been live with real traffic for a burn-in period and the validation criteria continue to hold under real (not shadow) load.

Requirements

  • A stated minimum burn-in period on real traffic before decommission is even considered (this issue should propose a number and reasoning, not leave it open-ended).
  • Final data-parity check (Postgres/Qdrant) immediately before decommission, in case any late write landed on the old host through an edge case in the cutover.
  • A last full backup of the old host's data taken and verified restorable before it's powered off, independent of whatever's already on the new host — a migration bug discovered later should not be an unrecoverable data-loss event.

Deliverables

  • Burn-in period proposed, agreed, and observed in full before this issue proceeds further
  • Final parity check confirms no data landed on the old host after cutover that's missing on the new one
  • Independent final backup taken and a restore of it test-verified
  • Old host decommissioned only after all of the above are checked off

Expected outcome

The old host is safely retired with zero data loss and a verified final backup, only once the new host has proven itself under real production load, not before.

Effort

S

Metadata

Metadata

Assignees

Labels

maintainer-onlyOwner-only work — yields no Gittensor points.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions