Page MenuHomePhabricator

Expand Phacility cluster repo and db tiers (add nodes: 003)
Closed, ResolvedPublic

Description

The current pool is getting reasonably full so I'm going to add new nodes after the upgrade. See T8686 for prior maintenance.

Event Timeline

epriestley raised the priority of this task from to Normal.
epriestley updated the task description. (Show Details)
epriestley added projects: Phacility, Ops.
epriestley added a subscriber: epriestley.
  • I launched repo003 and db003 in the cluster.
  • I created .phacility.net DNS entires for the hosts.
  • I created ddata, dbak, rdata, rbak, and rlog volumes for the hosts and attached them.
  • I created device entries for the hosts and *bak volumes.
  • I created service entries for the new repox and dbx services.
  • I used bin/remote deploy to deploy the hosts.

This time around, this all went smoothly. It still involves a fair amount of manual button clicking which I want to get rid of eventually, but no process issues.

epriestley claimed this task.
  • I closed the 002 services and opened the 003 services.
  • I created a new instance, verified it allocated on 003, connected to it, pushed/pulled, ran backups, etc.

Overall, lots of room left for automation, but this process seems stable and repeatable now.