Maintenance
Maintenance here refers to anything involving taking your validator temporarily out of the network (to apply security patches, system upgrade, etc).
As an administrator of a validator, you must ensure that the maintenance you are about to apply to the validator is safe for the overall network and for your validator.
Safe means that the other validators that depend on yours will not be affected too much when you turn off your validator for maintenance and that your validator will continue to operate as part of the network when it comes back up.
If you are changing some settings that may impact network wide settings such as protocol version, review the network upgrades page.
If you're changing your quorum set configuration, also read the section on what to do.
Recommended Steps to Perform as Part of a Maintenance
We recommend performing the following steps in order (repeat sequentially as needed if you run multiple nodes).
- Advertise your intention to others that may depend on you. Some coordination is required to avoid situations where too many nodes go down at the same time.
- Dependencies should assess the health of their quorum
- If there is no objection, take your instance down
- When done, start your instance that should rejoin the network
- The instance will be completely caught up when it's both
Synced
and there is no backlog in uploading history.
Special Considerations During Quorum Set Updates
When you join the ranks of node operators, it's also important to join the conversation. The best way to do that: follow the#validators
channel on the Stellar Developer Discord. If you can't do that for some reason, sign up for the Stellar Validators Google Group.
Sometimes an organization needs to make changes that will impact the quorum sets of others:
- taking a validator down for long period of time
- adding new validators to their pool
In both cases, it's crucial to stage the changes to preserve quorum intersection and general good health of the network:
- Be careful about removing too many nodes from your quorum set before the nodes are taken down. If different people remove different sets the remaining sets may not overlap between nodes and may cause network splits.
- Watch out for adding too many nodes in your quorum set at the same time. If not done carefully, this can cause those nodes to overpower your configuration.
Recommended steps are for the entity that adds/removes nodes to do so first between their own nodes, and then have people reflect those changes gradually (over several rounds) in their respective quorum configurations.