mariadb backup and recovery

Registered by bjolo

Loosing the database means loosing the entire cloud. The setup that kolla offers today with multiple galera nodes offers HA, but it is not a backup solution since a corruption or data deletion would be synced to all databases. It can be argued that operator backup strategies is out of scope for kolla, but kolla should at least provide some mechanizms for operators to backup and restore the database.

Suggested Requirements:
- should support full and incremental backup of all databases
- should support full and incremental backup of individual databases. e.g. only keystone
- should support restore of all databases
- should support restore of individual databases e.g. only keystone

There are several ways that backups can be done on galera, and this bp does not suggest one in particular, but rather attempts to spur a creative brainstorm discussion around this.

Some ways of doing it. Solution could also be a combination of these (or others)
- docker volume snapshots
- mariadb slave async replication.
- mysqldumps
- xtrabackup
- Galera State snapshot transfers

some links
http://galeracluster.com/documentation-webpages/backingupthecluster.html?highlight=backup
http://severalnines.com/blog/full-restore-mysql-galera-cluster-backup
http://severalnines.com/blog/deploy-asynchronous-replication-slave-mariadb-galera-cluster-gtid-clustercontrol

Blueprint information

Status:
Complete
Approver:
None
Priority:
Medium
Drafter:
bjolo
Direction:
Approved
Assignee:
Nick Jones
Definition:
Approved
Series goal:
Accepted for stein
Implementation:
Implemented
Milestone target:
milestone icon 8.0.0
Started by
Mark Goddard
Completed by
Mark Goddard

Related branches

Sprints

Whiteboard

Discussed briefly in Denver. Agreed it is something we'd like to see, we just need the know how to make it happen (pbourke)

Discussed further at the Rocky PTG in Dublin: https://etherpad.openstack.org/p/kolla-rocky-ptg-db-backup-restore

Some progress made on a POC (yankcrime)

Gerrit topic: https://review.openstack.org/#q,topic:bp/database-backup-recovery,n,z

Addressed by: https://review.openstack.org/607581
    [WIP] Introduce Percona XtraBackup image

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.