Point-in-time Recovery
IBM Cloud® Databases for MySQL offers Point-In-Time Recovery (PITR) for any time in the last 7 days. The deployment continuously backs up incrementally and can replay transactions to bring a new deployment that is restored from a backup to any point in that 7-day window you need.
The Backups tab of your deployment's UI keeps all your PITR information under Point-in-Time recovery.
Included information is the earliest time for a PITR. To discover the earliest recovery point through the CLI, use the cdb mysql earliest-pitr-timestamp
command.
ibmcloud cdb mysql earliest-pitr-timestamp <deployment name or CRN>
To discover the earliest recovery point through the API, use the /deployments/{id}/point_in_time_recovery_data
endpoint to find the earliest PITR time.
{
"point_in_time_recovery_data": {
"earliest_point_in_time_recovery_time": "2019-09-09T23:16:00Z"
}
}
Recovery
Backups are restored to a new deployment. After the new deployment finishes provisioning, your data in the backup file is restored into the new deployment. Backups are also restorable across accounts, but only by using the API and only if the user that is running the restore has access to both the source and destination accounts.
By default the new deployment is auto-sized to the same disk and memory allocation as the source deployment at the time of the backup that you are restoring from. Especially in the case of PITR, that might not be the current size of your deployment. If you need to adjust the resources that are allocated to the new deployment, use the optional fields in the UI, CLI, or API to resize the new deployment. Be sure to allocate enough for your data and workload, if the deployment is not given enough resources the restore fails.
While storage and memory are restored to the same as the source deployment, specific instance configurations are not automatically set for the new instance. In this case, rerunning the configuration after a restore might be needed. Note any instance modifications before running the restore (parameters like shared_buffers, max_connections, deadlock_timeout, archive_timeout, and others) to ensure accurate setting for the instance after the restore is complete.
It is crucial that you do not delete the source deployment while the backup is restoring. Wait until the new deployment is provisioned and the backup is restored before deleting the old deployment. Deleting a deployment also deletes its backups, so not only will the restore fail, you might not be able to recover the backup either.
In the UI
To initiate a PITR, enter the time that you want to restore back to in Coordinated Universal Time. If you want to restore only to the most recent available time, select that option. Clicking Restore brings up the options for your recovery. Enter a name, select the version, region, and allocated resources for the new deployment. Click Recover to start the process.
If you use Key Protect and have a key, use the CLI to recover. A command is provided for your convenience.
In the CLI
The Resource Controller supports provisioning of database deployments, and provisioning and restoring are the responsibility of the Resource Controller CLI. Use the resource service-instance-create
command.
For PITR, use the point_in_time_recovery_time
and point_in_time_recovery_deployment_id
parameters. The point_in_time_recovery_deployment_id
is the source deployment's ID and point_in_time_recovery_time
is the timestamp in Coordinated Universal Time you want to restore to. If you want to restore to the latest available point-in-time use "point_in_time_recovery_time":" "
.
ibmcloud resource service-instance-create <SERVICE_INSTANCE_NAME> <service-id> <region> -p '{"point_in_time_recovery_deployment_id":"DEPLOYMENT_ID", "point_in_time_recovery_time":"TIMESTAMP"}'
A pre-formatted command for a specific backup or PITR is available in detailed view of the backup.
Optional parameters are available when restoring through the CLI. Use them if you need to customize resources, or use a Key Protect key for BYOK encryption on the new deployment.
ibmcloud resource service-instance-create <SERVICE_INSTANCE_NAME> <service-id> standard <region> <--service-endpoints SERVICE_ENDPOINTS_TYPE> -p
'{"point_in_time_recovery_deployment_id":"DEPLOYMENT_ID", "point_in_time_recovery_time":"TIMESTAMP","key_protect_key":"KEY_PROTECT_KEY_CRN", "members_disk_allocation_mb":"DESIRED_DISK_IN_MB", "members_memory_allocation_mb":"DESIRED_MEMORY_IN_MB", "members_cpu_allocation_count":"NUMBER_OF_CORES"}'
In the API
The resource controller supports provisioning of database deployments, and provisioning and restoring are the responsibility of the Resource Controller API. Complete the necessary steps to use the resource controller API before using it to restore from a backup.
Once you have all the information, the create request is a POST
to the /resource_instances
endpoint.
curl -X POST
https://resource-controller.cloud.ibm.com/v2/resource_instances
-H 'Authorization: Bearer <>'
-H 'Content-Type: application/json'
-d '{
"name": "<SERVICE_INSTANCE_NAME>",
"target": "<region>",
"resource_group": "<your-resource-group>",
"resource_plan_id": "<service-id>",
"parameters":{
"point_in_time_recovery_time":"<TIMESTAMP>",
"point_in_time_recovery_deployment_id":"<DEPLOYMENT_ID>"
}
}'
The parameters name
, target
, resource_group
, and resource_plan_id
are all required. The target
is the region where you want the new deployment to be located, which can be a different
region from the source deployment. Cross-region restores are supported, except for restoring a eu-de
backup to another region.
For PITR, use the point_in_time_recovery_time
and point_in_time_recovery_deployment_id
parameters. The point_in_time_recovery_deployment_id
is the source deployment's ID and point_in_time_recovery_time
is the timestamp in UTC you want to restore to. If you want to restore to the latest available point-in-time use "point_in_time_recovery_time":" "
.
If you need to adjust resources or use a Key Protect key, add the optional parameters key_protect_key
, members_disk_allocation_mb
, members_memory_allocation_mb
, and/or members_cpu_allocation_count
,
and their values to the body of the request.
Verifying PITR
To verify the correct recovery time, check the database logs. Checking the database logs requires the Logging Integration to be set up on your deployment.
When you perform a recovery, your data is restored from the most recent incremental backup. Any outstanding transactions from the WAL log are used to catch your database up to the time you recovered to. After the recovery is finished, and the transactions are run, the logs display a message. You can check that your logs have the message,
LOG: last completed transaction was at log time 2019-09-03 19:40:48.997696+00
There are two scenarios where recovery does not show up in the logs.
- Your deployment has a recent full backup and there is no activity after the backup was taken that needs to be replayed.
- If you entered a time to recover to that is after the current time or is past latest available point-in-time recovery point.
In both cases the recovery is usually still successful, but there won't be an entry in the logs to check the exact time that the database was restored to.