You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Cloud SQL for SQL Server: --keep-encrypted BAK import fails on PITR-enabled instance (TDE cert sync)
Cloud SQL for SQL Server: --keep-encrypted BAK import fails on a PITR-enabled instance
If you import a TDE/encrypted .bak into Cloud SQL for SQL Server with --keep-encrypted and it
fails with either of these:
ERROR: (gcloud.sql.import.bak) [ERROR_SQL_SERVER_EXTERNAL_WARNING] Failed to fetch file list from bak,
Please ensure bak is unencrypted or the correct certificate is provided for encrypted backups:
%v with error mssql: RESTORE FILELIST is terminating abnormally.
Multi-AZ DB Cluster Binlog Persistence Solution using replica
Multi-AZ DB Cluster Binlog Persistence Solution
Problem Statement
Issue: AWS RDS Multi-AZ DB Clusters lose binlog files during maintenance operations (resizes, failovers, patches), causing CDC tools (DMS, Fivetran) to fail with Error 1236 "Could not find first log file name in binary log index file".
"If binary logs on the DB cluster exceed half of the total local storage space, Amazon RDS automatically moves stale logs to the EBS volume. However, the newest logs remain in local storage, so they're subject to be lost if there's a failure that requires a host replacement, or if you scale the database up or down."
The following steps show how to upgrade Cloud SQL PostgreSQL to a newer version using Google Cloud DMS. A few interesting observations that were made are:
You can write to the destination database, but the cloudsqlexternalsync user owns all objects. You must create users/roles and manually run grant statements to match the source.
During the promotion, the target database restarts.
The drop/create/grant statements ran during promotion [1] are here.
This screenshot shows grants after promotion [2]. They don't match the source instance. Here is a good blog post that talks about this [3].
In optimal settings, DMS creates two subscriptions per database (max of 10 subscriptions). The more subscriptions you have, the longer it can take to clean up during the promotion.
This screenshot [4] shows that I was able to insert data into the destination database after applying appropriate grants while the migration job was in the CDC phase.
Test sync_replication_slot to keep the logical replication running during a failover
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Transfer Data (CDC) from Cloud SQL (MySql) with Private IP to BigQuery using Datastream - Demo
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Example script on how to use Cloud Monitoring Metric Service Client in python.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Install Percona Toolkit and Export Mysql Table in CSV Format
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Connect to a Cloud SQL instance using Private Service Connect
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters