All Questions
Tagged with database-replication amazon-web-services
69 questions
0
votes
1
answer
166
views
Is Amazon Aurora RDS replication synchronous or asynchronous
We are using Amazon Aurora RDS with Postgres. We have Multi AZ deployment, with two instances, 1 writer and 1 reader replica. Now the question is, if the synchronization is synchronous or asynchronous ...
- 14.3k
0
votes
1
answer
900
views
AWS DMS Task Migration Mapping Rules - Add-Column using metadata
I need to create a new column for each record that DMS processes, right now I have the following mapping rule:
{
"rule-type": "transformation",
"rule-id": &...
- 3,576
0
votes
2
answers
325
views
Real time replication from on premises Oracle to AWS
Is there any service offering from AWS, that does real time replication of data from Oracle which is on premises to Oracle instance running on EC2 in AWS ? But the catch is, the table structures are ...
- 359
0
votes
1
answer
601
views
How to create RDS read replica in public subnet of my RDS which is in private subnet?
I have at RDS which is Aurora PostgreSQL and in private subnet with no to publically accessible.
Now I want to create its read replica in public subnet in same region or in cross region.
I tried to ...
- 21
0
votes
0
answers
369
views
AWS RDS replica is stuck in Connecting state
I have made some changes to my RDS Instance and now my replica is stuck in connecting state.
- 149
1
vote
0
answers
352
views
Create read replica with only specified list of tables
I have a MySQL instance (running on the latest version of the 5.7 engine) and I would like to create a read replica from it in the same region (if not possible, other regions might work as well) but ...
- 245
1
vote
1
answer
873
views
pause replication on AWS RDS
My python script requires replication on the master DB to be stopped for a while to perform all PostgreSQL operations like truncating tables, adding new values to them, and updating the tables as well,...
- 159
0
votes
1
answer
891
views
RDS MySQL to DMS CDC fails after running for some time
I'm having trouble with my AWS DMS setup.
The RDS used as source is MySQL. I have enabled the binlogging, set the retention to 168 and set innodb_flush_log_at_trx_commit to 1.
I have a DMS replication ...
- 157
0
votes
2
answers
1k
views
AWS replication failure - could not access file "pglogical"
After 2 months running without problems, my AWS DMS task failed with the following error:
Last failure message
Last Error Stream Component Fatal error. Task error notification received from subtask 0, ...
1
vote
1
answer
684
views
RDS PostgreSQL read replica considerations
I have a database that is maxing out on CPU. I would like to spin up a read replica so that my services use the replica to read and that removes some of the pressure of the master db.
If the cpu of ...
1
vote
2
answers
1k
views
DynamoDB single-active cross region replication
I'm trying to understand DynamoDB replication & failover strategies but do not find any articles on the web which clarifies them. I understand cross-region replication can be achieved by DynamoDB ...
- 553
2
votes
0
answers
329
views
AWS DMS replication instance and target endpoint test connection failed
I am trying to start a replication task but for that I need the test connection to work between the target endpoint (S3) and the replication instance. Here's the error:
Test Endpoint failed: ...
0
votes
1
answer
767
views
AWS Aurora replication - is that possible to lose data? [closed]
I'm confused about AWS Aurora (mostly MySQL interests me).
I know that Aurora separates the storage layer from the compute layer, but this is what makes me dizzy.
From the documentation it appears ...
- 159
0
votes
0
answers
423
views
Creating a RDS PostgreSQL slave in different account on same region
I have a master RDS postgreSQL in one account and I would like to create a slave in a different account and replication enabled(either sync or async), both master-slave can be in different AZ, but on ...
- 57
1
vote
0
answers
541
views
AWS DMS Task failed with error: Error executing source loop; Stream component failed at subtask
I want to migrate my PostgresDB hosted in cloud service to S3. I am using AWS DMS service. it ran fine for a few days now I'm getting below error
load type: Full load, ongoing replication
Error:
...
0
votes
0
answers
199
views
S3 CRR for entire bucket except objects with certain prefix
I am trying to set some replication rules for my S3 bucket in a way that it replicates all the objects in the bucket to another bucket in a different region, EXCEPT objects starting with a certain ...
- 68
0
votes
1
answer
1k
views
Do AWS RDS cross-region read replicas also replicate users and roles?
I have a Postgres DB set up on AWS in region X and a read replica of that DB in region Y.
I'm about to perform 2 action in my source DB in region X:
Change the password of one of the users (ALTER ...
- 53
0
votes
0
answers
48
views
Intra-RDS Database communications setup on common VPC and security groups
I have a production database plus a new database that I stood up on AWS. Both are Postgres. I wanted to use replication to copy a table from production into the new database. I did an nslookup to get ...
- 6,437
1
vote
1
answer
381
views
Is it normal to lose 30 minutes of data on a SQL Server crash?
We have worked with Oracle for a number of years and we now need to develop a new application using SQL Server in AWS for the first time.
What surprised us, is that the new SQL Server DBA told us off ...
- 988
0
votes
1
answer
212
views
AWS DMS for MySQL Aurora
I am trying to replicate MySQL Aurora database to another MySQL Aurora. Always its creating the database with the same name as source. Is there any way to specify the target DB name? Mean, I want to ...
1
vote
1
answer
1k
views
Update Amazon RDS for MySQL database instance
How to apply a new operating system (OS) update with critical security fixes update for Amazon RDS for MySQL database instance with little/no downtime?
In my case, I have the following database with ...
2
votes
2
answers
1k
views
AWS RDS bidirectional replication
I'm researching about AWS RDS bidirectional replication. I know that RDS has the read replica, but I need the bidirectional replication for disaster recovery.
Would anyone have the experience with ...
- 135
2
votes
1
answer
1k
views
AWS RDS MySQL replication from 5.6 to 5.7 during the upgrade process
Context
Hi all,
we are about to upgrade our AWS RDS MySQL instance from MySQL 5.6 to MySQL 5.7.
To do so, we are planning to go through the following steps
Create a read replica of the primary ...
0
votes
1
answer
739
views
Does Amazon DMS support replicating one table from a schema to a different schema of the same table?
I'm trying to setup replication between two MySQL RDS instances for one table only. I would like to replicate for example, schema1.users to schema2.users.
Under Mapping rules, I'm able to specify the ...
- 736
0
votes
2
answers
228
views
Data Replication from Amazon RDS for MySQL to Amazon Aurora for PostgreSQL
We need to replicate data from an Amazon RDS (MySQL) databaes to an Aurora PostgreSQL database. Each database is on a different AWS account and region.
The data must be replicated in the PostgreSQL ...
2
votes
2
answers
1k
views
Is it possible to create a multi source read replica in RDS
We use RDS MySQL with a micro service architecture. Each service has its own database and we have been slowly moving them into their own instances for load management and whatnot.
We have a replica ...
- 653
1
vote
1
answer
673
views
Are cascading replicas still a thing for RDS MySQL?
I can find traces on the internet that this was an option a while back, at least for MySQL 5.7 (for example: https://aws.amazon.com/rds/faqs/ still says: Amazon Aurora, Amazon RDS for MySQL and ...
- 41
0
votes
1
answer
136
views
Unexpected behavior of RDS snapshots in a replication array with an external master
RDS Snapshots don't seem to work as I would expect when set up with replication. I'd like to get some guidance on if I'm making incorrect assumptions, or just doing something wrong.
Here's what ...
- 45
1
vote
1
answer
555
views
How to make AWS aurora Mysql into a writable instance
I am working on a project where we are creating a new region for resilience purpose.
As we create a new Region for the project, we also plan to create a Read replica of Aurora MySQL DB.
My question ...
- 367
0
votes
2
answers
1k
views
Does AWS RDS support two way replication with local MySQL database?
I would like to sync the local MySQL database to Amazon RDS MySQL database. I found a solution for EC2 to RDS but not for Local Database to RDS.
I built a database including 12 tables which all I ...
- 163
5
votes
2
answers
5k
views
Is there a RDS aurora synchronous read replica?
If I understand correctly, Amazon Aurora has asynchronous read replica. So, we can get some read lag (it seems, lag is about 100 ms).
I need synchronous read replica. So, can I set such type of ...
- 1,903
1
vote
1
answer
985
views
Why MySQL database replica does not replicate when replica has bigint key and master has int key?
I try to change the primary key size or another field from int to bigint.
MySQL manual tells me that this type of convert is available (from int to bigint), but my replica gets an error:
Column 1 ...
- 90
11
votes
4
answers
13k
views
Does AWS load-balance connections between master and read-replica DB
I created a read-replica for an RDS instance, Does AWS handles the load-balancing automatically or it needs another configuration or implementation in the code ? and if so Is there a reference for ...
- 385
0
votes
0
answers
233
views
How can I replicate data into from one RDS instance to another without using Multi-az?
I have my production Mysql Aurora RDS instance with no Multi-AZ option enabled.I have a requirement to replicate this production data into another isolated Mysql RDS instance(or perhaps another Mysql ...
-2
votes
2
answers
536
views
How to replicate Production MSSQL DB into Test db on a daily basis
I'm using RDS SQL Server database for my live environment.
I'd need to fully replicate the database into another RDS database on a fixed frecuency (maybe daily). The goal is to have test environment ...
0
votes
1
answer
496
views
Procedure call not working via ProxySql, error MySql.Data.MySqlClient.MySqlException (0x80004005): Table 'mysql.proc' doesn't exist
I have two RDS instances for mysql, 1 master node and 1 replication slave node. I have setup a ProxySql EC2 instance listening on 6033 port which routes all the write requests to master node and all ...
- 573
2
votes
1
answer
5k
views
AWS RDS Postgresql Transaction logs keep going when there is no data change?
You can have see these problem
https://www.reddit.com/r/aws/comments/7snob5/postgresql_transaction_logs_fill_up_storage_till/
https://dba.stackexchange.com/questions/173267/aws-rds-postgres-logical-...
- 1,456
0
votes
1
answer
61
views
Will PDO's LastInsertID Break AWS Replication?
Does the PDO lastinsertid function use MySQL's last_insert_id function?
I'm particularly interested in replication with AWS and per the AWS manual using some MySQL functions break replication:
...
- 5,224
0
votes
2
answers
458
views
Is it possible to leave an Amazon Aurora DB cluster as a replica from Amazon RDS (intermediate master)?
I wanted to create in Amazon RDS the following topology: master -> slave -> slave. But this topology isn't possible in Amazon RDS. I'll appreciate if somebody can explain if I'll be able to create ...
0
votes
2
answers
750
views
Replicate Data Regularly from AWS RDS (MySQL) to another Server (EC2 instance)
We have a large AWS RDS(MySQL) Instance and we need to replicate data from it to another Ec2 Instance, daily at a certain time for reporting and analysis purpose.
currently we are using mysqldump to ...
- 126
1
vote
1
answer
1k
views
How to configure MySQL read replica in RDS from Slave server
We have a working MySQL Master-Slave replication in our Data center. We need to configure one read replica in AWS RDS from my slave server. How can I achieve this? I need the configuration like the ...
- 111
0
votes
1
answer
95
views
can we replicate Cross Region Replication (CRR) across more than 2 regions?
Cross Region Replication is one of the 2017 updates for DynamoDB.To experience with it, I used AWS Management Console to replicate my database once. Just wondered if anybody knows how to replicate it ...
- 192
0
votes
1
answer
281
views
How does AWS RDS replication handle curdate() and other date-sensitive commands?
It looks as if AWS handles RDS MySQL replication by executing the same commands on the replicas that were executed on the master. However, our replicas are currently lagging by about 24 hours due to ...
- 3,478
0
votes
0
answers
1k
views
Amazon RDS: Automatically Changing Replication Role During Import
I created an RDS instance on AWS (Aurora MySQL with replication). When I start importing an SQL file into the database I get an error message ERROR 2013 (HY000) at line 2805: Lost connection to MySQL ...
- 538
0
votes
1
answer
74
views
Updating a migrated percona database to aurora
I've successfully copied data over the period of four hours from an external percona mysql database to an AWS Aurora cluster. Is it possible to configure the AWS Aurora database as a slave to avoid ...
- 3,197
0
votes
0
answers
372
views
Can I replicate a database to different regions for read AND write access & synchronize?
We plan to have users all over the world who will access our web application. But our database is located in US-West. We want the same database in Mumbai. We did create a read-replica, but it's ...
- 4,690
1
vote
2
answers
2k
views
Slave isn't writing any data into the table in mysql master slave replication
I am having a difficult time in setting Master-Slave configuration.
Master Database runs on Ubuntu( Amazon AWS instance) and successfully set-up master replication.
I have localhost as a Slave ...
- 1,285
2
votes
1
answer
150
views
how to setup and test if a location is using the closest rds read replica? aws
I am currently learning how rds replica works in aws.
I got everything setup and now I have a postgres rds instance in the origin of oregon which is the original rds instance. Then I created one ...
- 2,198
0
votes
2
answers
898
views
Replica - MongoDB EC2 instances
Added 3 EC2 instances in in AWS cloud.
Installed 3 MongoDB instances in 3 different instances and all are running fine.
I am adding replication for the same DBs.
below are the steps i followed:
...
- 1,620
2
votes
1
answer
6k
views
AWS DMS Streaming replication : Logical Decoding Output Plugins(test_decoding) not accessible
I'm trying to migrate a PostgreSQL DB persisted on cloud (on DO droplet) to RDS using AWS Database Migration Service (DMS).
I've successfully configured the replication instance and endpoints.
I've ...
