Why is AWS RDS MYSQL INSERT using READ IOPS?

I have db.r3.2xlarge with 4000 PIOPS. I insert 1 billion rows from EC2 instances. There are 40 GB of free memory right now.

Currently, out of 4000 PIOPS, READ PIOPS accepts 3000, and I only get 1000 WRITE PIOPS. So it was a low record.

How can I check what READ PIOPS does? And how to speed up the work?

Thanks.

Edit:

insert ignore into dna (hash, time, song_id) values (b%s, b%s, %s)

I'm using self.cursor.executemany(query, rows) from python

hash + time + song_id is a composite primary key.

I am using AWS RDS InnoDB.

I have 4000 PIOPS. However, he is now stuck at 2000 points. I have 60 MB / s WRITE THROUGH.

+4
source share
1 answer

, / .

, INSERT IGNORE, , , , .

InnoDB , (-) / , , , , , .

, , , , , .

hash , , , - .

+2

Source: https://habr.com/ru/post/1624111/


All Articles