I have db.r3.2xlarge with 4000 PIOPS. I insert 1 billion rows from EC2 instances. There are 40 GB of free memory right now.
Currently, out of 4000 PIOPS, READ PIOPS accepts 3000, and I only get 1000 WRITE PIOPS. So it was a low record.
How can I check what READ PIOPS does? And how to speed up the work?
Thanks.
Edit:
insert ignore into dna (hash, time, song_id) values (b%s, b%s, %s)
I'm using self.cursor.executemany(query, rows) from python
hash + time + song_id is a composite primary key.
I am using AWS RDS InnoDB.
I have 4000 PIOPS. However, he is now stuck at 2000 points. I have 60 MB / s WRITE THROUGH.
source
share