Number of Matches for ELO Rating System

Question

I am creating a system that will allow people to rate images.

My idea is to use the ELO rating system ( http://en.wikipedia.org/wiki/Elo_rating_system ) for each image, and then use crowdsourcing so that people say if an individual image is better than another, i.e.

Better than B

This will be used to update the ratings of ELO A and B, in the end I would rate all the images, presumably the best is worse.

For this I have two questions

• Is this the use of ELO correctly or should I look at a different rating scheme.

• If the ELO rating is correct and I have 100 images, how many “matches” do I need before I look confidently at the rating?

Answer 1

1 - Elo is a fairly simple and effective solution to this problem, you just need to use a different one if you have other requirements. I would definitely choose Elo.

2 - Listen, you can trust Elo, but if you don't run Matching, you won’t get an exact answer. “look confidently at the ranking” means for me “according to xx coinciding times the top winner (or whatever you name it) is XYZ so far”