This test is possible because the Coollector ratings convert perfectly into Criticker ratings (and vice-versa): 100 excellent+ 95 excellent 90 excellent- 85 very good+ 80 very good 75 very good- 70 good+ 65 good 60 good- 55 neutral+ 50 neutral 45 neutral- 40 bad+ 35 bad 30 bad- 25 very bad+ 20 very bad 15 very bad- 10 awful+ 5 awful 0 awful- I've picked some Criticker users at random and I've quickly found one who used the exact same rating scale as above. It was the user named ejcon: https://www.criticker.com/rankings/ejcon/ Then with a brand new account on Criticker and a brand new coollection on Coollector, I've applied the ejcon's ratings for the 5 first movies of each rating levels: 100 Die Hard The Godfather The Lion King Pulp Fiction The Shawshank Redemption 95 Adaptation. Anchorman: The Legend of Ron Burg Back to the Future Eternal Sunshine of the Spotless Mind The Godfather: Part II 90 3:10 to Yuma (2007) The 40-Year-Old Virgin Alien American History X American Psycho 85 300 Adventureland American Pie The Assassination of Jesse James The Avengers 80 127 Hours 21 Jump Street 48 Hrs. 50/50 8 Mile 75 101 Dalmatians Ace Ventura: When Nature Calls Airplane! Aladdin: The Return of Jafar The Amazing Spider-Man 70 50 First Dates Along Came Polly Alpha Dog American Gangster American Reunion 65 101 Dalmatians Alice in Wonderland Animal House Austin Powers in Goldmember Avatar 60 30 Minutes or Less Ali G Indahouse Big Fat Liar Couples Retreat Crossroads 55 Envy) Fantastic Four: Rise of the Silver Surfer Freaky Friday Fright Night Hancock When came the bad movies, I've only rated one per level. This was mostly to show to the Criticker system that I'm using a scale from 0 to 100: 50 Alice in Wonderland 45 Analyze That 40 2012 35 Batman Returns 30 10,000 B.C. 25 Chicken Little 20 88 Minutes 15 Catwoman 10 Deuce Bigalow: European Gigolo 5 Date Movie *********************** Because the user ejcon have rated much more movies, I can now compare the real ratings of ejcon with the predictions of Coollector and Criticker. Here are the results, they express the difference between ejcon's ratings and the predictions (the smallest the difference, the better). For example the first result is: Goodfellas 5 - 0 It means that Criticker made an error of 5, predicting 95 instead of 100, while Coollector made an error of 0, correctly predicting 100. Goodfellas 5 - 0 Monty Python and the Holy Grail 6 - 55 Reservoir Dogs 9 - 0 The Silence of the Lambs 0 - 0 Borat 15 - 10 Bronson 10 - 15 The Dark Knight 10 - 10 The Departed 5 - 5 Dumb and Dumber 30 - 10 Finding Nemo 10 - 0 The Green Mile 2 - 5 Hercules 25 - 10 In Bruges 4 - 5 Inglourious Basterds 5 - 5 Misery 10 - 5 The Outsiders 15 - 10 Red Dragon 20 - 10 Scarface 5 - 5 Shaun of the Dead 10 - 5 Tarzan 20 - 10 To Kill a Mockingbird 1 - 5 Up 10 - 0 The Usual Suspects 10 - 5 Back to the Future 10 - 15 Drive 5 - 0 The Fox and the Hound 10- 5 Glengarry Glen Ross 5 - 0 The Hangover 10 - 0 Lady and the Tramp 15 - 10 Office Space 2 - 0 Rango 10 - 10 Seven Psychopaths 10 - 10 Shrek 5 - 5 Taxi Driver 15 - 10 WALL·E 1 - 5 Ace Ventura: Pet Detective 10 - 0 Aladdin 5 - 10 American Pie 2 25 - 10 Austin Powers: The Spy Who Shagged Me 21 - 15 Austin Powers: International Man of Mystery 10 - 5 A Bug's Life 5 - 0 Cast Away 5 - 5 Dances with Wolves 6 - 5 Ferris Bueller's Day Off 0 - 0 The Godfather: Part III 5 - 5 Harold and Kumar Go to White Castle 10 - 0 Idiocracy 10 - 40 Jurassic Park 5 - 10 Men in Black 10 - 0 Mulan 10 - 0 The Next Three Days 10 - 0 O Brother, Where Art Thou 9 - 5 Primal Fear 0 - 5 Shrek 2 10 - 5 Superbad 5 - 0 Wayne's World 15 - 5 The Wizard of Oz 0 - 5 Antz 10 - 0 The AristoCats 0 - 0 Billy Madison 10 - 5 Bowling for Columbine 5 - 10 Charlie and the Chocolate Factory 10 - 5 Crash 10 - 0 Hannibal 10 - 0 I, Robot 10 - 5 The Jungle Book 5 - 5 Looper 0 - 10 The Lord of the Rings: The Fellowship of the Ring 20 - 20 The Lord of the Rings: The Two Towers 14 - 20 The Lord of the Rings: The Return of the King 12 - 20 Madagascar 10 - 0 Pocahontas 5 - 5 Robin Hood 5 - 5 The Simpsons Movie 10 - 5 Total: 667 - 500 (Criticker 667, Coollector 500) Biggest errors: Hercules 25 - 10 Dumb and Dumber 30 - 10 Idiocracy 10 - 40 Monty Python and the Holy Grail 6 - 55 Coollector seriously missed with the last 2 movies and was heavily penalized for it. *************************** Then I've followed the test by adding more ratings to have more predictions 100 The Social Network 95 Goodfellas Groundhog Day The Master Memento Monty Python and the Holy Grail 90 Batman Beyond: Return of the Joker Batman: Mask of the Phantasm Beauty and the Beast Borat Brokeback Mountain 85 Back to the Future Part II Bambi Batman Begins Beverly Hills Cop Big 80 Ace Ventura: Pet Detective Aladdin All Dogs Go to Heaven American Beauty American Pie 2 75 Antz The AristoCats As Good As It Gets Baseketball Batman 70 Analyze This Anger Management Back to the Future Part III Bad Boys Batman: Gotham Knight 65 Batman Forever Beethoven The Bucket List Cars The Chronicles of Narnia: The Lion, the Witch and the Wardrobe 60 Daredevil Date Night Disturbia Due Date Earth Girls Are Easy 55 Harry Potter and the Deathly Hallows: Part 1 Harry Potter and the Goblet of Fire Harry Potter and the Half-Blood Prince Harry Potter and the Order of the Phoenix Holy Man ************** Results Reservoir Dogs 5 - 0 Seven 0 - 0 The Silence of the Lambs 0 - 0 South Park: Bigger, Longer, and Uncut 0 - 10 Bronson 8 - 15 The Dark Knight 5 - 10 The Departed 5 - 5 Dumb and Dumber 15 - 10 Elf 25 - 15 Finding Nemo 0 - 5 Forgetting Sarah Marshall 10 - 15 Forrest Gump 0 - 0 Ghostbusters 5 - 10 The Green Mile 5 - 5 Hercules 25 - 10 In Bruges 5 - 5 Inglourious Basterds 5 - 5 Knocked Up 15 - 15 Life of Brian 5 - 5 Man on the Moon 7 - 10 Misery 10 - 5 Old School 15 - 15 The Outsiders 15 - 10 Red Dragon 20 - 10 Scarface 6 - 5 Shaun of the Dead 6 - 5 Silver Linings Playbook 15 - 5 Tarzan 20 - 10 Titanic 25 - 10 To Kill a Mockingbird 0 - 5 Toy Story 5 - 5 Toy Story 3 0 - 0 The Truman Show 5 - 5 Up 0 - 0 The Usual Suspects 0 - 5 The Big Lebowski 15 - 0 The Brave Little Toaster 10 - 5 The Breakfast Club 10 - 5 Bridesmaids 15 - 10 Dodgeball 20 - 10 Drive 10 - 0 The Fox and the Hound 10 - 5 Glengarry Glen Ross 10 - 0 Good Morning, Vietnam 5 - 5 The Goonies 10 - 5 The Hangover 3 - 0 Hot Fuzz 2 - 15 How to Train Your Dragon 10 - 0 The Hunchback of Notre Dame 15 - 5 The Incredibles 2 - 0 Iron Man 5 - 0 The Karate Kid 10 - 10 Kung Fu Panda 10 - 0 Kung Fu Panda 2 10 - 5 Lady and the Tramp 10 - 5 Lion King 1˝ 25 - 10 The Lion King II: Simba's Pride 25 - 10 Moneyball 1 - 0 Office Space 4 - 0 Planes, Trains and Automobiles 1 - 5 Punch-Drunk Love 5 - 5 Rango 0 - 5 Ratatouille 10 - 0 The Rugrats Movie 30 - 0 Seven Psychopaths 10 - 5 Shrek 2 - 0 Spider-Man 2 10 - 10 Stand by Me 5 - 0 Taxi Driver 15 - 10 Vacation 10 - 5 WALL·E 10 - 5 Wedding Crashers 15 - 10 X2: X-Men United 5 - 10 Zombieland 4 - 5 Zoolander 15 - 10 Austin Powers: The Spy Who Shagged Me 10 - 5 Austin Powers: International Man of Mystery 5 - 5 Be Kind Rewind 5 - 15 A Bug's Life 10 - 0 Cast Away 5 - 0 Christmas Vacation 10 - 0 Dances with Wolves 0 - 5 Die Hard: With a Vengeance 5 - 0 Enchanted 10 - 5 Ferris Bueller's Day Off 4 - 5 The Fighter 5 - 5 Ghost 15 - 5 Gladiator 10 - 5 The Godfather: Part III 5 - 5 Harold and Kumar Go to White Castle 10 - 0 Homeward Bound 10 - 5 I Love You, Man 4 - 5 Idiocracy 5 - 30 It's a Wonderful Life 10 - 10 Jaws 1 - 5 Jurassic Park 4 - 5 Kingdom of Heaven 10 - 5 The Land Before Time 10 - 0 The Little Mermaid 5 - 0 Men in Black 5 - 0 Monsters, Inc 3 - 5 Mulan 0 - 0 My Girl 10 - 5 Napoleon Dynamite 10 - 5 The Next Three Days 5 - 0 Not Another Teen Movie 15 - 15 The Notebook 10 - 0 O Brother, Where Art Thou 10 - 5 Pineapple Express 10 - 0 Primal Fear 1 - 5 The Royal Tenenbaums 1 - 0 Safety Not Guaranteed 5 - 5 Scary Movie 15 - 10 Shrek 2 5 - 5 Something's Gotta Give 10 - 5 Spaceballs 5 - 0 Spider-Man 5 - 0 Stranger Than Fiction 0 - 0 Superbad 10 - 0 Superman II 5 - 5 Superman: The Movie 5 - 0 There's Something About Mary 10 - 0 This Is 40 15 - 15 Tommy Boy 10 - 5 Toy Story 2 10 - 5 Wayne's World 15 - 5 When Harry Met Sally 5 - 0 The Wizard of Oz 0 - 10 X-Men: First Class 4 - 0 You've Got Mail 10 - 10 Billy Madison 5 - 5 Bowling for Columbine 5 - 10 Brother Bear 10 - 0 Bruce Almighty 10 - 0 Casper 10 - 10 Charlie and the Chocolate Factory 5 - 0 Click 15 - 10 Corpse Bride 0 - 5 Crash 5 - 10 Crazy, Stupid, Love 0 - 5 The Da Vinci Code 10 - 20 Dan in Real Life 5 - 0 Easy A 5 - 0 Edward Scissorhands 8 - 10 Flubber 20 - 20 Frosty the Snowman 5 - 5 Funny Games 5 - 10 A Goofy Movie 5 - 5 Hall Pass 20 - 20 Hannibal 10 - 5 Happy Gilmore 10 - 5 The Hitchhiker's Guide to the Galaxy 5 - 0 Honey, I Shrunk the Kids 5 - 0 Horrible Bosses 10 - 0 The Hunger Games 0 - 0 I, Robot 5 - 5 The Imaginarium of Doctor Parnassus 0 - 5 Independence Day 10 - 0 Into the Wild 20 - 10 The Jungle Book 0 - 5 King Kong 0 - 5 Little Miss Sunshine 15 - 10 Looper 7 - 10 The Lord of the Rings: The Fellowship of the Ring 15 - 20 The Lord of the Rings: The Return of the King 15 - 20 The Lord of the Rings: The Two Towers 15 - 20 Love and Other Drugs 15 - 10 Madagascar 10 - 0 The Mask 5 - 5 Mrs. Doubtfire 5 - 0 National Treasure 5 - 15 Oliver & Company 10 - 0 The Perks of Being a Wallflower 0 - 0 Total: 1408 - 975 (Criticker 1408, Coollector 975) ******************* Conclusions: ------------ We can say that the two systems gave great results, as very often they are spot on or only off by a little. We should keep in mind that we've used an extremely accurate rating scale with 21 different levels. There's not much of a difference between a 65 and a 70, so predicting a 65 instead of a 70 is an almost neglictable error. We can also notice that on several occasions the user's rating has surprised both Coollector and Criticker. Maybe it's because they both didn't have enough data yet to fully understand the user's taste, or maybe the user's rating was really surprising, contradicting, and unpredictable. By the end of the test, the predictions of Coollector appeared to be slightly more accurate, but not by much. Criticker made roughly 50% more errors, but 50% of a little, that's still not much.