Welcome to the ICM Forum. If you have an account but have trouble logging in, or have other questions, see THIS THREAD.
Podcast: Talking Images (Episode 5 released June 2nd)
Polls: 1950s (Results), 1935 (Results), 1966 awards (Jun 9th), 2010s (Jun 30th)
Challenges: TSPDT, 1960s, China/Hong Kong/Taiwan
Film of the Week: Údolí vcel, July nominations (Jun 26th)
World Cup S4: Round 2 schedule, Match 2A: Poland vs Mexico (Jun 4th), Match 2B: Tajikistan vs Italy (Jun 14th)

IMDB Ratings / Vote History Analyzer

Post Reply
burdenofhope
Posts: 3
Joined: Dec 03, 2012
Contact:

IMDB Ratings / Vote History Analyzer

#1

Post by burdenofhope » December 3rd, 2012, 11:38 am

Hello there,

although I have been using iCM for quite a while, I am new to this board. And it comes with a question. First, I'd like to explain what I am trying to do:

Some years ago there was an awesome website called IVHA (IMDB Vote History Analyzer). You could enter the public link to your ratings history and the website would create stats from that: how many movies from that decade have you seen, what are your top genres, who are your top actors and so forth. Due to countless IMDB redesigns the website stopped working and has been taken off some years ago.
Now I want to recreate that website. Right now I am using the ratings.csv (the exported ratings history) to get the IDs of all the movies I've rated on IMDB. With the help of IMDBPHP I am filling an SQL database with all the movies, actors, genres, keywords etc. to create stats. Unfortunately, IMDBPHP does not include a function to directly access the IMDB My Movies ratings history, which iCM does.

Now to my question: iCM does manage to directly access the rating history, as you can simply import your ratings. I don't want anyone to divulge any corporate secrets, but it would be immensely helpful to know how to do this. Then I could update all the existing data once a week or so without the user having to reupload his updated ratings.csv. When the website is finished I will of course make it publicly accessible.

I'd appreciate any help. Thanks a lot for your time, bye, Michael.

Pain
Posts: 2177
Joined: Jun 22, 2011
Location: Riyadh, Saudi Arabia
Contact:

#2

Post by Pain » December 3rd, 2012, 12:04 pm

You can ask The Guys directly on ICM

I really like the idea and it could be very helpful, so hopefully they'll answer you to your satisfaction.

User avatar
bal3x
Donator
Posts: 13052
Joined: May 26, 2011
Contact:

#3

Post by bal3x » December 3rd, 2012, 1:19 pm

This sounds interesting, perhaps our themagician can be of some help here! He's been doing all sorts of wonders :)

themagician
Posts: 3889
Joined: Jun 18, 2011
Location: Finland
Contact:

#4

Post by themagician » December 3rd, 2012, 1:20 pm

If the link to your IMDb ratings is http://www.imdb.com/user/ur12345678/ratings, where userid=ur12345678, then the direct link to download the CSV file is http://www.imdb.com/list/export?list_id ... ur12345678.

If that's what you're asking?

edit: And if you use Python to develop you can simply do:

Code: Select all

import requests

url = 'http://www.imdb.com/list/export?list_id=ratings&author_id=ur12345678'
r = requests.get(url)

if r.status_code != 200:
    # private list
else:
    # parse csv file
Last edited by themagician on December 3rd, 2012, 1:25 pm, edited 1 time in total.

burdenofhope
Posts: 3
Joined: Dec 03, 2012
Contact:

#5

Post by burdenofhope » December 3rd, 2012, 1:39 pm

Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way. :)

User avatar
kingink
Posts: 2608
Joined: Jun 16, 2011
Contact:

#6

Post by kingink » December 3rd, 2012, 1:54 pm

I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!

User avatar
St. Gloede
Moderator
Posts: 10747
Joined: May 06, 2011
Contact:

#7

Post by St. Gloede » December 3rd, 2012, 1:58 pm

kingink on Dec 3 2012, 06:54:22 AM wrote:I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!
I loved it too. Only problem was that it didn't seperate between TV eps and movies, causing the actor listing to be particularly skewed.

User avatar
kingink
Posts: 2608
Joined: Jun 16, 2011
Contact:

#8

Post by kingink » December 3rd, 2012, 2:04 pm

Because of ivha I never voted on imdb any episodes or all the greek movies I've seen. I didn't want my stats to be a total mess. And I still keep that rule hoping for another ivha to make it's appearance

mjf314
Moderator
Posts: 11258
Joined: May 08, 2011
Contact:

#9

Post by mjf314 » December 3rd, 2012, 7:04 pm

burdenofhope on Dec 3 2012, 06:39:34 AM wrote:Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way. :)
Maybe you can set it so that users have to click a button to refresh their ratings histories (and if necessary limit it to 2 or 3 times per user per week), so then you won't be downloading every csv every day.
Last edited by mjf314 on December 3rd, 2012, 7:05 pm, edited 1 time in total.

timmy_501
Posts: 455
Joined: May 27, 2011
Contact:

#10

Post by timmy_501 » December 4th, 2012, 4:14 am

Loved that site, hope this works!

burdenofhope
Posts: 3
Joined: Dec 03, 2012
Contact:

#11

Post by burdenofhope » December 9th, 2012, 5:28 am

Just wanted to let you guys know that it is looking good. themagician's idea works fine, let's just hope that IMDB does not make any other questionable design and structural changes. I might have something to show for in two weeks.

Bye, Michael.


User avatar
mightysparks
Site Admin
Posts: 30477
Joined: May 05, 2011
Location: Perth, WA, Australia
Contact:

#13

Post by mightysparks » December 9th, 2012, 5:35 am

Squee! I missed out on the original site and was saddened, so it'll be nice to get a go at it :)
"I do not always know what I want, but I do know what I don't want." - Stanley Kubrick

iCM | IMDb | LastFM | TSZDT

Image

User avatar
St. Gloede
Moderator
Posts: 10747
Joined: May 06, 2011
Contact:

#14

Post by St. Gloede » December 9th, 2012, 5:38 am

If there's a way to exclude TV eps it would be even more awesome.

allisoncm
Posts: 16476
Joined: May 11, 2011
Contact:

#15

Post by allisoncm » February 15th, 2013, 7:09 am

My top rated year is 1908, followed by 1927 and 1952.
At the bottom of the top-rated genre (lowest rated) is westerns.

User avatar
metaller
Donator
Posts: 2856
Joined: Jun 17, 2011
Contact:

#16

Post by metaller » February 15th, 2013, 10:16 am

Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched C-beams glitter in the dark near the Tannhäuser Gate. All those moments will be lost in time, like tears in rain. Time to die.

allisoncm
Posts: 16476
Joined: May 11, 2011
Contact:

#17

Post by allisoncm » February 15th, 2013, 9:23 pm

metaller on Feb 15 2013, 03:16:34 AM wrote:Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
IMDB has a new feature now that does all the work for you. :woot: At first it didn't work because I had so many votes. :rolleyes: But now it does.

User avatar
frbrown
Posts: 6135
Joined: Nov 01, 2011
Contact:

#18

Post by frbrown » February 15th, 2013, 11:45 pm

allisoncm on Feb 15 2013, 02:23:57 PM wrote:
metaller on Feb 15 2013, 03:16:34 AM wrote:Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
IMDB has a new feature now that does all the work for you. :woot: At first it didn't work because I had so many votes. :rolleyes: But now it does.
Where is this feature hiding?
Image

User avatar
brokenface
Donator
Posts: 13438
Joined: Dec 29, 2011
Contact:

#19

Post by brokenface » February 15th, 2013, 11:48 pm

click on your account and then View Your Achievements.

User avatar
frbrown
Posts: 6135
Joined: Nov 01, 2011
Contact:

#20

Post by frbrown » February 16th, 2013, 12:01 am

Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes :sweat:
Image

User avatar
brokenface
Donator
Posts: 13438
Joined: Dec 29, 2011
Contact:

#21

Post by brokenface » February 16th, 2013, 12:03 am

if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/

User avatar
frbrown
Posts: 6135
Joined: Nov 01, 2011
Contact:

#22

Post by frbrown » February 16th, 2013, 12:20 am

brokenface on Feb 15 2013, 05:03:39 PM wrote:if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/
You also like film noir :thumbsup:

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline :P
Image

User avatar
brokenface
Donator
Posts: 13438
Joined: Dec 29, 2011
Contact:

#23

Post by brokenface » February 16th, 2013, 12:22 am

Sure do like noir :)

1943 is your Empire State Building!

allisoncm
Posts: 16476
Joined: May 11, 2011
Contact:

#24

Post by allisoncm » February 16th, 2013, 3:13 am

frbrown on Feb 15 2013, 05:01:11 PM wrote:Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes :sweat:
I think someone posted the info here on the board recently, but I forget which thread, so I posted it in this one. :)

User avatar
Torgo
Posts: 1291
Joined: Jun 30, 2011
Location: Germany
Contact:

#25

Post by Torgo » December 3rd, 2013, 2:15 am

Still a matter close to my heart.

Are the Criticker stats any comparable? I think some of you guys mentioned them for the Directors poll, but I'm not registered there yet.

User avatar
Armoreska
Posts: 11799
Joined: Nov 01, 2012
Location: Ukraine
Contact:

#26

Post by Armoreska » December 3rd, 2013, 2:30 am

frbrown on Feb 15 2013, 05:20:59 PM wrote:
brokenface on Feb 15 2013, 05:03:39 PM wrote:if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/
You also like film noir :thumbsup:

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline :P
mine looks like a stage to Mont Ventoux
Image
Image
currently working towards a vegan/low waste world + thru such film lists (besides TV): 2010s bests, RW Fassbinder, Luis Bunuel, Yasujiro Ozu, Eric Rohmer, Visual Effects nominees, kid-related stuff, great animes (mini-serie or feature), very 80s movies, 17+ sci-fi lists on watchlist, ENVIRO, remarkable Silent Films and Pre-Code (exploring 1925 atm) and every shorts and docu list I'm aware of and
viewtopic.php?f=1&t=1434
and "Gordon" Liu Chia-Hui/Liu Chia-Liang and Yuen Woo-ping and "Sammo" Hung Kam-bo

User avatar
xianjiro
Donator
Posts: 7570
Joined: Jun 17, 2015
Location: Kakistani Left Coast
Contact:

#27

Post by xianjiro » April 29th, 2020, 6:51 am

So, not sure where else to put this, but for those interested in the IMDb Top 1000's effect on ratings, here's a really good example. https://www.imdb.com/title/tt0205963/ratings

"213 IMDb users have given a weighted average vote of 6.5 / 10"
and
"Arithmetic mean = 7.2 Median = 8"

but the next page
https://www.imdb.com/title/tt0205963/ra ... 000_voters

"14 IMDb users have given a weighted average vote of 2.1 / 10"
and
"Arithmetic mean = 2.1 Median = 1"

I leave it to the mathematicians to figure out the formula and please not, I just rated this title so time in the next few hours the numbers will change.

Listen, Daddy. Teacher says, 'every time a car alarm bleeps, into heaven a demon sneaks.'
sol can find me here

Post Reply