Welcome to the ICM Forum. If you have an account but have trouble logging in, or have other questions, see THIS THREAD.
NOTE: Board emails should be working again. Information on forum upgrade and style issues.
Podcast: Talking Images (Episode 22 released November 17th * EXCLUSIVE * We Are Mentioned in a Book!!! Interview with Mary Guillermin on Rapture, JG & More)
Polls: 1978 (Results), Red Planet: Essential Cinema (Results), Western (Jul 30th)
Challenges: Run the Actor, Travel the World, Iran and Central Asia

IMDB Ratings / Vote History Analyzer

Post Reply
burdenofhope
Posts: 3
Joined: December 3rd, 2012, 7:00 am
Contact:

IMDB Ratings / Vote History Analyzer

#1

Post by burdenofhope »

Hello there,

although I have been using iCM for quite a while, I am new to this board. And it comes with a question. First, I'd like to explain what I am trying to do:

Some years ago there was an awesome website called IVHA (IMDB Vote History Analyzer). You could enter the public link to your ratings history and the website would create stats from that: how many movies from that decade have you seen, what are your top genres, who are your top actors and so forth. Due to countless IMDB redesigns the website stopped working and has been taken off some years ago.
Now I want to recreate that website. Right now I am using the ratings.csv (the exported ratings history) to get the IDs of all the movies I've rated on IMDB. With the help of IMDBPHP I am filling an SQL database with all the movies, actors, genres, keywords etc. to create stats. Unfortunately, IMDBPHP does not include a function to directly access the IMDB My Movies ratings history, which iCM does.

Now to my question: iCM does manage to directly access the rating history, as you can simply import your ratings. I don't want anyone to divulge any corporate secrets, but it would be immensely helpful to know how to do this. Then I could update all the existing data once a week or so without the user having to reupload his updated ratings.csv. When the website is finished I will of course make it publicly accessible.

I'd appreciate any help. Thanks a lot for your time, bye, Michael.
Pain
Posts: 2177
Joined: June 22nd, 2011, 6:00 am
Location: Riyadh, Saudi Arabia
Contact:

#2

Post by Pain »

You can ask The Guys directly on ICM

I really like the idea and it could be very helpful, so hopefully they'll answer you to your satisfaction.
User avatar
bal3x
Donator
Posts: 13106
Joined: May 26th, 2011, 6:00 am
Contact:

#3

Post by bal3x »

This sounds interesting, perhaps our themagician can be of some help here! He's been doing all sorts of wonders :)
themagician
Posts: 3889
Joined: June 18th, 2011, 6:00 am
Location: Finland
Contact:

#4

Post by themagician »

If the link to your IMDb ratings is http://www.imdb.com/user/ur12345678/ratings, where userid=ur12345678, then the direct link to download the CSV file is http://www.imdb.com/list/export?list_id ... ur12345678.

If that's what you're asking?

edit: And if you use Python to develop you can simply do:

Code: Select all

import requests

url = 'http://www.imdb.com/list/export?list_id=ratings&author_id=ur12345678'
r = requests.get(url)

if r.status_code != 200:
    # private list
else:
    # parse csv file
Last edited by themagician on December 3rd, 2012, 1:25 pm, edited 1 time in total.
burdenofhope
Posts: 3
Joined: December 3rd, 2012, 7:00 am
Contact:

#5

Post by burdenofhope »

Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way. :)
User avatar
kingink
Posts: 2707
Joined: June 16th, 2011, 6:00 am
Contact:

#6

Post by kingink »

I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!
User avatar
St. Gloede
Moderator
Posts: 12588
Joined: May 6th, 2011, 6:00 am
Contact:

#7

Post by St. Gloede »

kingink on Dec 3 2012, 06:54:22 AM wrote:I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!
I loved it too. Only problem was that it didn't seperate between TV eps and movies, causing the actor listing to be particularly skewed.
User avatar
kingink
Posts: 2707
Joined: June 16th, 2011, 6:00 am
Contact:

#8

Post by kingink »

Because of ivha I never voted on imdb any episodes or all the greek movies I've seen. I didn't want my stats to be a total mess. And I still keep that rule hoping for another ivha to make it's appearance
mjf314
Moderator
Posts: 12047
Joined: May 8th, 2011, 6:00 am
Contact:

#9

Post by mjf314 »

burdenofhope on Dec 3 2012, 06:39:34 AM wrote:Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way. :)
Maybe you can set it so that users have to click a button to refresh their ratings histories (and if necessary limit it to 2 or 3 times per user per week), so then you won't be downloading every csv every day.
Last edited by mjf314 on December 3rd, 2012, 7:05 pm, edited 1 time in total.
timmy_501
Posts: 457
Joined: May 27th, 2011, 6:00 am
Contact:

#10

Post by timmy_501 »

Loved that site, hope this works!
burdenofhope
Posts: 3
Joined: December 3rd, 2012, 7:00 am
Contact:

#11

Post by burdenofhope »

Just wanted to let you guys know that it is looking good. themagician's idea works fine, let's just hope that IMDB does not make any other questionable design and structural changes. I might have something to show for in two weeks.

Bye, Michael.
User avatar
mightysparks
Site Admin
Posts: 31552
Joined: May 5th, 2011, 6:00 am
Location: Perth, WA, Australia
Contact:

#13

Post by mightysparks »

Squee! I missed out on the original site and was saddened, so it'll be nice to get a go at it :)
"I do not always know what I want, but I do know what I don't want." - Stanley Kubrick

iCM | IMDb | Letterboxd | LastFM | TSZDT

Image
User avatar
St. Gloede
Moderator
Posts: 12588
Joined: May 6th, 2011, 6:00 am
Contact:

#14

Post by St. Gloede »

If there's a way to exclude TV eps it would be even more awesome.
allisoncm
Posts: 16756
Joined: May 11th, 2011, 6:00 am
Contact:

#15

Post by allisoncm »

My top rated year is 1908, followed by 1927 and 1952.
At the bottom of the top-rated genre (lowest rated) is westerns.
User avatar
metaller
Donator
Posts: 2863
Joined: June 17th, 2011, 6:00 am
Contact:

#16

Post by metaller »

Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched C-beams glitter in the dark near the Tannhäuser Gate. All those moments will be lost in time, like tears in rain. Time to die.
allisoncm
Posts: 16756
Joined: May 11th, 2011, 6:00 am
Contact:

#17

Post by allisoncm »

metaller on Feb 15 2013, 03:16:34 AM wrote:Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
IMDB has a new feature now that does all the work for you. :woot: At first it didn't work because I had so many votes. :rolleyes: But now it does.
User avatar
frbrown
Posts: 6683
Joined: November 1st, 2011, 6:00 am
Contact:

#18

Post by frbrown »

allisoncm on Feb 15 2013, 02:23:57 PM wrote:
metaller on Feb 15 2013, 03:16:34 AM wrote:Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)
IMDB has a new feature now that does all the work for you. :woot: At first it didn't work because I had so many votes. :rolleyes: But now it does.
Where is this feature hiding?
Image
User avatar
brokenface
Donator
Posts: 13912
Joined: December 29th, 2011, 7:00 am
Contact:

#19

Post by brokenface »

click on your account and then View Your Achievements.
User avatar
frbrown
Posts: 6683
Joined: November 1st, 2011, 6:00 am
Contact:

#20

Post by frbrown »

Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes :sweat:
Image
User avatar
brokenface
Donator
Posts: 13912
Joined: December 29th, 2011, 7:00 am
Contact:

#21

Post by brokenface »

if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/
User avatar
frbrown
Posts: 6683
Joined: November 1st, 2011, 6:00 am
Contact:

#22

Post by frbrown »

brokenface on Feb 15 2013, 05:03:39 PM wrote:if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/
You also like film noir :thumbsup:

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline :P
Image
User avatar
brokenface
Donator
Posts: 13912
Joined: December 29th, 2011, 7:00 am
Contact:

#23

Post by brokenface »

Sure do like noir :)

1943 is your Empire State Building!
allisoncm
Posts: 16756
Joined: May 11th, 2011, 6:00 am
Contact:

#24

Post by allisoncm »

frbrown on Feb 15 2013, 05:01:11 PM wrote:Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes :sweat:
I think someone posted the info here on the board recently, but I forget which thread, so I posted it in this one. :)
User avatar
Torgo
Posts: 3531
Joined: June 30th, 2011, 6:00 am
Location: Germany
Contact:

#25

Post by Torgo »

Still a matter close to my heart.

Are the Criticker stats any comparable? I think some of you guys mentioned them for the Directors poll, but I'm not registered there yet.
User avatar
Armoreska
Posts: 13934
Joined: November 1st, 2012, 6:00 am
Location: Ukraine, former Free Territory
Contact:

#26

Post by Armoreska »

frbrown on Feb 15 2013, 05:20:59 PM wrote:
brokenface on Feb 15 2013, 05:03:39 PM wrote:if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/
You also like film noir :thumbsup:

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline :P
mine looks like a stage to Mont Ventoux
Image
he or A. or Armo or any

Image
currently working towards a vegan/free world + thru such film lists: GODARD, r/antinatalism recommends,..
the rest
ANARCHISTS, ANIMAL RIGHTS, Assisted suicide, Existential films, SOCIALIST CINEMA (an amalgamation of lists), Feminist lists, various GSSRM lists (aka LGBTQ+), 2010s bests, Visual Effects nominees, kid-related stuff, great animes (mini-serie or feature), very 80s movies, mah huge sci-fi list, ENVIRO, remarkable Silent Films and Pre-Code (exploring 1925 atm) and every shorts and docu list I'm aware of and
/forum.icmforum.com/viewtopic.php?f=1&t=1434
and "Gordon" Liu Chia-Hui/Liu Chia-Liang and Yuen Woo-ping and "Sammo" Hung Kam-bo
imaginary awards | youtube channels | complaint lounge | explain how big a fan of slavery you are here, ..viewtopic.php?f=12&t=1535 and here: ..viewtopic.php?f=12&t=4484
User avatar
xianjiro
Donator
Posts: 9735
Joined: June 17th, 2015, 6:00 am
Location: Kakistani Left Coast
Contact:

#27

Post by xianjiro »

So, not sure where else to put this, but for those interested in the IMDb Top 1000's effect on ratings, here's a really good example. https://www.imdb.com/title/tt0205963/ratings

"213 IMDb users have given a weighted average vote of 6.5 / 10"
and
"Arithmetic mean = 7.2 Median = 8"

but the next page
https://www.imdb.com/title/tt0205963/ra ... 000_voters

"14 IMDb users have given a weighted average vote of 2.1 / 10"
and
"Arithmetic mean = 2.1 Median = 1"

I leave it to the mathematicians to figure out the formula and please not, I just rated this title so time in the next few hours the numbers will change.
Post Reply