IMDB Ratings / Vote History Analyzer

[burdenofhope]

Hello there,

although I have been using iCM for quite a while, I am new to this board. And it comes with a question. First, I'd like to explain what I am trying to do:

Some years ago there was an awesome website called IVHA (IMDB Vote History Analyzer). You could enter the public link to your ratings history and the website would create stats from that: how many movies from that decade have you seen, what are your top genres, who are your top actors and so forth. Due to countless IMDB redesigns the website stopped working and has been taken off some years ago.
Now I want to recreate that website. Right now I am using the ratings.csv (the exported ratings history) to get the IDs of all the movies I've rated on IMDB. With the help of IMDBPHP I am filling an SQL database with all the movies, actors, genres, keywords etc. to create stats. Unfortunately, IMDBPHP does not include a function to directly access the IMDB My Movies ratings history, which iCM does.

Now to my question: iCM does manage to directly access the rating history, as you can simply import your ratings. I don't want anyone to divulge any corporate secrets, but it would be immensely helpful to know how to do this. Then I could update all the existing data once a week or so without the user having to reupload his updated ratings.csv. When the website is finished I will of course make it publicly accessible.

I'd appreciate any help. Thanks a lot for your time, bye, Michael.

[Pain]

You can ask The Guys directly on ICM

I really like the idea and it could be very helpful, so hopefully they'll answer you to your satisfaction.

[bal3x]

This sounds interesting, perhaps our themagician can be of some help here! He's been doing all sorts of wonders

[themagician]

If the link to your IMDb ratings is http://www.imdb.com/user/ur12345678/ratings, where userid=ur12345678, then the direct link to download the CSV file is http://www.imdb.com/list/export?list_id ... ur12345678.

If that's what you're asking?

edit: And if you use Python to develop you can simply do:

Code: Select all

import requests

url = 'http://www.imdb.com/list/export?list_id=ratings&author_id=ur12345678'
r = requests.get(url)

if r.status_code != 200:
    # private list
else:
    # parse csv file

[burdenofhope]

Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way.

[kingink]

I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!

[St. Gloede]

I really loved IVHA and was heartbroken when it stopped working, so if you manage to recreate it you'll be my hero burdenofhope!

I loved it too. Only problem was that it didn't seperate between TV eps and movies, causing the actor listing to be particularly skewed.

[kingink]

Because of ivha I never voted on imdb any episodes or all the greek movies I've seen. I didn't want my stats to be a total mess. And I still keep that rule hoping for another ivha to make it's appearance

[mjf314]

Do you also use the .csv-file to import the movies on iCM or is there a way to access the ratings directly? Point is, that I want to refresh the users' history and thus their stats once or twice a day via a cronjob and if I have to access every csv-file (some are over a megabyte) .. well, it's quite a lot of data going in and out.

But nevertheless, thanks a lot for that hint with the export url, I will definitely try that one out if there is no other way.

Maybe you can set it so that users have to click a button to refresh their ratings histories (and if necessary limit it to 2 or 3 times per user per week), so then you won't be downloading every csv every day.

[timmy_501]

Loved that site, hope this works!

[burdenofhope]

Just wanted to let you guys know that it is looking good. themagician's idea works fine, let's just hope that IMDB does not make any other questionable design and structural changes. I might have something to show for in two weeks.

Bye, Michael.

[St. Gloede]

Awesome!

[mightysparks]

Squee! I missed out on the original site and was saddened, so it'll be nice to get a go at it

[St. Gloede]

If there's a way to exclude TV eps it would be even more awesome.

[allisoncm]

My top rated year is 1908, followed by 1927 and 1952.
At the bottom of the top-rated genre (lowest rated) is westerns.

[metaller]

Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)

[allisoncm]

Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)

IMDB has a new feature now that does all the work for you. At first it didn't work because I had so many votes. But now it does.

[frbrown]

Ha, I see I'm not the only one who had the same idea. On the facebook group I recently posted very proud how I imported my imdb csv to a mysql database and from there I could of course querry it whatever way I wanted.
What's suggested here would be of course the logical next step for me too.
But when someone else does that work, there is more time for me to watch films. ;)

IMDB has a new feature now that does all the work for you. At first it didn't work because I had so many votes. But now it does.

Where is this feature hiding?

[brokenface]

click on your account and then View Your Achievements.

[frbrown]

Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes

[brokenface]

if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/

[frbrown]

if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/

You also like film noir

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline

[brokenface]

Sure do like noir

1943 is your Empire State Building!

[allisoncm]

Thanks! I would have never noticed that link on my own.

My four highest rated genres are really just one genre: film noir, crime, mystery, thriller! I don't have the most diverse of tastes

I think someone posted the info here on the board recently, but I forget which thread, so I posted it in this one.

[Torgo]

Still a matter close to my heart.

Are the Criticker stats any comparable? I think some of you guys mentioned them for the Directors poll, but I'm not registered there yet.

[Armoreska]

if you have other people's imdb account and go to it, it now gives you a comparison as well (how many ratings the same/higher/lower and a similarity score), check the Lounge thread a page or two back.

e.g. try mine: http://www.imdb.com/user/ur5409488/

You also like film noir

Here is mine:
http://www.imdb.com/user/ur3840633/

My "Count by Title Year" graph would make a nice city skyline

mine looks like a stage to Mont Ventoux

[xianjiro]

So, not sure where else to put this, but for those interested in the IMDb Top 1000's effect on ratings, here's a really good example. https://www.imdb.com/title/tt0205963/ratings

"213 IMDb users have given a weighted average vote of 6.5 / 10"
and
"Arithmetic mean = 7.2 Median = 8"

but the next page
https://www.imdb.com/title/tt0205963/ra ... 000_voters

"14 IMDb users have given a weighted average vote of 2.1 / 10"
and
"Arithmetic mean = 2.1 Median = 1"

I leave it to the mathematicians to figure out the formula and please not, I just rated this title so time in the next few hours the numbers will change.