Welcome to the ICM Forum. If you have an account but have trouble logging in, or have other questions, see THIS THREAD.
Polls: 2006 (Results), Directors (Jan 3rd), 1968 awards (Jan 21st), Documentaries (Jan 26th), 2018 (Feb 17th)
Challenges: Russia, Sci-Fi/Fantasy, Rosenbaum
World Cup: Quarter Finals schedule, QF-A (Jan 16th), QF-B (Jan 27th)
Film of the Week: Pisma myortvogo cheloveka

Posting Links on iCM title comments

User avatar
monk-time
Posts: 1335
Joined: Mar 23, 2015
Contact:

Posting Links on iCM title comments

#441

Post by monk-time » February 17th, 2018, 7:18 pm

I have updated the post above with 80 more links from checking another batch of 17500 users. The whole procedure takes 3 hours and does roughly 21k requests to ICM and 1.5k to Youtube Data API.

This got me thinking: joachimt, would it be possible to ask Marijn to set up an endpoint for the mods to download a dump of all comments from the database in any format (with fields: user, movie, timestamp, comment)? It could be updated, say, once a month, and then I would be able to check all comments on the site in a matter of minutes for all kinds of links.

---

The most hilarious find (already fixed by the mods):

Image
Image
Image
Last edited by monk-time on February 17th, 2018, 7:19 pm, edited 1 time in total.
ICM profile | My userscripts for IMDb/iCM | iCheckMovies Enhanced by themagician: call it direct, call it collect, but CALL IT TODAY!

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#442

Post by joachimt » February 17th, 2018, 9:36 pm

The 80 new ones are the ones at the bottom starting with fkaymak, right?

I don't exactly understand what you mean with your proposal, but I'll pass the message on to Marijn. :thumbsup:
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
monk-time
Posts: 1335
Joined: Mar 23, 2015
Contact:

#443

Post by monk-time » February 17th, 2018, 9:54 pm

Yep; I know that editing the first batch would've thrown a wrench into your workflow, so I put them separately. And thanks!
ICM profile | My userscripts for IMDb/iCM | iCheckMovies Enhanced by themagician: call it direct, call it collect, but CALL IT TODAY!

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#444

Post by joachimt » February 19th, 2018, 4:43 pm

monk-time on Feb 17 2018, 12:18:19 PM wrote:This got me thinking: joachimt, would it be possible to ask Marijn to set up an endpoint for the mods to download a dump of all comments from the database in any format (with fields: user, movie, timestamp, comment)? It could be updated, say, once a month, and then I would be able to check all comments on the site in a matter of minutes for all kinds of links.
Marijn's answer:
This would be way to much data and I think this is something we should do internally. So I have a better idea:

Why don’t I make something that detects dead links in comments automatically and flag those comments for you? Wouldn’t that be much better? The flagged comments will be shown in a list in the admin, and you can easily edit or delete them there.

Do you know what criteria they use to detect dead links? Or would they be willing to share that? If not, I can come up with something myself…
Sounds like a good idea to me. monk-time, can you contact Marijn through PM on iCM to give him some details about detecting dead links?
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
monk-time
Posts: 1335
Joined: Mar 23, 2015
Contact:

#445

Post by monk-time » February 19th, 2018, 5:16 pm

Wait, I thought between maintaining ICM 2.0 and developing 3.0 there's absolutely no free time to spare on any new features? Which is why I thought saving him time on this less important (compared to dozens of ideas that we all can generate in like ten minutes) feature would be good, especially since my tool that I've posted last summer to the official helpdesk seems to work pretty well.

And I wonder how many comments there are on the site. 0.5GB in a compressed archive that would be fetched from the site once a month? It's probably even smaller.

But OK, I'll send him a PM through the site.
Last edited by monk-time on February 19th, 2018, 5:27 pm, edited 1 time in total.
ICM profile | My userscripts for IMDb/iCM | iCheckMovies Enhanced by themagician: call it direct, call it collect, but CALL IT TODAY!

Marijn
Posts: 133
Joined: Jun 24, 2011
Contact:

#446

Post by Marijn » February 19th, 2018, 6:43 pm

monk-time on Feb 19 2018, 10:16:29 AM wrote:Wait, I thought between maintaining ICM 2.0 and developing 3.0 there's absolutely no free time to spare on any new features? Which is why I thought saving him time on this less important (compared to dozens of ideas that we all can generate in like ten minutes) feature would be good, especially since my tool that I've posted last summer to the official helpdesk seems to work pretty well.

And I wonder how many comments there are on the site. 0.5GB in a compressed archive that would be fetched from the site once a month? It's probably even smaller.

But OK, I'll send him a PM through the site.
You're right, there is not much (if any) free time while maintaining the current version and building the new one. But sometimes it's nice to step away from the new design for a moment and build something you guys can use right now, like the instant-awards. That's why I'd like to do this and even more so, because this does not have to be much work to develop.

But hey, like I asked in my PM, you're welcome to help me with developing the site (or this) further if you'd like. It looks like you know your Python good enough to be of help :)

User avatar
monk-time
Posts: 1335
Joined: Mar 23, 2015
Contact:

#447

Post by monk-time » February 19th, 2018, 10:16 pm

Marijn on Feb 19 2018, 11:43:19 AM wrote:But hey, like I asked in my PM, you're welcome to help me with developing the site (or this) further if you'd like. It looks like you know your Python good enough to be of help :)
That's something I really need to think about. :thumbsup:
ICM profile | My userscripts for IMDb/iCM | iCheckMovies Enhanced by themagician: call it direct, call it collect, but CALL IT TODAY!

Marijn
Posts: 133
Joined: Jun 24, 2011
Contact:

#448

Post by Marijn » February 19th, 2018, 11:00 pm

monk-time on Feb 19 2018, 03:16:49 PM wrote:
Marijn on Feb 19 2018, 11:43:19 AM wrote:But hey, like I asked in my PM, you're welcome to help me with developing the site (or this) further if you'd like. It looks like you know your Python good enough to be of help :)
That's something I really need to think about. :thumbsup:
Sure, no problem :)

User avatar
Gershwin
Donator
Posts: 7070
Joined: May 17, 2011
Location: Leiden, NL
Contact:

#449

Post by Gershwin » February 19th, 2018, 11:39 pm

Do it, Monk. Others will follow, and we'll end up with a decent bunch of guys who can assist Marijn. Everyone profits, more or less. :sweat:
RokP 250

Profiles: Untappd - Last.fm - iCM

User avatar
wowwee123
Posts: 1204
Joined: Jun 11, 2011
Location: Sigh Burr Spay ZZZ
Contact:

#450

Post by wowwee123 » February 20th, 2018, 8:17 am

1. Is the link to this person's comments working? Qwijybo

https://beta.icheckmovies.com/movies/panagur/comments/



2. Link posted by Gershwin gives a 404 Not Found

https://beta.icheckmovies.com/movies/vo ... /comments/
Last edited by wowwee123 on February 20th, 2018, 8:35 am, edited 1 time in total.

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#451

Post by joachimt » February 20th, 2018, 2:14 pm

Qwijybo's link is working for me.
Gershwin's post edited.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
wowwee123
Posts: 1204
Joined: Jun 11, 2011
Location: Sigh Burr Spay ZZZ
Contact:

#452

Post by wowwee123 » February 20th, 2018, 4:28 pm

joachimt on Feb 20 2018, 07:14:46 AM wrote:Qwijybo's link is working for me.
I tried it in two browsers -- FF and edge with blockers turned off--both show an empty box. Which browser did you use?

Thank you for your continuous efforts!

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#453

Post by joachimt » February 20th, 2018, 6:59 pm

wowwee123 on Feb 20 2018, 09:28:35 AM wrote:
joachimt on Feb 20 2018, 07:14:46 AM wrote:Qwijybo's link is working for me.
I tried it in two browsers -- FF and edge with blockers turned off--both show an empty box. Which browser did you use?
Chrome
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
wowwee123
Posts: 1204
Joined: Jun 11, 2011
Location: Sigh Burr Spay ZZZ
Contact:

#454

Post by wowwee123 » February 21st, 2018, 2:14 am

joachimt on Feb 20 2018, 11:59:11 AM wrote:
wowwee123 on Feb 20 2018, 09:28:35 AM wrote:
joachimt on Feb 20 2018, 07:14:46 AM wrote:Qwijybo's link is working for me.
I tried it in two browsers -- FF and edge with blockers turned off--both show an empty box. Which browser did you use?
Chrome
I meant Chrome when I wrote FF. I simply get a empty square box. Also, on a side note, all the functionality of this site for example, clicking on spoilers, are not working. This might be related, though.

Edit: Issue fixed.
Last edited by wowwee123 on February 22nd, 2018, 5:19 pm, edited 1 time in total.

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#455

Post by joachimt » February 23rd, 2018, 10:54 pm

I'm done with all the dead links found by monk-time. :)
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
monk-time
Posts: 1335
Joined: Mar 23, 2015
Contact:

#456

Post by monk-time » February 23rd, 2018, 11:49 pm

Congrats! :thumbsup:
ICM profile | My userscripts for IMDb/iCM | iCheckMovies Enhanced by themagician: call it direct, call it collect, but CALL IT TODAY!


User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#458

Post by joachimt » February 25th, 2018, 8:50 am

done
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#459

Post by joachimt » February 27th, 2018, 7:11 pm

The past few days I edited a lot of non-English posts. If you run into more, you can post them here.

I also added spoiler-tags a few times when I ran into complaints about spoilers. If you see something like that, you can post here as well.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

allisoncm
Posts: 15921
Joined: May 11, 2011
Contact:

#460

Post by allisoncm » February 28th, 2018, 6:51 am

Last edited by allisoncm on February 28th, 2018, 6:52 am, edited 1 time in total.

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#461

Post by joachimt » February 28th, 2018, 10:06 am

done
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
xianjiro
Donator
Posts: 5718
Joined: Jun 17, 2015
Location: Kakistani Left Coast
Contact:

#462

Post by xianjiro » March 10th, 2018, 7:18 am


Listen, Daddy. Teacher says, 'every time a car alarm bleeps, into heaven a demon sneaks.'
sol can find me here

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#463

Post by joachimt » March 10th, 2018, 8:27 am

removed
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
xianjiro
Donator
Posts: 5718
Joined: Jun 17, 2015
Location: Kakistani Left Coast
Contact:

#464

Post by xianjiro » March 24th, 2018, 8:49 am


Listen, Daddy. Teacher says, 'every time a car alarm bleeps, into heaven a demon sneaks.'
sol can find me here

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#465

Post by joachimt » March 24th, 2018, 8:58 am

removed
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
Ebbywebby
Posts: 1773
Joined: Sep 10, 2012
Location: Orange County, CA
Contact:

#466

Post by Ebbywebby » March 27th, 2018, 4:38 am


User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#467

Post by joachimt » March 27th, 2018, 5:51 am

Ebbywebby on Mar 26 2018, 10:38:24 PM wrote:https://www.icheckmovies.com/movies/byd ... /#comments

Armoreska's iink is dead.
Working for me. Have you tried this?
https://www.youpak.com/watch?v=hwszNksO4Gs
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
Ebbywebby
Posts: 1773
Joined: Sep 10, 2012
Location: Orange County, CA
Contact:

#468

Post by Ebbywebby » March 27th, 2018, 8:41 am

joachimt on Mar 26 2018, 11:51:45 PM wrote:
Ebbywebby on Mar 26 2018, 10:38:24 PM wrote:https://www.icheckmovies.com/movies/byd ... /#comments

Armoreska's iink is dead.
Working for me. Have you tried this?
https://www.youpak.com/watch?v=hwszNksO4Gs
I get "This video is not available" for the YouTube link. And your link doesn't seem to be working either.

User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#469

Post by joachimt » March 27th, 2018, 2:31 pm

Ebbywebby on Mar 27 2018, 02:41:49 AM wrote:
joachimt on Mar 26 2018, 11:51:45 PM wrote:
Ebbywebby on Mar 26 2018, 10:38:24 PM wrote:https://www.icheckmovies.com/movies/byd ... /#comments

Armoreska's iink is dead.
Working for me. Have you tried this?
https://www.youpak.com/watch?v=hwszNksO4Gs
I get "This video is not available" for the YouTube link. And your link doesn't seem to be working either.
Okay, I made a note about it in the comment.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"




User avatar
Ebbywebby
Posts: 1773
Joined: Sep 10, 2012
Location: Orange County, CA
Contact:

#473

Post by Ebbywebby » April 5th, 2018, 12:24 am



User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#475

Post by joachimt » April 5th, 2018, 5:57 am

All done
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
wowwee123
Posts: 1204
Joined: Jun 11, 2011
Location: Sigh Burr Spay ZZZ
Contact:

#476

Post by wowwee123 » April 8th, 2018, 12:15 am


User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#477

Post by joachimt » April 8th, 2018, 7:40 am

done
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"


User avatar
joachimt
Donator
Posts: 27262
Joined: Feb 16, 2012
Location: Netherlands
Contact:

#479

Post by joachimt » April 9th, 2018, 6:27 pm

done
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"

User avatar
wowwee123
Posts: 1204
Joined: Jun 11, 2011
Location: Sigh Burr Spay ZZZ
Contact:

#480

Post by wowwee123 » April 11th, 2018, 1:02 pm

Last edited by wowwee123 on April 11th, 2018, 1:26 pm, edited 1 time in total.

Post Reply