Welcome to the ICM Forum. If you have an account but have trouble logging in, or have other questions, see THIS THREAD.
NOTE: Board emails should be working again. Information on forum upgrade and style issues.
Podcast: Talking Images (Episode 36 released September 16th: The Minimalist World of Robert Bresson)
Polls: 2020 (Results), 21st Century (Results), 500<400 (Sept 24th), 1967 (Sept 29th)
Challenges: Eastern Europe, Silent Era, Low Rating
Managers Cup: Round 1 Schedule, 1B: russa03 vs zzzorf vs OldAle1 (Sep 26th)

Technical Support

Post Reply
User avatar
Knaldskalle
Moderator
Posts: 10619
Joined: May 9th, 2011, 6:00 am
Location: New Mexico, USA
Contact:

#1881

Post by Knaldskalle »

Armoreska wrote: July 29th, 2021, 3:46 pm Yeah I understand that sometool could do that as an alternative. I'd need a timecode in the file name though.
Doesn't the fact that the images are numbered and represent 1/60 of a minute make that fairly trivial? Image3601.jpg is the one at 1:00:01.
ImageImageImageImage

Please don't hurt yourself, talk to someone.
User avatar
Armoreska
Posts: 14117
Joined: November 1st, 2012, 6:00 am
Location: Ukraine, former Free Territory
Contact:

#1882

Post by Armoreska »

Well if I can't find a better option I'll have to work with that
he or A. or Armo or any

Image
currently working towards a vegan/free world + thru such film lists: GODARD, r/antinatalism recommends,..
the rest
ANARCHISTS, ANIMAL RIGHTS, Assisted suicide, Existential films, SOCIALIST CINEMA (an amalgamation of lists), Feminist lists, various GSSRM lists (aka LGBTQ+), 2010s bests, Visual Effects nominees, kid-related stuff, great animes (mini-serie or feature), very 80s movies, mah huge sci-fi list, ENVIRO, remarkable Silent Films and Pre-Code (exploring 1925 atm) and every shorts and docu list I'm aware of and
/forum.icmforum.com/viewtopic.php?f=1&t=1434
and "Gordon" Liu Chia-Hui/Liu Chia-Liang and Yuen Woo-ping and "Sammo" Hung Kam-bo
imaginary awards | youtube channels | complaint lounge | explain how big a fan of slavery you are here, ..viewtopic.php?f=12&t=1535 and here: ..viewtopic.php?f=12&t=4484
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1883

Post by joachimt »

Help scraping this page needed.

https://app.plex.tv/desktop/#!/media/tv ... categories

This link works without being logged in, right?

Every category has a page with a list of movies. Each movie has a title and a link. I want those two from every category. I thought I could do it with linkclump, but somehow I can't scroll down while holding down my right mouse button. Anyone got an idea?

Once I know how to get all the links and titles, I'll start working on a spreadsheet with IMDb-urls, so I can create an iCM-list of this.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
PeacefulAnarchy
Moderator
Posts: 26145
Joined: May 8th, 2011, 6:00 am
Contact:

#1884

Post by PeacefulAnarchy »

I'm not sure linkclump will work with that many links, I also don't know why you can't scroll down while holding the (left?) mouse button, I can on that page. But in any case, try the End key.
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1885

Post by joachimt »

PeacefulAnarchy wrote: September 13th, 2021, 7:48 pm (left?) mouse button
I've set linkclump on right button + u for urls. I just changed it to left, but I can't scroll down while holding down the u-key. On other sites that's not a problem. When I use the end key, the selection disappears.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
PeacefulAnarchy
Moderator
Posts: 26145
Joined: May 8th, 2011, 6:00 am
Contact:

#1886

Post by PeacefulAnarchy »

Weird.

Can't you do the selection first with the left button and scroll/End, and then press the linkclump buttons? I don't know how linkclump works.

Edit: Oh, I see. Linkclump makes you do a space selection with a box rather the usual sequential highlighting built into the browser. Still not sure why it doesn't let you scroll.
User avatar
monk-time
Posts: 1529
Joined: March 23rd, 2015, 6:00 am
Contact:

#1887

Post by monk-time »

joachimt wrote: September 13th, 2021, 7:36 pm Every category has a page with a list of movies. Each movie has a title and a link. I want those two from every category.
Run this in the browser console after opening any category. I also recommend popping the console into a separate window (a button in the three dot menu) and zooming out on the page to load as many films at once as possible, the site unloads movies that are not near the visible portion of the page so you'll have to run this multiple times per category. Right-click on the results to copy the whole block of text ('Copy message' in Firefox). Chrome doesn't format the output properly and I gotta run so cannot figure out how to fix it there rn, use FF.

Code: Select all

[...document.querySelectorAll('[class^=PosterCardLink-link]')].map(el => [el.href, el.getAttribute('aria-label')].join('\t')).join('\n')
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1888

Post by joachimt »

Can't get that to work. I don't even know where to paste it.
But thanks for the hint on zooming out extremely. Sometimes the solution is so simple. That way I can get the biggest category in two runs. I can continue with this now. Thanks.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1889

Post by joachimt »

joachimt wrote: September 14th, 2021, 11:47 am That way I can get the biggest category in two runs.
Make that five, but this is doable.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1890

Post by joachimt »

Another technical question.

At work I've got 15-200 Excel-files that need to be converted to csv. There are several online tools for that. However, there are two problems with that:
1. All tools I found so far are restricted to 1, 2 or 5 files at a time.
2. The csv's need to be UTF-8 with a semicolon. None of those tools give me the option to choose encoding or separation symbol.

Any idea that doesn't involve VBA or Python or stuff like that?
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
maxwelldeux
Donator
Posts: 9214
Joined: June 7th, 2016, 6:00 am
Location: Seattle-ish, WA, USA
Contact:

#1891

Post by maxwelldeux »

joachimt wrote: September 14th, 2021, 1:40 pm Another technical question.

At work I've got 15-200 Excel-files that need to be converted to csv. There are several online tools for that. However, there are two problems with that:
1. All tools I found so far are restricted to 1, 2 or 5 files at a time.
2. The csv's need to be UTF-8 with a semicolon. None of those tools give me the option to choose encoding or separation symbol.

Any idea that doesn't involve VBA or Python or stuff like that?
Not here. My approach for something like that would be to do it manually, or write a simple function in R or Python to do it for me. Depending on the count. My quick glance didn't turn up anything that addressed your second problem.
User avatar
PeacefulAnarchy
Moderator
Posts: 26145
Joined: May 8th, 2011, 6:00 am
Contact:

#1892

Post by PeacefulAnarchy »

Do you not have access to VBA?
This gives the code you need: https://www.extendoffice.com/documents/ ... o-csv.html
So you wouldn't need to actually write your own code.

Excel uses the separator set in your system (supposedly) so if that is set to semicolon it should work. There's a UTF-8 export option in excel, so you should be able to make the program use that as the format.

For the script above, you'd want to change:
FileFormat:=xlCSV
to
FileFormat:=xlCSVUTF8
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1893

Post by joachimt »

I have access to VBA. I just don't know how to deal with it and I'm not sure if I want to figure it out for this. But thanks for the link, I'll look into it.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1894

Post by joachimt »

This worked pretty easy actually. However it uses a comma instead of a semicolon. When I save a csv normally it’s a semicolon. It doesn’t say in the code it’s using a comma, or at least I can’t find it.

Maybe a comma is good enough for me though, as long as it’s UTF-8.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
Knaldskalle
Moderator
Posts: 10619
Joined: May 9th, 2011, 6:00 am
Location: New Mexico, USA
Contact:

#1895

Post by Knaldskalle »

joachimt wrote: September 15th, 2021, 7:28 am This worked pretty easy actually. However it uses a comma instead of a semicolon. When I save a csv normally it’s a semicolon. It doesn’t say in the code it’s using a comma, or at least I can’t find it.

Maybe a comma is good enough for me though, as long as it’s UTF-8.
It's a regional thing.

Wikipedia:
Semicolons are often used instead of commas in many European locales in order to use the comma as the decimal separator and, possibly, the period as a decimal grouping character. Because of that, the term character-separated values is suggested as a wider definition of this file format.[by whom?]
ImageImageImageImage

Please don't hurt yourself, talk to someone.
User avatar
joachimt
Donator
Posts: 34420
Joined: February 16th, 2012, 7:00 am
Location: Netherlands
Contact:

#1896

Post by joachimt »

Comma wasn't good enough. I'll do it otherwise. I ran into another problem as well. The Excel-files contain a lot of cells with data on multiple rows within one cell, using ALT-ENTER. The csv splits that on separate lines (but as one entry) and the program I need to import it too can't handle that. So I have to do some work on that as well.
ICM-profile
Fergenaprido: "I find your OCD to be adorable, J"
User avatar
PeacefulAnarchy
Moderator
Posts: 26145
Joined: May 8th, 2011, 6:00 am
Contact:

#1897

Post by PeacefulAnarchy »

Converting semicolon to comma can be scripted as a find replace, but I don't know how to deal with ALT-ENTER.
Knaldskalle wrote: September 15th, 2021, 8:06 pm
joachimt wrote: September 15th, 2021, 7:28 am This worked pretty easy actually. However it uses a comma instead of a semicolon. When I save a csv normally it’s a semicolon. It doesn’t say in the code it’s using a comma, or at least I can’t find it.

Maybe a comma is good enough for me though, as long as it’s UTF-8.
It's a regional thing.

Wikipedia:
Semicolons are often used instead of commas in many European locales in order to use the comma as the decimal separator and, possibly, the period as a decimal grouping character. Because of that, the term character-separated values is suggested as a wider definition of this file format.[by whom?]
Yeah, but Joachim's computer is set to use semicolons, so it should have exported that way.
Post Reply