Site
Home / Forum / 3rd Party Projects / Re: [Kodi Add-on] TheSportsDB Kodi TV Scraper

Re: [Kodi Add-on] TheSportsDB Kodi TV Scraper


Posted: 08 Jan 2020 20:17

zag
Posts: 1,558
Joined: Oct 2016

Yes also try with just one event as a test, thats how I got it working eventually. The fake test files should help work it out.

One day I will add custom filenames here (it's on the todo list) but it will still need Kodi scraper support somehow. Perhaps the new Python scrapers will help?

Posted: 08 Jan 2020 23:23

koti
Posts: 7
Joined: Jan 2020



I decided to write a Python script that will process my file name, create the poster and nfo file.

Posted: 09 Jan 2020 11:04

zag
Posts: 1,558
Joined: Oct 2016



I decided to write a Python script that will process my file name, create the poster and nfo file.


If you have any event posters please do upload them to the site, it only takes 1 person to create them and they can then be used going forward for all those events.

Posted: 09 Jan 2020 11:54

koti
Posts: 7
Joined: Jan 2020


If you have any event posters please do upload them to the site, it only takes 1 person to create them and they can then be used going forward for all those events.


I made a script that recognize the teams from file name and than takes a background image, adds to it logos of those teams and saves a new poster.

My goal is to have individual poster for each game with logos of teams that play the game. That makes it easier for me to find the game I'm looking for.

I could do upload those but I'd have to do it each it each time manually.

Posted: 09 Jan 2020 12:22

zag
Posts: 1,558
Joined: Oct 2016



Manually to 1 event yes, but then that graphic can be used in subsequent seasons forever. Its very useful and many users to do this already on the site

Posted: 09 Jan 2020 13:01

koti
Posts: 7
Joined: Jan 2020


Manually to 1 event yes, but then that graphic can be used in subsequent seasons forever. Its very useful and many users to do this already on the site

I like this project very much and I will try to contribute as you described. Thank you for your help and time.

Posted: 11 Jan 2020 20:22

curswine
Posts: 143
Joined: Jan 2017



I made a script that recognize the teams from file name and than takes a background image, adds to it logos of those teams and saves a new poster.

My goal is to have individual poster for each game with logos of teams that play the game. That makes it easier for me to find the game I'm looking for.

I could do upload those but I'd have to do it each it each time manually.



Is the script something you'd be willing to share?

I've been trying to make something similar, but I keep having problems, being able to automate it would really speed up a lot of things.

Posted: 12 Jan 2020 17:30

koti
Posts: 7
Joined: Jan 2020

Is the script something you'd be willing to share?

I've been trying to make something similar, but I keep having problems, being able to automate it would really speed up a lot of things.


Sure, I'll come back with it when I'm done. It's going to recognize sport event out of the filename, rename it to the name TheSportsDB suggest, create poster, Kodi .nfo file and move the file to league folder.

Let me know if you think something else might be useful when processing such files

Posted: 13 Jan 2020 19:36

bry
Posts: 4
Joined: Jan 2020

dumb question.. am I supposed to see any additional information other than the the NHL poster for the series under TV Shows?

Posted: 14 Jan 2020 11:03

zag
Posts: 1,558
Joined: Oct 2016

dumb question.. am I supposed to see any additional information other than the the NHL poster for the series under TV Shows?

Yep But only if that information is filled out on the site.

NHL is a bit of a weird one as there are so many events there is no real point in adding a description for each one. I tend to only add descriptions for motorsports myself. For something like the Stanley Cup playoffs it might be worth it though.

Posted: 14 Jan 2020 12:42

bry
Posts: 4
Joined: Jan 2020



Yep But only if that information is filled out on the site.

NHL is a bit of a weird one as there are so many events there is no real point in adding a description for each one. I tend to only add descriptions for motorsports myself. For something like the Stanley Cup playoffs it might be worth it though.

Zag, can I send you all the NFOs for 2019-2020 rangers season for you to process and add? or maybe create a way for me to upload nfo's to be processed?

Posted: 14 Jan 2020 13:12

zag
Posts: 1,558
Joined: Oct 2016

Cool yeh send them over to [email protected]

You can always just copy and paste the data into each event. Should be pretty quick.

Just click the "Edit Event" button on the event page.

Posted: 14 Jan 2020 14:19

bry
Posts: 4
Joined: Jan 2020

Cool yeh send them over to [email protected]

You can always just copy and paste the data into each event. Should be pretty quick.

Just click the "Edit Event" button on the event page.


sent

Posted: 14 Jan 2020 15:27

zag
Posts: 1,558
Joined: Oct 2016

Cool I added a few plot >> descriptions for you.

Example here:

https://www.thesportsdb.com/event/624378

It should be pickled up by the scraper as well as the event thumb or poster.

I didn't do them all, you can do that yourself

Posted: 28 Sep 2020 16:30
htpcmac2
Posts: 12
Joined: 2020-09-28

I've been trying to get this indexer to read UFC fights. I could never get it to work. I seen a updatedl/modified add-on on the Kodi forums that indexes SOME events but not all, in fact it just indexed the two most recent, and nothing else.

When I try to modify the filename I get an error that the file name has illegal characters. I can edit the name without error within Kodi but it still does not index the event. I noticed that some events that are not indexing don't have descriptions, would that matter?

Edit: Ok it is most definitely the : character in the filenames. Why is that there? Windows, OSX, and linux don't like it.

zag
Posted: 28 Sep 2020 18:55

zag
Posts: 3,327
Joined: 2020-03-23

I've been trying to get this indexer to read UFC fights. I could never get it to work. I seen a updatedl/modified add-on on the Kodi forums that indexes SOME events but not all, in fact it just indexed the two most recent, and nothing else.

When I try to modify the filename I get an error that the file name has illegal characters. I can edit the name without error within Kodi but it still does not index the event. I noticed that some events that are not indexing don't have descriptions, would that matter?

Edit: Ok it is most definitely the : character in the filenames. Why is that there? Windows, OSX, and linux don't like it.


Yes that needs to go, I can fix that and prevent it in the future... Any examples of the illegal character in the event names you can give me?

EDIT: Looks like it was only a few recent events that had used the : character. I've fixed those and prevented them being used in event names going forward. Let me know if you find any more.

Posted: 28 Sep 2020 19:42
htpcmac2
Posts: 12
Joined: 2020-09-28

It appears than any of the main series fights (250,251, etc) have the :. The Fight Night ones don't. Even then Fight Night 176 does not index for me. Nothing before 177 indexes in fact.

Posted: 28 Sep 2020 20:34
htpcmac2
Posts: 12
Joined: 2020-09-28

https://www.thesportsdb.com/event/1038483

This one has the : as well.

Posted: 28 Sep 2020 20:39
curswine
Posts: 865
Joined: 2020-06-17

It appears than any of the main series fights (250,251, etc) have the :. The Fight Night ones don't. Even then Fight Night 176 does not index for me. Nothing before 177 indexes in fact.

I'm gonna say it's because the UTC date and local date are on different days and the scraper doesn't handle that well.

Posted: 28 Sep 2020 20:52

zag
Posts: 3,327
Joined: 2020-03-23

Might be yeh... Always trust the UTC date.

Also check the round numbers, I think the scraper uses those as well as the episode number. If they are missing just update the round for the event on our site. Fighting events need to be sequential.

Posted: 28 Sep 2020 21:53
htpcmac2
Posts: 12
Joined: 2020-09-28

It appears than any of the main series fights (250,251, etc) have the :. The Fight Night ones don't. Even then Fight Night 176 does not index for me. Nothing before 177 indexes in fact.

I'm gonna say it's because the UTC date and local date are on different days and the scraper doesn't handle that well.

I see. I will test that. That fixed it. Thank you.

Posted: 16 Mar 2021 01:30
htpcmac
Posts: 1
Joined: 2020-08-22

Scraper grabs poster as if it were a TV Show. UFC is unique in that is has posters per event, rather than just one for the entire show. Is there anyway for the scraper to grab the poster PER 'episode/event'? When I manage art (in kodi) it does not scrape the poster.

Posted: 18 Mar 2021 19:17

zag
Posts: 3,327
Joined: 2020-03-23

Scraper grabs poster as if it were a TV Show. UFC is unique in that is has posters per event, rather than just one for the entire show. Is there anyway for the scraper to grab the poster PER 'episode/event'? When I manage art (in kodi) it does not scrape the poster.

I think it only does Thumbs, but the artwork should be good for UFC in that case.

Posted: 19 Apr 2022 21:24

zag
Posts: 3,327
Joined: 2020-03-23

Today I fixed the eventseason api method which was limited to 1,500 events. This meant that only recent events would scrape with leagues that have lots of episodes. I have made it unlimited.

I also reduced the size of the returned data by 90% which means that the scraper should be a lot faster.

I will do some more testing tomorrow as various new issues came up such as episode descriptions being cut off when it finds a /r or /n newline json encoding. I have an idea how to fix it but will need some testing.

Posted: 26 Apr 2022 16:08

zag
Posts: 3,327
Joined: 2020-03-23

Lots of fixes in the latest version. Still more to do but its finally in a usable state I believe.

- Update settings format to latest kodi structure
- Updated strings.xml to strings.po to match latest kodi recomendation
- Fixed episode description cutting off at first line break
- Fixed episode thumbnail

https://github.com/zag2me/metadata.thesportsdb.com/archive/refs/heads/master.zip


Who is Online?

In total there are 68 users online :: 3 registered, 0 hidden and 65 guests (based on users active over the past 5 minutes) Most users ever online was 424 on Fri Nov 10, 2017 9:02 pm

About Us

Discussion forum for TheSportsDB.com site and related topics

Rules

- Be Polite
- Respect other users
- Always post log files with issues
- Try to be helpful
- No Piracy discussion

Showing 17 to 42 (Total: 43)