Site
Home / Forum / General Discussion / The use of teams in UFC event nfos

The use of teams in UFC event nfos


Posted: 25 Nov 2024 15:54
htpcmac2

Posts: 52
Joined: 2020

What is the point of including the team in UFC event nfos? There are, what I call placeholder,s that have UFC Mens, and UFC Women as teams listed in the nfo. This is the most pointless metadata I have ever seen. It is not that hard to see what team a person would be on.
The reason why I ask why it is included is that when I scrape the event in kodi and look up cast all I see is UFC Mens and UFC Womens as cast. Clicking them does practically nothing. Whereas nfos that have the fighters names in them allow me to see all events that that person fought it (if the metadata supports it)

I was editing in some fighters to UFC events but it was incrediblity tedious as the database does not have every fighter and I practically have to create the metadata on a fight by fight bases rather than event by event. (maybe you can dump all know UFC Fighters into your db somehow)

Posted: 25 Nov 2024 22:56

Ovokx

Posts: 1,771
Joined: 2020

Since a while, UFC teams were changed to indicate weight class fight

zag
Posted: 25 Nov 2024 23:38

zag


Posts: 3,556
Joined: 2020

If anyone has a list of fighters in csv format then I could certainly import. They would need dates of birth though.

I agree it's tedious but once the fighters are added we can add results and events pretty quickly.

It definitely needs work but it only takes one person to sit down for a few days and add them all, I did exactly that for cycling recently.

As for teams, it has to have them to fit the structure of the site, but it's much nicer now we have weight classes.

Posted: 26 Nov 2024 05:15
htpcmac2

Posts: 52
Joined: 2020

If anyone has a list of fighters in csv format then I could certainly import. They would need dates of birth though.

I agree it's tedious but once the fighters are added we can add results and events pretty quickly.

It definitely needs work but it only takes one person to sit down for a few days and add them all, I did exactly that for cycling recently.

As for teams, it has to have them to fit the structure of the site, but it's much nicer now we have weight classes.

What about this CSV:
https://github.com/sagi778/UFC-Data-Extractor/blob/main/data/ufc_fighters_stats.csv

I have a suggestion for 'teams' for MMA is to display their Affiliation as a Team. Like Team Burns or Tiger Muay Thai.


zag
Posted: 26 Nov 2024 07:42
curswine


Posts: 947
Joined: 2020

If anyone has a list of fighters in csv format then I could certainly import. They would need dates of birth though.

I agree it's tedious but once the fighters are added we can add results and events pretty quickly.

It definitely needs work but it only takes one person to sit down for a few days and add them all, I did exactly that for cycling recently.

As for teams, it has to have them to fit the structure of the site, but it's much nicer now we have weight classes.
What about this CSV:
https://github.com/sagi778/UFC-Data-Extractor/blob/main/data/ufc_fighters_stats.csv

I have a suggestion for 'teams' for MMA is to display their Affiliation as a Team. Like Team Burns or Tiger Muay Thai.


Doesn't have nationality data, at the bare minimum the data should be able to complete the `add player` form.

Also as Ovokx stated the `teams` have been updated to show the weight division.

I agree it is pointless, but zag is very insistent on every sport being the same so you're going to get a lot of round pegs in square holes across the site.


zag
Posted: 26 Nov 2024 11:01

zag


Posts: 3,556
Joined: 2020

What about this CSV:
https://github.com/sagi778/UFC-Data-Extractor/blob/main/data/ufc_fighters_stats.csv


4,000 fighters!!

That's a great start!

But yes just missing nationality. I could import with them all as United States nationality perhaps, will have a think if its worth it...

I'll see if I can do some processing.

Posted: 26 Nov 2024 13:37
htpcmac2

Posts: 52
Joined: 2020

What about this CSV:
https://github.com/sagi778/UFC-Data-Extractor/blob/main/data/ufc_fighters_stats.csv


4,000 fighters!!

That's a great start!

But yes just missing nationality. I could import with them all as United States nationality perhaps, will have a think if its worth it...

I'll see if I can do some processing.

With that amount of atheletes maybe edit to system for editing an event to limit to atheletes to that sport? That drop down is long enough!


Posted: 26 Nov 2024 15:49

zag


Posts: 3,556
Joined: 2020

OK so I've managed to import about 3,500 fighters with Date of birth, height, weight, nationality.

I've put them all in the retired category for now but please do move them out and back into their respective promotions if they are still active. You can find them all here, all will need artwork and details added where possible.

https://www.thesportsdb.com/team/147369-_Retired-Fighting

I'll have a look at the long list thing, there might be something I can do like other areas of the site with long lists.



Posted: 26 Nov 2024 16:57
htpcmac2

Posts: 52
Joined: 2020

OK so I've managed to import about 3,500 fighters with Date of birth, height, weight, nationality.

I've put them all in the retired category for now but please do move them out and back into their respective promotions if they are still active. You can find them all here, all will need artwork and details added where possible.

https://www.thesportsdb.com/team/147369-_Retired-Fighting

I'll have a look at the long list thing, there might be something I can do like other areas of the site with long lists.


Hold, I am maybe be able to get the data you want in a csv.

https://ibb.co/n6H7ZQY
Is that better? I can tweet the data. Imperial/metric, birthday format. I have a Nationality2 for 'Fighting out of' as sometimes that is different.

zag
Posted: 26 Nov 2024 22:00

zag


Posts: 3,556
Joined: 2020

Nice, I can use that to check and cross reference the import.

This is also useful I think:

https://en.wikipedia.org/wiki/List_of_current_UFC_fighters

Posted: 27 Nov 2024 05:40
htpcmac2

Posts: 52
Joined: 2020

Nice, I can use that to check and cross reference the import.

This is also useful I think:

https://en.wikipedia.org/wiki/List_of_current_UFC_fighters

Ok, let me update that csv I linked so that the name field is constant but the other fields are replaced with the metadata in my screenshot. Theoretically that should just update the added 'retired' fighters data ?

Here is what it will look like:
https://ibb.co/dtxJ7Sr
I would need to clean up the Nationality field for inconsistencies after the merge.

Edit 1:Ok I went into scrape all the data mode. I ammended the csv format to scrape wikipedia and add, stance, style, nickname, and reach.

New Frankenstein's monster format:
https://ibb.co/0hF8H09

Is that ok? I extrapolated the Nationality from the Country name then because that is how I thought you had it stored, but it turns out you have country instead of nationality. Ughh

Edit 2: Ok looking at the fighter info you can edit you have Team and Team Secondary. The Team Field in my data can be Team Secondary, and I'll change Team to be the weight division from Wikipedia. How does this site handle fighters that changed weight classes? You keep only the current class? Should I use wizardry and calculate the weight class by their listed weight?

If I keep adding things I will never get a full list but at least it will be complete!

zag
Posted: 27 Nov 2024 14:20

zag


Posts: 3,556
Joined: 2020

Brilliant, I have imported another 2,000 UFC fighters using this and other data posted on discord.

I've run through adding a few results to events and most fighters existed already so was simple to select them!

Nice work everyone! Now to add artwork and deions to them all

Posted: 27 Nov 2024 14:36
htpcmac2

Posts: 52
Joined: 2020

Brilliant, I have imported another 2,000 UFC fighters using this and other data posted on discord.

I've run through adding a few results to events and most fighters existed already so was simple to select them!

Nice work everyone! Now to add artwork and deions to them all

I am still building the csv file, sorry (currently it is on line 2330 of that csv so halfway done!). But, it uses the same exact names list as the csv i linked so the update csv should just be filling data for the same CSV.

Look at the data in Edit Profile for a Player this is the only data I am not including (other than the stuff that is not relevent to a UFC fighter) are:
Facebook, Instagram,ethnicity (hard to scrape that), and gender (my 4am edit to determine gender failed and that column needs to get scrapped)

Now Why were we doing this?
1) Having a complet list of atheletes
2) Having fighters to add to the fight results

Which brings us back to the start! With that CSV I linkd to you (not mine, just did an ddg search for "ufc fighters csv" and found it. There are other data sources on that could help.

https://github.com/sagi778/UFC-Data-Extractor/blob/main/data/ufc_matches_stats.csv
Since this uses from the same source as the other CSV we can assume that the name in CSV file 1 link to CSV file 2 (it pulls the fighter and results from ufcstats). We can Import the list of results and internet magic would point to the correct player/athelete in your database of retired fighters, no?

I can blast that csv with wizardly to be make it easier to import.

ALSO! I included a Field for Wikipedia link, if found, hopefully a link is enough to fill out the wikipedia blob. And as a 5am bonus a link to the image that wikipedia uses.

I will let you know when the csv is done though.

Edit 1: Ok looking at that other csv we have this to work with (sorry for. the spoilers)
https://ibb.co/r2HQTDv
Ok first column: win (unless draw/dq) so it can assume Field 2 is the Winner and Field 3 is the loser. Simple!
You don't need the fight stats, weight class maybe, method and type would have to be converted.
Time and round is pretty straight forward.
Date 'could' match the event or it could not (the infamous issue with the international date line and today vs yesterday that plagues a lot of entries)
There is only missing data that is important… the event! We have the data to wark with an link to UFC Stats.

So he is what I can offer on that , strip out the fight stats, convert method and type to something you use, and use some QnD python wizardry to check that ufcstats link and get the UFC event name.

Seem something you'd want or use?

Posted: 27 Nov 2024 14:41

zag


Posts: 3,556
Joined: 2020

Great yes its still a work in progress, any more csv's are good

Posted: 27 Nov 2024 14:55
htpcmac2

Posts: 52
Joined: 2020

Great yes its still a work in progress, any more csv's are good
Might as well but me edit here since you are here

Edit 1: Ok looking at that other csv we have this to work with (sorry for. the spoilers)
https://ibb.co/r2HQTDv
Ok first column: win (unless draw/dq) so it can assume Field 2 is the Winner and Field 3 is the loser. Simple!
You don't need the fight stats, weight class maybe, method and type would have to be converted.
Time and round is pretty straight forward.
Date 'could' match the event or it could not (the infamous issue with the international date line and today vs yesterday that plagues a lot of entries)
There is only missing data that is important… the event! We have the data to wark with an link to UFC Stats.

So he is what I can offer on that , strip out the fight stats, convert method and type to something you use, and use some QnD python wizardry to check that ufcstats link and get the UFC event name.

Seem something you'd want or use?

Edit: Ok tiny complication that is easily solved. The ufcstats link have en event name that does not match your database, and it is incomplete (they use UFC Fight Night Bob vs Rob, where as you have UFC on ESPN 34 Bob vs Rob). I could use the supplied data in the csv to fuzzy match +- one day to your database event and write that data in the csv using your event name
-OR-
Do you want to dump these in individual csv for each event?

Edit 2: I messed up one of your events testing something!! https://www.thesportsdb.com/event/1803751-UFC-on-ESPN-44-Holloway-vs-Allen Remove fight 50. I was seeing if you stored method, round or time. You don't. Can either drop those fields are add that data to the site!

Posted: 27 Nov 2024 16:44
htpcmac2

Posts: 52
Joined: 2020

Progress update:
https://ibb.co/30VztBn

Next step:
1) fuzzy match the Event Name to your database and use your event name as canonical event.
2) 'count' the fighters for each event and assign a fight number to the csv in the same manny that you have. It seems like ufcstats list the fights as per the fight card so a simple count should work.

I'll let that run and I'll take my dog for a nice long hike!

Edit (what would my post be without an edit?): I could also output each event to its separate CSV with the complete metadata, including the fight result list

Posted: 27 Nov 2024 19:05
htpcmac2

Posts: 52
Joined: 2020

Progress update:
https://ibb.co/30VztBn

Next step:
1) fuzzy match the Event Name to your database and use your event name as canonical event.
2) 'count' the fighters for each event and assign a fight number to the csv in the same manny that you have. It seems like ufcstats list the fights as per the fight card so a simple count should work.

I'll let that run and I'll take my dog for a nice long hike!

zag
Posted: 27 Nov 2024 22:11
htpcmac2

Posts: 52
Joined: 2020

I am having an issue matching the event in the csv to your api
I keep getting no results.
https://www.thesportsdb.com/api/v1/json/3/searchevents.php?e=Holloway%20vs%20Allen
for example and not getting any results.
The event csv is done processing, other than that fuzzy matching.:

https://ibb.co/8jYHDkp

Posted: 28 Nov 2024 00:08
htpcmac2

Posts: 52
Joined: 2020

How do I send you these files.
I don't have a discord nor do I want one.
I went to the invite link and it wants my e-mail… fat chance.
There was nothing wrong with mIRC don't know why zoomers invented discord… but they should apologize

Posted: 28 Nov 2024 08:46

zag


Posts: 3,556
Joined: 2020

How do I send you these files.
I don't have a discord nor do I want one.
I went to the invite link and it wants my e-mail… fat chance.
There was nothing wrong with mIRC don't know why zoomers invented discord… but they should apologize


haha MIRC was amazing, but yeh we love discord these days but its just for chat.

Just host the csv on any pastebin thing

https://pastebin.com/

Posted: 28 Nov 2024 13:31
htpcmac2

Posts: 52
Joined: 2020

How do I send you these files.
I don't have a discord nor do I want one.
I went to the invite link and it wants my e-mail… fat chance.
There was nothing wrong with mIRC don't know why zoomers invented discord… but they should apologize

haha MIRC was amazing, but yeh we love discord these days but its just for chat.

Just host the csv on any pastebin thing

https://pastebin.com/

Way too big for that.
It sent you link to it on your kodi forum account.

Posted: 28 Nov 2024 13:31

zag


Posts: 3,556
Joined: 2020

I've just done a massive image import, 1,800 cutouts and renders imported for UFC fighters.

Posted: 28 Nov 2024 13:51
htpcmac2

Posts: 52
Joined: 2020

How do I send you these files.
I don't have a discord nor do I want one.
I went to the invite link and it wants my e-mail… fat chance.
There was nothing wrong with mIRC don't know why zoomers invented discord… but they should apologize

haha MIRC was amazing, but yeh we love discord these days but its just for chat.

Just host the csv on any pastebin thing

https://pastebin.com/

Way too big for that.
It sent you link to it on your kodi forum account.

Or here:
Fighters:
https://www.dropbox.com/scl/fi/gi3cansg7vhmu339o7frn/ufc-events_adjusted_decision.csv?rlkey=vrvdvvf2p963hltqtfga4hwph&dl=0
Events:
https://www.dropbox.com/s/c0bccobn8zfzlw0/UFC_Event_full.csv?dl=0

It seems that event csv has not been updated since 2023, but it appears to be something we can run and get up to date results. Then again, the most complete metadata you have for UFC is newest events.

zag
Posted: 28 Nov 2024 20:24

zag


Posts: 3,556
Joined: 2020

Very nice, there is some data there that I was missing and the event stuff I haven't even started on.

Looking forward to trying to import this tomorrow

Posted: 28 Nov 2024 20:45
htpcmac2

Posts: 52
Joined: 2020

Very nice, there is some data there that I was missing and the event stuff I haven't even started on.

Looking forward to trying to import this tomorrow

I was just trying to fill in missing information that your database already uses. If you want more metadata for future let me know so I can include it.

I'm trying to fill in some blanks on my csv for the fighters.

Now, for your character art… is that done by hand? Maybe some kind of image ai can make cutouts. I don't know anything about that.

Edit: To clarify the metrics I used for the Method Table. These are the only acceptable outcomes for a fight, as far as I know.

Majority Decision: Two judges score one fighter as the winner, while the third judge scores it a draw.
Major Decision: Two judges score one fighter as the winner, while the third judge scores for the opponent (but not a unanimous win).
Split Decision: Two judges score one fighter as the winner, and the third judge scores for the opponent.
Unanimous Decision: All three judges score the same fighter as the winner.
Majority Draw: Two judges score the fight as a draw, while the third judge scores for one fighter.
Split Draw: One judge scores for one fighter, another for the opponent, and the third judge scores a draw.
Unanimous Draw: All three judges score the fight as a draw. (only happened 4 times in this data set)
No Contest: The fight is stopped due to unforeseen circumstances (e.g., illegal strike, accidental injury, or an event beyond the control of the fighters) and no winner is declared.
Disqualification (DQ): A fighter is disqualified for violating the rules (e.g., illegal strikes, unsportsmanlike conduct, or not following instructions from the referee), and the opponent is declared the winner.

Edit 2: I swear I added all the event_ids but some show up as not found… probably saved it somewhere else. The events are sequential for the most part, should be easy to fill in the missing numbers

zag

Who is Online?

In total there are 68 users online :: 3 registered, 0 hidden and 65 guests (based on users active over the past 5 minutes) Most users ever online was 424 on Fri Nov 10, 2017 9:02 pm

About Us

Discussion forum for TheSportsDB.com site and related topics

Rules

- Be Polite
- Respect other users
- Always post log files with issues
- Try to be helpful
- No Piracy discussion

Showing 0 to 25 (Total: 49)