Hi all -- Sorry for not updating sooner -- FIFA changed things significantly from 2014 and I had to do a bunch of updating to the scraper to use headless chrome to pull in updates via JS to get all the events working again.
Everything should be working in real time for tomorrow's games. Real time goals, matches marked completed after they are officially over, and an event stream of goals, subs, and cards.
Sorry for delay, hard to scrape data until it actually exists, and besided the 50+ emails I got in the past few months asking me to make it work for 2018, I was the only one making PRs ;)
Should be good to go for tomorrow, please file a github issue if you see any problems.
nope, was just problems with scraping data -- can't scrape data until it exists (FIFA is using a new CMS for World Cup 2018 that uses a fair amount of JS), and I couldn't get all the events that are used to mark a match officially completed.
Should be working now for the next games. First day is always a bit of a mess.
Slightly related: My friends have created https://wcfixtures.football. For some reason they only made it work on mobile. We did a similar one back in 2014 but I was not involved in this one. I imagine they use https://www.football-data.org or scape themselves.
Will update again once I got another API setup for StatsZone when ready.
By the way, how often do you guys need data refresh for? Once I get some feedback I could tweak my app to increase the number of frequency.
Also please do ping me if you want to register your webhooks. My app only supports only one webhook per API at the moment. I will try to get it properly extended so that all your webhooks can get registered.
Nice! I built a World Cup IRC bot back in 2014 but couldn't find a reliable API. In the end I found the only way I could get realtime results was by streaming from the official Twitter page, as they posted live match updates in a (reasonably) predictable format.
I don't see any match related data from StatsZone at the moment, but I have created an API for the world cup related news articles that are being published on the site.
The FIFA API is hard to understand but has all of the info as well. Here's a list of all matches in the group stages; I don't believe the round of 16 matches have been generated yet.
yup, all events and goals should happen in real time starting tomorrow, first day is always a mess because it is a scraper and FIFA is using a new CMS this year. Thought I had it worked, but had to make some sig changes to account for lots of JS.
Events and status changes and goals should all update in realtime now.
I tried loading over HTTPS and got the following error:
This server could not prove that it is
worldcup.sfg.io; its security certificate
is from *.herokuapp.com. This may be
caused by a misconfiguration or an
attacker intercepting your connection.
Kinda unrelated but does anyone know where do Google get the win probability numbers from on the match pages? Is it something scientific or some "social" numbers (like which team is more popular, more searches etc.)
There are definitely other APIs for commercial use that don't rely on scraping but the problem is that they aren't free. Sports data can get very expensive.
2018-06-14T17:00:00.000-05:00
Moscow is GMT+3, and kick-off is 18h local time (i.e. 15h GMT). Not sure what combination of stuff has gone wrong there!