Don't worry, I would be immensely impressed if they even finish a pretraining run for a competitive model. Let alone get to the stage of doing any kind of fine tuning for any kind of purpose.
They've cooperated with a research agency known in part for their Prolog implementation, i.e. they've been at it since the last massive "AI" hype cycle.