They're not GPUs in computers... they're effectively GPUs that are computers. They're a single board computer (SBC), with an ARM CPU that is approximately the scale for desktop but not the scale for enterprise, conjoined with 2 extremely large GPUs that are siblings to the desktop version.
Each GPU chip is approximately twice the size of the biggest desktop version, and it has two of them, and it roughly twice as dense as anything else you could do using normal enterprise-dense GPU deployments (ie, those rigs that have 4 x16 slots and fit dual-slot GPUs across 8 slots)
However, these are not the same chips, they are siblings: the major change is, depending on the generation, they contain 2x or 4x matrix math ALUs and no texture units.
Seeing as it is a "small" (for enterprise) CPU, and a GPU that is very poor at non-matrix GPU tasks; and since it doesn't have TUs or media controllers (thats the thing that does DP/HDMI and video decoding/encoding) it can't be some weird niche desktop.
Unless you're doing inference at home, this thing is useless. Inference at home, and even small scale enterprise inference, is very very niche. There isn't enough market to give these boards a second chance.
However, totally normal used server parts? Totally useful. Cases, fans, power supplies, motherboards, CPUs, RAM, HBA/RAID, NICs? All useful to end users, either smaller companies doing inexpensive onsite, smaller datacenters maintaining an existing fleet and not needing to upgrade yet, or people building home labs.
It's very rare that you'll be at the exact point where it does make sense to use the "not quite high-power GPU racks".
* Lowest short term costs favors "just use the Cloud" solutions, that will often have power, HVAC and space constraints that favors new GPUs.
* Lowest long term costs bias the cost analysis to OPEX, where old GPUs gets expensive very fast, as they use more power, HVAC and space for less compute.
> It's literally garbage the moment it leaves the factory.
Sorry I'm new to this, can you explain how? Why would high-power GPU racks not have good resale value?