The sentence before says the systems are interconnected with 200 gigabit Infiniband.
So they aren't talking about the number of cores in a single system, but rather in a cluster that has a high speed and low latency interconnect.
> Socket Direct technology is enabled by a main card housing the ConnectX-6
and an auxiliary PCIe card bringing in the remaining PCIe lanes. The
ConnectX-6 Socket Direct card is installed into two PCIe x16 slots and
connected using a 350mm long harness
How often do companies band together x16 links? What else benefits from it?