You're correct, but I believe the MP was referring to the fact that any such capital assets (e.g. miners/servers) are being purchased outside of Iceland, so no tax revenue accrues to Iceland (except maybe indirectly in the form of import duties or shipping costs).
...as opposed to any other business? if you're setting up any kind of business[1], chances are most of the capital investments won't be goods from iceland.