IO is pretty huge as well. You can spend lots and lots and lots of money to buy ...

brianwawok on Sept 1, 2016 | parent | context | favorite | on: Apache Spark Scale: A 60 TB+ production use case

IO is pretty huge as well. You can spend lots and lots and lots of money to buy 1 machine a hard drive that can read 60 TB fast. Or you can have 100 machines with the cheapest possible hard drive and smoke the total IO.