resurrected's comments

On: File Systems Unfit as Distributed Storage Back Ends (2019)

[resurrected]

Noooo, really?

It all depends on what you want to do. For things that are already in files like all that data that DeepSeek and other models train on and for which DS open sourced their own distributed file system, it makes sense to go with a distributed file system.

For OLTP you need a database with appropriate isolation levels.

I know someone will build a distributed file system on top of FoundationDB if they haven’t yet.

[_zoltan_ → resurrected]

~2006 I've built a fuse fs that used mysql as a backend, kept all file hashes (not blocks, just whole files) and did deduplication. good old times.

[jeffrallen → resurrected]

They have, at Exoscale. My officemate leads the team doing it.

[darkstar_16 → resurrected]

Isn't the Cassandra file system something like that ?

[AtlasBarfed → resurrected]

They did it atop Cassandra.

[EGreg → resurrected]

Just use hypercore with hyperdrive. And be free!