Hacker News new | past | comments | ask | show | jobs | submit login
Strategy: Avoid Lots of Little Files (highscalability.com)
8 points by gk1 on Nov 9, 2015 | hide | past | favorite | 2 comments



I think the takeaway here, as with most data problems, is be careful what you are indexing and why/how. What file systems optimize their indices for is not necessarily what your data needs indexed. In this particular example, because (among other reasons) users tend to prefer folders with smaller numbers of files, most operating systems naturally optimize their indices for that use case rather than folders with large numbers of files.


> The problem is a file system isn't a database

Except that, that's exactly what it is.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: