Hacker Newsnew | comments | show | ask | jobs | submit login
Ask HN: What is your Big Data Stack
8 points by Rain_maker 983 days ago | 1 comment
If You/Your company are involved in big data , please elaborate on the Stack you are using, your workload, how well does the stack hold against worload.



I don't know if it qualify as "big data", but to fetch, index, classify (meta-data analysis) and rerank daily (6 hours) a set of more than 5 millions medical publications, the stack is simple :

- Glassfish 3 (EJB, JPA, JSF)

- PostgreSQL 9

- Lucene (used as an index and as a NoSQL store)

- hardware: blazing fast SSD and 8GB+ RAM for PostgreSQL

I'm impressed by PostgreSQL, handling without a fuss tables containing more than 60 millions entries (well, I like tuning the DB conf and the ORM, it's usually the best effort/result ratio in devs :)

-----




Applications are open for YC Winter 2016

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | DMCA | Apply to YC | Contact

Search: