Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I think you are describing something close to the Dataset API in Spark. Spark is built on the RDD, a novel data structure that creates transparent concurrency and distribution. Additionally, you can access the same data with 4 APIs, one of which is SQL, and another which is a typed functional API.

The RDD paper is one of my favorite papers, and is great bed time reading.

https://www.usenix.org/system/files/conference/nsdi12/nsdi12...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: