Similarly, see Matei Zaharia's (the original Spark lead) and his team at MIT (he's now at Stanford) SIGMOD 2018 paper called MISTIQUE ...
 Joe Hellerstein https://github.com/jhellerstein
 Berkeley RISELab https://rise.cs.berkeley.edu https://github.com/ucbrise
 Fluent Compute Platform https://github.com/fluent-project/fluent
 Anna: A Crazy Fast, Super-Scalable, Flexibly Consistent KVS https://databeta.wordpress.com/2018/03/09/anna-kvs/ Discussion: https://news.ycombinator.com/item?id=16551072
 MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis