DBSP: Automatic Incremental View Maintenance for Rich Query Languages [pdf]

[luu]

https://www.feldera.com/assets/files/vldb23-1bfe30b29f95168c8e1f427fccfc6da2.pdf

[matlin]

The idea of representing a view over a stream with a type of circuit diagram is really neat and seems like the big unlock here.

Makes me wonder if you could create a toy implementation in a reactive stream library like RxJS but one that is glitch-free[1]. I'll have to give this a try in our Typescript database we're developing that has basic incremental view maintenance currently.

[1] https://en.wikipedia.org/wiki/Reactive_programming#Glitches

[rrwright → matlin]

https://quine.io does that with a graph and reactive streams under the hood.

[convolvatron → matlin]

it also really nicely provides a dual between the differential and the integrated graphs.

and also check out the sections on grouping and aggregation. this is a place where datalog implementations often fall down

[rajnathani]

Interesting to see Materialize’s founder Frank McSherry as an author here.