On: Polars 2.0

[Kinrany]

How does Polars relate to DataFusion these days? There's no reason for them not to converge into a single ecosystem, is there?

[esafak → Kinrany]

It does not use datafusion. https://github.com/pola-rs/polars/issues/6197

[Kinrany → esafak]

Yes, but why?

I mean, it's very clear that the projects have a lot in common, even if building one on top of another directly is not a good idea.

[esafak → Kinrany]

In the issue, polars' creator says it is to reduce dependencies:

   I don't want polars to depend on on the datafusion crate, that is a complexity that is not needed.

[Kinrany → esafak]

Right, that doesn't explain much. What are the features that datafusion needs but polars doesn't?