Interesting! However, it's important to note that S3 Select isn't ideal for handling large-scale data scans, as this can lead to exorbitant costs. In contrast, Databend(https://github.com/datafuselabs/databend) utilizes S3 primarily for storage purposes. Key functionalities like bloom filter indexing, min-max indexing, aggregating indexing, join reordering, and filter pushdown are all managed within the query layer. This approach optimizes performance and cost-efficiency, particularly when dealing with substantial amounts of data.
