ftisiot's comments

On: The One Billion Row Challenge

[ftisiot]

Just modified the original post to add the file_fdw. Again, none of the instances (PG or ClickHouse) were optimised for the workload https://ftisiot.net/posts/1brows/

[rustforlinux → ftisiot]

>The result is 44.465s!

Very nice! Is this time for the first run or second? Is there a big difference between the first and second run, please?

[ftisiot → rustforlinux]

first run! I just rerun the experiment: - ~46 secs on the first run - ~22 secs on the following runs

[yencabulator → ftisiot]

Not including this in the benchmark time is cheating:

    \copy TEST(CITY, TEMPERATURE) FROM 'measurements.txt' DELIMITER ';' CSV;

[ftisiot → yencabulator]

The loading time it's included in both examples

In the first one, the table is dropped, recreated, populated and queries. In the second example, the table is created from a file FDW to the CSV file. In both examples the loading time is included in the total time

On: A SOFT methodology to define robust data platforms

[ftisiot]

Making robust and future-proof decisions about your data setup can be complex. The SOFT methodology is here to guide you to the right choices for your needs.

On: Using PostgreSQL JSON functions to navigate review...

[ftisiot]

Parsing semi-structured dataset in a relational database seems scary. Read on for how PostgreSQL® JSON functions allow your SQL queries to work with json and jsonb data.

On: Using Kafka Connect JDBC Source: A PostgreSQL Exam...

[ftisiot]

Integrate Apache Kafka with your existing PostgreSQL Database with Kafka Connect JDBC source connector