All Hacker News posts dataset on Google BigQuery

[alastairr]

https://console.cloud.google.com/marketplace/product/y-combinator/hacker-news?hl=fr&invt=Abiljw&project=blaze-861a6

[zX41ZdbW]

I have this dataset being updated in ClickHouse in real-time: https://play.clickhouse.com/play?user=play#U0VMRUNUIG1heCh0a...

I also provide a way to export it or attach it to clickhouse-local and analyze it locally: https://github.com/ClickHouse/ClickHouse/issues/29693#issuec...

[alastairr → zX41ZdbW]

this is great, thanks for sharing

[alastairr]

This has appeared on HN a few times before - but it's so useful that it seems worth resharing periodically.

[cranberryturkey]

Is it free to use?

[manx → cranberryturkey]

You can use it for free from kaggle: https://www.kaggle.com/code/felixdietze/hacker-news-score-an...

[alastairr → cranberryturkey]

yes, although there is a paid tier they try to upgrade you to. worth noting that there are some limits on how much data you can export in one go - I found the easiest way was to dump out pieces you need to google drive.

[cranberryturkey → alastairr]

what about their github api?

[alastairr → cranberryturkey]

what about it?