> We use Redshift to store data. As user events are happening, our relational da... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

diceduckmonk on Oct 25, 2022 | parent | context | favorite | on: How to maintain engineering velocity as you scale

> We use Redshift to store data. As user events are happening, our relational database (MySQL) replicates them in Redshift. Within minutes, the data is available for queries and reports.

Is data engineering really this simple?

Fiahil on Oct 25, 2022 [–]

No, making the data available is only the tip of the iceberg.

Next in line is how to version your data so you can create consistent "snapshots" at given point in time with no leakages.

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact