Hacker News new | comments | show | ask | jobs | submit login
Show HN: Connect Pub/Sub to BigQuery with an open source Dataflow pipeline (github.com)
44 points by homosaphien 10 months ago | hide | past | web | favorite | 2 comments



Very cool! I like how configurable your solution is.

Google has an example app (https://github.com/GoogleCloudPlatform/kubernetes-bigquery-p...) that demonstrates getting Pub/Sub data into BigQuery, but it just does it directly as a little Kubernetes job rather than using Dataflow. I like your more serverless solution.


Thank you for the feedback.




Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact

Search: