Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Well, I guess that is the power of it being so general purpose. I have used Spark more for analytics (and Spark SQL) but not extensively for ETL. What you're saying makes sense, you're still using Spark as an execution/computation engine, just writing the plumbing code to use it like an intermediary ETL tool.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: