On: Announcing Apache Spark 1.4

[threeseed]

JDBC works great if you have a large RDD that you want to persist in one go.

But if you are writing row by row you will need to implement your own batching algorithm and connection pooling to get any decent performance.

[gglanzani → threeseed]

You could always use mapPartition to open one connection per partition.