The work we describe here is our research prototype, I'm currently working towards making the code base more stable before open sourcing. The plan is to release the code over the coming months.
AFAIK only OpenCL 1.1 (or 1.2?) is available on nvidia though, not OpenCL 2.0 or 2.1. So, unfortunately, if you want to support nvidia (eg AWS GPU instances), then OpenCL may not be the best choice :-(
The JDK is getting support for GPGPU via Truffle/Graal http://www.oracle.com/technetwork/java/jvmls2913wuerth-20139...