That nice benchmark shows that multiple implementations of HNSW perform differently (my experience also). It would be helpful therefore if HANN benchmarked its implementation against the others, and tried to get the details the same as the best version.
So fixing to make it compile just with the Go toolchain (probably by rewriting in assembly) seems doable.
Using avo to produce assembly: https://github.com/mmcloughlin/avo