Our code often involves quantities which have intrinsic errors (like readings from accelerometers or photo-sensors or even just plain data like averages). The probabilistic framework enables us to computer with these kind of quantities that have uncertainties embedded in to them.
Every programmer should read this paper. It's one of the nicely written paper than pretty much anyone can understand.
Nothing wrong with the paper, but the relationship of the paper to the OP seems tenuous. The paper you link is not doing inference, it seems like just sampling. The OP is doing inference using some non-obvious program transformations and MCMC.