I wonder whether you can fix this by using the positional tracking they developed for Augmented Reality (ARkit). If your device is moving, even a little, and the thing you are looking for is stationary, it should be possible to figure out exactly where it is.
