If the routers are wireless there could be other factors that change the latency between them. Maybe during certain times of day there is more electromagnetic interference in the area which would affect the latency. As for determining distance through the internet, this also would be impossible to ...