How can you tell if you are exactly at the North Pole and not a few miles away from it?

You would need to take many 'sightings' of stars above your horizon at accurately times moments and compute your latitudes from their know coordinates. Because a shift of one mile causes an angular shift of about 8 arcseconds, you need to make your measurements with an accurate theodolite, not a hand-held sextant.