Loitering on APM 2.6 problem

When I put my drone which has a APM 2.6 and GPS + compass module in loitering mode it doesn’t keep it’s position but it hovers over a small area, any help?