Loiter Stability

Out flying today in reasonably gusty wind about 20 kph.In Stabilise mode the copter sits well in the wind but when I switch to loiter it appears to move around a lot more and unstable. The copter is holding position well but the arms appear to be up and down around a lot more than in stabilise.
Is this possible or all in my head.

I have a question about the default altitude. Is there any default altitude? As today I was testing my copter with APM 2.6 on board using the HC-05 for communication between GCS and the Copter. It hit the roof and tear itself into pieces. I know I shouldn’t have done this indoor. But still I would like to know if I can set a default altitude in DroidPlanner or Mission Planner?