You are on default parameters and should not have left the ground and are running old firmware. In this order:
- Update to latest Stable version.
- Go here and get to work The Configurator
- Don’t make another flight until this craft is properly configured unless you want to continue crashing.
For future reference. You were flying in Stabilize mode the entire time. There is no expectation of holding position and you have full control of altitude with the throttle. So what you are reporting is normal for this mode, you just need more practice.