This is typically the result of reversing RC transmitter channels to make MANUAL mode behave as you expect without regard for autopilot assisted modes.
Instead, leave the RC channels at their defaults and use SERVOx_REVERSED for the throttle channel(s). Confirm this is correct by putting the vehicle on jack stands and using Mission Planner’s motor test feature.