Yes, of course. I took off indoor in loiter mode using optical flow sensor.
If you use mission planner to connect and check the health of the drone, you should see ekf IMUx is using optical flow message something like that. When you see that, you are good to takeoff in loiter mode.
Why is your EK3_SRC1_YAW 0 and not 1?