I’ve been able to get it to work on Buster using the instructions in this thread: How to guide: Mission Planner on Raspberry Pi but I’ve not had any luck with Bullseye. On Bullseye I’ve started using MavProxy, and not surprising but MavProxy works really well on a Pi.
I’ve never tried the joystick so can’t say if that works one way or the other.