Mission Planner Live Video support


I think many users may not know that Mission Planner has two methods for showing live video and both are documented on this live-video wiki page.

The first method is where the video is displayed in place of the HUD. This method has been around since the very early days of the project and makes sense for cases where the camera is hard mounted on the nose of the vehicle. It makes less sense for today’s 3-axis modern camera gimbals… which is why @robertlong13 has added a new custom camera gimbal control screen which can be pulled up by right-mouse-button-clicking on the map and selecting “Gimbal Video”.

One slightly hurdle for potential users is that the autopilot should run the the video-stream-information.lua script which is also documented on the live-video wiki page. Still, maybe we can reduce need for this hurdle in the future.

Thanks very much to Siyi for their support in providing the hardware for this project!

In any case, any and all feedback is greatly appreciated!

9 Likes

I was just having a go at using an IP cam, and I had no idea we could display video anyplace other than the HUD.

Probably not the specific feedback you’re looking for, as it’s not a supported gimbal camera, but being able to move the video stream around the screen between HUD, map, and mini-map is excellent!

3 Likes

Hi @rmackay9

i have tried this feature on viewpro Gimbal and CUAV X7+ FC.
loaded Lua scriot on the Sd card and enabled necessary parameters related to VID1.

Gimbal connected to FC via serial port2 and configured as mavlink.everthing configured correctly but still getting Prearm scripting error and video stream is not detected automatically.
by copying the Gstreamer Pipeline video streaming works normally.

here is the onboard log file: Video Stream information.bin - Google Drive

1 Like

Hi @kalai1219,

Thanks very much for testing!

Sorry, I see now that I never mentioned that the vehicle must be running AP 4.6. I’ll add this to the wiki. AP-4.6 is quite stable now though so if you’d be willing to give that a try as a test that would be a great help!

Thanks for the feedback @rmackay9

i have tried out the same procedure with AP 4.6.0 beta6 but still same result no auto video detected. i have manually pasted Gstreamer Pipeline link then video streaming diaplayed.

but still the keyboard control also not working. i have closed mission planner to have retry to get autodetect of the video stream by Lua scirpt but its not happening.

Hi @kalai1219,

Ah, the issue must be that CAM1_TYPE = 0. Are you using one of the AP supported camera gimbals or perhaps something else?

I’ll add a check to the script to make it easier for people to figure out what’s gone wrong, thanks!

Thanks @rmackay9
it was my fault that i couldnot set CAM1_TYPE and MNT1_TYPE i thought that Lua Script setting will take care of this because we are setting VID1_CAMMODEL as Viewpro.

yes i am using AP support ViewPro Camera model is A10T combo Day and Night payload https://www.viewprotech.com/index.php?ac=article&at=read&did=533

after changing CAM1_TYPE and MNT1_TYPE the Lua script detected incoming video feed automatically.but the command and control it seems not available for thermal camera all command looks working only to day camera alone.
these command are not available.

  1. Change of PIP mode (Picture in Picture Mode)
  2. Thermal Digital zoom Not available only day zoom working.
  3. Thermal polaritity change function not avaialable (black hot and white hot color change of the thermal camera).
  4. i think tracking function shortcut available but how to exit from the tracking what shortcut key i have to use.
    because Now a days most of the Viewpro Gimbal models are available with Combo payload type these days.

what is the purpose of FOV been asking here to project camera Azimuth on the map view alongwith Drone ICON.

Instead of PC keyboard can we interface game pad Joystick and user can assign axis and buttons for each differnt function of gimbal aswell as camera if they wish.

1 Like

Hi @kalai1219,

Thanks for the feedback. I’ve created an issue here to cover the AP flight code related enhancement requests.

Re turning off tracking, I would have expected the Alt+LeftClick to turn on/off tracking but maybe I’ll check with @robertlong13 to be sure.

The camera FOV is also used to calculate the angle that the gimbal should move to if the user clicks on the live video stream window.

I’ve created an issue here for the MP request to add support for joystick buttons.

Thanks again!

1 Like