Mission planner gstreamer pipeline question

When i type below in command prompt, new screen pops up and play real time video from Navio2.
gst-launch-1.0 -v udpsrc port=9000 caps=“application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264” ! rtph264depay ! avdec_h264 ! videoconvert ! autovideosink sync=f
D3D%20video%20sink

But I want to use Mission planner istead of ‘D3D video sink screen’

I have no idea what data to put at the ‘GStreamer url’

please help…

image image image

try

udpsrc port=9000 caps=“application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264” ! rtph264depay ! avdec_h264 ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink

this is one I use to test

videotestsrc ! video/x-raw, width=1280, height=720,framerate=25/1 ! clockoverlay ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink

error2

i get this image using the test lines

i tried but still error message as below…
error1

that error message is if you are using a webcam or capture device.

when providing a gstreamer pipeline you don’t have to click start at all.

given that the test pipeline works, do you know what version of gstreamer is being used from the navio? might be a version issue

I am currently using gstreamer-1.0-x86_64-1.4.5 downloaded from Emlid (Navio2 Doc page)
gstreamer is installed in ‘complete’ setup type.
I am using raspberry pi camera Rev 1.3

Thanks for your help Michael_Oborne
Joon

Mission planner is using
gst-launch-1.0 version 1.12.4
GStreamer 1.12.4

internally. so I think this must be a version issue.

can you test with a newer gstreamer on your pc?

2 Likes

Thank you Michael_Oborne your answer solved my problem!!
final

hello joongoung86 and Michael Oborne, I have same issue as you right now, Im using mission planner 1.3.62, but im out of the box, need to further digging to know how to configure out. Can u give step by step how to integrate it and is their any software to install?

Hi Michael_Oborne,

Thanks for your support in this community.

I have tried all the above solutions but none of them resolved the issue for me.
I am still unable to view the video stream in the Mission planner HUD. Here are the details about my setup.

Mission Planner 1.3.72 build 1.3.7463.24854
gstreamer-1.0-x86_64-1.3.91

Rapsberry Pi:
raspivid -n -t 0 -rot 180 -w 640 -h 480 -fps 30 -b 6000000 -o - | gst-launch-1.0 -e -vvvv fdsrc ! h264parse ! rtph264pay pt=96 config-interval=5 ! udpsink host= port=5000

Windows PC:
Standalone gstlaunch app is able to show the video stream perfectly. Here is the command used.
gst-launch-1.0 -e -v udpsrc port=5000 ! application/x-rtp, payload=96 ! rtpjitterbuffer ! rtph264depay ! avdec_h264 ! fpsdisplaysink sync=false text-overlay=false

And here is the string have used in Mission Planner as per your suggestions above in this thread, which is still not working at my end.

udpsrc port=5000 caps=“application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264” ! rtph264depay ! avdec_h264 ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink

I am pretty much beginner to gstream and mission planner. Please let me know if i am missing anything. Appreciate your help here.

Awaiting for your answer,

Regards,
Joel.

the first pipeline to test is the loopback pipeline

videotestsrc ! video/x-raw, width=1280, height=720,framerate=25/1 ! clockoverlay ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink

this creates a video localy and plays it. and confirms if MP can indeed display the video.

once this is confirm you need to derive a pipeline for your use case.

hello Michael_Oborne I tried many code to streaming from raspberry pi to mission planner
I cant receive videos in mission planner
I did the test code you added and it worked well

help me please

what pipeline are you using on the pi?

I tried all this

raspivid -n -w 460 -h 460 -b 1000000 -fps 30 -t 0 -o - | gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=10 pt=96 ! udpsink host=192.168.43.154 port=5600

gst-launch-1.0 -v v4l2src device=/dev/video0 num-buffers=-1 ! video/x-raw,width=640,height=480, framerate=30/1 ! videoconvert ! jpegenc ! tcpserversink host=192.168.43.154 port=5000

في الاثنين، ٢٠ يونيو، ٢٠٢٢ ١٠:٠٥ ص Michael Oborne via ArduPilot Discourse <noreply@ardupilot.org> كتب:

I am beginner with it

Please help me the command in raspberry pi and gstreamer source in mission planner

في الاثنين، ٢٠ يونيو، ٢٠٢٢ ١٠:١١ ص ahmed abbas <eng.ahmed.elect@gmail.com> كتب:

I also streaming live video in html page with open cv python

can I display it in mission planner?

في الاثنين، ٢٠ يونيو، ٢٠٢٢ ١٠:١٤ ص ahmed abbas <eng.ahmed.elect@gmail.com> كتب:

use
raspivid -n -w 460 -h 460 -b 1000000 -fps 30 -t 0 -o - | gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=10 pt=96 ! udpsink host=192.168.43.154 port=5600

and in MP
udpsrc port=5600 buffer-size=90000 ! application/x-rtp ! decodebin3 ! queue max-size-buffers=1 leaky=2 ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink sync=false

1 Like

i found an error

in MP
udpsrc port=5600 buffer-size=90000 ! application/x-rtp,media=(string)video,clock-rate=(int)90000,encoding-name=(string)H264 ! decodebin3 ! queue max-size-buffers=1 leaky=2 ! videoconvert ! video/x-raw,format=BGRA ! appsink name=outsink sync=false