Integration of ArduPilot and VIO tracking camera (Part 1): Getting started with the Intel Realsense T265 on Rasberry Pi 3B

Blog
, ,
82

Hi @thomatwn123,

  • as @amilcarlucas mentioned, it’s better to create a new thread if the problem is not directly related to this thread.
  • however, in this case it is not necessary: the error “SLAM Error Speed” means that the Realsense T265’s tracking function has failed and the data that it is providing is no longer valid. Hence, the main issue is that the T265 could not provide satisfactory performance in your use case.
  • this typically happens in situations such as quick motion from static position, or if the device temporarily looks at a blank wall, or that the device moved more rapidly than expected for typical handheld motion.

I would suggest looking for support by Intel to find a solution over at https://github.com/IntelRealSense/librealsense.

1 Like
83

@amilcarlucas and @LuckyBird thank you so much for your prompt response. I found that I was doing a silly mistake in the threshold curve. I am using QAV250 frame along with 2300kv motors + 5 inch props. After I adjust the max threshold to 70% from Flysky F6 TX and took off in AltHold and in Loiter mode the problem resolved.

The main reason I was experiencing it, due to sudden motion, which incurred Slam speed error and the co-ordinate values got some garbage values. So, due to no co-ordinate info and the copter become crazy.

If further issues occur I will open a new thread.

Thank you so much @LuckyBird for your such nice and lucid tutorial.

Susanta Sharma
PhD. scholar, NYCU (formally known as NCTU), Taiwan

1 Like
84

This link is dead @LuckyBird

85

@shubham-shahh which link are you referring to?

86

the link mentioned in this answer

87

the link works

https://docs.qgroundcontrol.com/master/en/getting_started/download_and_install.html

88

Hi @ppoirier I am not referring to that link
I am referring to this link, https://docs.qgroundcontrol.com/en/app_menu/mavlink_analyzer.html
the mavlink analyser

89

Much simpler when it is explicit :wink:
Google being our friend, it is easy to find
https://docs.qgroundcontrol.com/master/en/analyze_view/mavlink_inspector.html

BTW you can do the same with mission planner , just do Ctrl-F and select mavlink inspector

90

Hi, Yes, I know about mission planner but since I am using a linux system I have to use QgroundControl

thanks

91

actually QgroundControl’s Mavlink Inspector works better as we can make more detailled graphical analysis

92

yes true. and thanks for the help

1 Like
93

Hey Hi! I’m completely new to this project and what you did in 3 years is literally amazing. I read the entire article and I just wanted to ask that is it possible to do this project with any other camera other than Intel T256 Tracking camera

94

Hi,
since Intel 265 provides direct odometry data, it becomes alot easier. In case of other cams like D435i or D455, you need to run a SLAM algorithm to generate odometry and pass it to mavros in the message form of PoseStamped

95

Hi, @LuckyBird
I was curious if there is any fail safe implemented in case of SLAM drifting?

96

wow that is a lot of work and I heard that ROS is super complicated

97

SLAM is an active area of research and ROS is just a tool. its not complicated

98

If the SLAM provides a measure of tracking confidence (in the case of the T265, a scalar value from 0x0 - Failed, 0x1 - Low, 0x2 - Medium, 0x3 - High) or preferably a covariance matrix, ArduPilot can refuse to fuse the data when the SLAM fails or is erroneous. And if you also have optical flow or GPS, then that’s another source of localization that AP can fall back to in case the SLAM completely fails.
If none of the above applies, I think you should be ready to take back control manually.

99

right, but slam algorithms such as VINS, orb-SLAM don’t provide confidence score hence I think there is a need of drift detection. If its not implemented, i think we should work upon it

100

I see here Developer and Internals » Covariance Index Internals
Developer and Internals » Covariance Index Internals | OpenVINS

I suggest for the rest of discussion you go to DISCORD as it has no direct relation with this thread

…oups… this channel

1 Like
101

since ardupilot is only taking the pose stamped type message which consists of position and orientation, how is the confidence score sent to ardupilot

thanks