Since I’ve ordered OAK Lite, I’ve started to getting familiar with OpenVINO and I’m disappointed with the ONNX support, because the docs state that supported opset is ver 8 (which is far behind the current one - 15!).
I saw a post a few months ago where you and @rmackay9 were discussing the possibility of enabling this camera with the ability to do both VIO and obstacle avoidance. Is that still in the works?
Yes, we’re likely going to kick this off in the new year, starting mid January. We have wide FOV models coming out as well like OAK-D W as well:
And these will be more capable for VIO because of the wider FOV.
Depth-AI has already a feature tracker engine, you need the external software or a internal firmware I think. Many of that external software use Ceres,G2o,GTAM…and the one you named enter in that category I think, I don’t think is very probable that can run in a OAK camera.
About the internal option should be something like the feature tracker/slam of the T265.
About the internal firmware option I read something about that possibility soon , but Brandon is here so I guess he will give any news related with that .
Yes. Spectacular AI has done some impressive host-side VIO with DepthAI outputs as well.
And yes we will be doing a direct-on-DepthAI VIO as well. Likely will be lower accuracy/etc. But a zero-to-one sort of thing. That will just allow VIO to be spit out directly from the camera for folks who don’t need absolute state-of-the-art but more around the performance of T265 (which is WAY below state of the art - but still useful).
And Spectacular AI is planning a better-than-state-of-art version that will run onboard our Series 3 OAK (which is coming late 2022) which is based on MA2095 (Gen3 Movidius).
Hrm… not sure if my posts went through. They keep getting flagged as SPAM. I was accused of being an AI at my last job (on many occasions) by people. Now AI is thinking I’m an AI. Now I think I must be an AI!
Will the code for your VIO be open-sourced? IMO closed-source was a major flaw of T265. Without access to code there’s no way to proper tune and fix bugs for your particular use case
Can you say something more about Gen3 Movidius? How it’s compared with Gen2? I’ve found some press announcements from 2019 but now it’s 2022 and I can’t find anything on Intel website or anywhere else.
Yes, likely. Unfortunately the build tools can’t be open-sourced but ideally we can write it in a way that it can be cross-compiled to other architectures with open-source build tools.
Yes. It’s about 10x the AI performance of Myriad X. So more like a Xavier NX in terms of AI performance. And it has a bunch of other niceties that make the CV/depth better. And in addition to that it has about the equivalent of a Raspberry Pi Zero 2 built-in (quad-core ARM 1 GHz) that runs YOCTO Linux. So on this version it will be easier to run a variety of host application on-chip.
Will are making our OAK-SoM-Pro with Keem Bay (Gen3 Movidius) as well.
Hello, i have a .tflite model we use on a coral for our photovoltaic job to keep dron in track. How should i proceed to convert it to use with oak-d lite? I tried to follow your links but i soon got lost.
Sorry but i am a bit discord dumb, i already have an account there and used it to join discord and accepted your invite than i tried to write and asked me for a phone validation wich i did but it told me the number is already used for another server, wich obviously is.
One last thing it is not really clear to me. As i understand from this blog post i should get the fixed focus version but it looks like there is not fixed focus on the oak-d lite. Should i just wait or have any other advice?
Thanks! Yes, I too have Discord troubles. You’re not alone.
So on OAK-D-Lite actually we do have a fixed-focus version. I’m not sure if the link will be stopped by the ArduPilot forum (usually it is blocked) - so if it is, please shoot support at luxonis.com an email and we’ll send the link to you.
But TLDR, juts go to OAK-D-Lite on our webstore, and then there’s a selector for RGB CAMERA FOCUS and you can choose Auto-focus or Fixed-focus there.