question

RobbF-1342 avatar image
0 Votes"
RobbF-1342 asked AnilMurching-7279 answered

Azure Video Analyzer on Jetson Nano with GPU support

Hi,

Is there a way to use the Azure Video Analyzer archtitecture on Nvidia Jetson Edge devices (Nano or Xavier NX) with a GPU accelerated inference server?

So far I have only found tutorials using Nvidias Deepstream SDK as a substitute for the Azure Video Analyzer (AVA) module. However, by using the Deepstream SDK I wouldn't be able to take advantage of AVA's pipeline topology architecture for quick deployment of different use cases.

Instead, I would like to deploy my own inference server as a grpc extension module within the AVA pipeline (as indicated here). This would ideally be based on a container that sends inference jobs to the jetson gpu (maybe Nvidias Triton Server container?).

This seems to be the case in Microsofts OpenVino example, so essentially I would like to replicate this for Nvidias edge devices.


azure-iot-edgeazure-iot
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Sorry for the late response and thanks for reaching. I have escalated this issue to Azure Video Analyzer team for help. Will respond under this thread once I have any information here.

Regards.,
Yutong

0 Votes 0 ·

Hello Robb,

Sorry for the delay. Since Video Analyzer is out of scope currently, I would recommend you to raise a support ticket for this issue. Please let me know if you have no support plan and need help to create a one time free ticket. We are working on covering this service area and improve the support.

Regards,
Yutong

0 Votes 0 ·
RF-4614 avatar image
0 Votes"
RF-4614 answered YutongTie-MSFT commented

Hi Yutong,
thank you for the reply. I'have submitted a support ticket already, thank you.

It definitely seems possible, but atm there is no official guide how to implement AVA on jetson devices.

Thanks,
Robby.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello,

Could you please share the ticket number so that we can track on this item? Thanks.

Regards,
Yutong

0 Votes 0 ·
AnilMurching-7279 avatar image
0 Votes"
AnilMurching-7279 answered

Please see this for an example of how to build an inference server around DeepStream SDK, such that the server can be used with AVA.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.