How can I display videos, that were modified through the VPS deepstream pipeline, on the corresponding VPS camera in XProtect Smart Client (2021 R2)?

I am working on a heatmap that displays crowd density in a given video stream. I have managed to modify the frames in the pipeline through overlaying the heatmap over the original ones, and I need to display the modified video in XProtect Smart Client. For this purpose I have set the property “return_video” to true in the pipeline. However, the VPS camera is not displaying the video; instead it’s just displaying the message “Connected to server”.

In the reference code of the plugin gstvpsdeepstream, it’s stated that “We don’t want to return video from the bounding box plugin, as the video will be raw and won’t be usable by XProtect”. Is there any way to display the video output in the smart client? Would reencoding the video to H.264 before resending it to the VPS driver work?

  1.  It requires that encoding is H.264 or jpeg before XProtect can show it.
    
  2.  Try the test plugin example ‘vpspasstru’ it takes the video from the source camera and return the video back to XProtect or ‘vpsjpegtranscoder’ it takes the H.264 and change it to jpeg encoding and return the video.
    
  3.  Please beaver of if you will have video back into XProtect then it requires a device license.
    

Hi Bent, apologies for the late reply.

I actually managed to return the video in the format required by XProtect and was able to display the modified video on the XProtect Smart Client. I used the plugins “xprotectjoin” and “toxprotectconverter” after encoding the frames in jpeg.

Thank you.