I am working on a heatmap that displays crowd density in a given video stream. I have managed to modify the frames in the pipeline through overlaying the heatmap over the original ones, and I need to display the modified video in XProtect Smart Client. For this purpose I have set the property “return_video” to true in the pipeline. However, the VPS camera is not displaying the video; instead it’s just displaying the message “Connected to server”.
In the reference code of the plugin gstvpsdeepstream, it’s stated that “We don’t want to return video from the bounding box plugin, as the video will be raw and won’t be usable by XProtect”. Is there any way to display the video output in the smart client? Would reencoding the video to H.264 before resending it to the VPS driver work?