Smart client live video drift problem

I find that the video in smart client drift a lot after running for serveral hours. You can produce it by following step:

1. Start the first instance of Smart client, open live camera viewer. Let it run for couple of hours.

2. Start sencond instance of smart client and open same live camera, you will see the two video are not sync. the first one that running for hours is slower than the one is newer opened.

3. If you switch to Alarm Manager tab in the first smart client, then switch back to Live Viewer. the video sync again with second smart client.

It seem a big problem for us since we draw bounding box on video client, at the begining the bounding box looks exactly on the top of the object on video, after running for a while, the bouding box is drawn ahead of object and not on the top of object anymore. We have to switch to other Tab like Alarm Manager then switch back to Live viewer then bounding box drawn correctly again.

Is any idea to fix this problem? thanks a lot again.

I have a couple of questions.

Does the camera view in the Smart Client run with Image Quality = Full (no transcoding that might give a delay)?

Do you see the delay only while using overlays (or does it get worse using overlays)?

Does the delay vary with the image resolution (get worse with higher resolution on the camera)?

How much delay do you see? (Approx.? -half a second? -a second? -many seconds?)

Please add what camera and XProtect server you are you testing with and what is the setup (codec, resolution etc.).

Bo,

Thanks for your reply. Here is my answers for your question.

1.I don’t know how to configure camera viewer with Full image quality, in smart client, I just choose a camera and send it to new float windows, Let it run for a while and see drifting.

2.I believe that video drift even without running overlay plugin, but I will test it again and let you know tomorrow.

3.Delay happens in low resolution camera like 640x480 and high resolution camera as well.

4.Delay varies from 0.5-2 seconds

5. I use Axis P3301 camera codec is H264 640x480, and Siveillance VMS 2014 version 7.0.4

thanks,

In the Smart Client in Setup mode when you have the camera view selected you can in the left hand side set Image Quality. This will transcode the video to lower quality, whether this can cause delays is what I am wondering. Default is Image Quality = Full so from your description this is most likely what you have.

I tried to reproduce your observations but was unable to. Did you test again? Is the behavior depending on your plugin doing the overlays?

I tested again, if there is no overlay plugin running, there is no delay. So video drifting delay only happen when boundingbox pluging is running.

Our application detect objects from camera and send the alarmed data as boundingbox metadata stream to Milestone VMS, we use overlay plugin to draw these bounding box. Even we don’t run our plugin and use Milestone default pink color bouding box, we see same delay too. It seems that imageAddedOn.SetOverlay() will affect the video rendering. Do you have idea to sovle this problem? If vide looks delayed and the bounding box is not following the objects, it is really confusing to end user.

Amy

We have so far not been able to reproduce the issue in our test-lab.

A theory is that new functionality that was introduced in 9.0c could be causing unintended delays..

Could I persuade you test with Smart Client 9.0b (next-newest version)?

Could you send me the link of Smart Client 9.0b? I’d like to try.

Another question, how could I get the time stamp of current video frame rendered on ImageViewerAddedOn at smart client? If I am able to get this time stamp, I can put corresponding overlay boundingbox on this video frame to solve this problem. thanks.

Found a way easy to reproduce this problem:

1. Open smart client and run a video in Live view for a while, the pink bounding box is perfect drawing on moving object, no delay. see picture below.

2. Click Playback viewer and move the bar and run playback video for a while.

3. Click Live viewer again, you will see delay, the default pink bounding boxes are not sync with moving object anymore.

Can you please run a test for us?

Please try using Smart Client 9.0b. See if the issue does not exist in this version.

In Smart Client 9.0c Milestone introduced some different method of buffering, it was introduced to solve some other issue. We are speculating right now if might have introduced a problem for overlays.

PS. Did you get a message from our Support case system? I have been trying to contact you.