Does XPMobileSDK.playbackGoTo work with stream type XPMobileSDK.library.VideoConnectionStream.H264inFMP4 in HTML video elements?

MIP
, , , ,
1

Is it possible to use the code in the experimental sample to display a video in a video element (instead of canvas) in playback mode? It seems like when the stream type is XPMobileSDK.library.VideoConnectionStream.H264inFMP4, the video displayed is always “live” and ignores the rest of the request stream parameters passed to XPMobileSDK.requestStream.

Having the Mobile server decode and encode the frames to JPEG is very demanding don’t see this solution working when multiple users are using the system at the same time.

Thanks!

Daniel

2

Hi, unfortunately we do not support playback for H264inFPMP4 streaming type.

3

Hi Svetlana. Thank you very much for your answer.

So as I understand, there’s currently no way to retrive a video stream and display it into a HTML5 video element for “playback” mode.

Is it something that will be possible in the future in another release?

Thanks,

Daniel

4

Hi Daniel,

Yes, you are right. Currently there is no way to retrieve video stream in playback mode and display it into HTML5 video element.

And yes, we do plan to include it in future release, but I cannot give you an exact time frame when this will happen.

Kind regards,

Svetlana

5

Hi Svetlana

Let me get this staight: Video playback (SignalType=“Playback”) is not possible at the moment, but live video (SignalType=“Live”) with HTML5 video element should work?

If yes, which version of Mobile Server is required for doing this? Will this reduce the transcoding load on the Mobile Server compared to “conventional” use of the Mobile Server Protocol?

Best regards,

Andy

6

Hey Andy,

I found the sample for the HTML5 video element in the Experimental folder in the XPMobileSDK 2019 R3 sample folder.

We found it to greatly reduce the load on the CPU of the Mobile Server. When using HTML canvas to paint the frames received from a motion JPEG stream, the CPU load on the Mobile Server would always go up to 100%. When using the code to retrieve the H264 video stream, the Mobile Server CPU usage seems to be way lower.

7

Hi Andy,

Daniel is right.

It is available in 2019 R3 release of both Mobile server and XPMobileSDK.

And yes it is supported only for Live.

Reduced CPU load is significant.

Unfortunately this is not something that is officially supported.

Therefore sample is put into the “Experimental” folder.

There is great chance the sample and the functionality to be removed in the upcoming 2020 R1 release.

The reason is in fact that we realized there are some uncovered (mostly edge) cases with the implementation and functionality.

You can continue to use 2019 R3 version, but on your own risk and without any guarantee from Milestone (as it is not officially released).

If you are interested in, I can ask if it is possible to add you in the early adopters / beta testing program.

You eventually will be able to receive newer things (concerning this particular feature) earlier and give us feedback how it works for you, possible problems, gains in the performance etc.

For this to happen we will need at least your e-mail addresses and will contact you offline.

@ Daniel

Btw have you noticed what in what level is the performance improvement of the Mobile server on your side ?

Something very general like few percents or few times ?

(We are very interested to compare our measurements with real life scenarios)