How to create proper video file from multiple video blocks

We are able to fetch video blocks (h264 or h265) using a “goto” and multiple “next” calls. The responses are concatenated (minus the GenericByteData headers) into a single file. This file can be played in the VLC media player. However, when trying to use this file with ffmpeg there are multiple complaints about missing PTS.

Does anyone have any suggestion on how to fix this?

I have asked Milestone Development and said:

As I understand it, they are missing timestamps on the individual frames. H264 and h265 do not encode timestamps. There are timestamps in the Generic Byte Data headers they threw away.