Audio over Protocol Integration

MIP
,
1

I’ve searched documentation, examples and the forum but I could not find a way to obtain recorded audio using Protocol Integration. Only images, live and recorded, but no audio stream. Am I missing something?​

2

On the ImageServer protocol you will get audio data when you ask for data from a microphone device instead of from a camera.

How the data is encapsulated is described in the “The GenericByteData format” page in the MIP Documentation, perhaps you have already been into this information if you can get and use video data.

3

Thanks for your answers.

So, I have to process the two streams separately and take care of the synchronization in my application, right?

I’ve seen that it’s possible to retrieve a H.264 video instead of using jpeg transcoding and I’m working on it (I have another post open already on that topic) : is this a video only stream, or may I expect to receive the audio from the mapped microphone inside the same H.264 stream?

4

The audio is a separate stream.

5

I’m having trouble handling the audio stream.

The documentation does not explicitly refer to microphones. The chapter is called “cameras and microphones” but it only focuses on cameras. So I tried to connect to the device using the same syntax I used with the camera, putting my microphone id inside the tags.

That looks strange but I get a connected:yes from the server, so I try to get the first packet with a GOTO. The response is a GenericByteData whose first bytes are 0x0020, which means audio, fine.

Then I try to issue a NEXT command to get the next packet but I get an error saying “Unable to browse the selected database”

6

Correct. When you ask for raw data from a microphone you get audio data. In playback mode GOTO should work. Can you document the communication? Perhaps a small network communication trace (Wirteshark or similar).

7

If we are using the direct server protocol and typitcally call out a camera guid, how do we call a microphone seperately?

for example:

   public ImageServerConnection() // For testing on static camera

   {

       \_imageServer = "192.168.235.131";

       \_imagePort = 7563;

       \_cameraGuid = "a9adc052-e793-4ed0-a1e2-8b975ba8e020";

       \_token = "";

   }

This calls a camera guid, is there a place to further specify a microphone? if we want to recieve just the audio?

8

you simply have another GUID for the microphone stream.