OSC getLivePreview implementation

[rares-lupascu]

Hey

I need to implement the getLivePreview command from Google Open Spherical Camera API
https://developers.google.com/streetview/open-spherical-camera/reference/camera/getlivepreview

What i need to do is a POST with some data that will tell the endpoint i need the getLivePreview stream ... the output is a video stream of MOTION Jpegs at 15fps ... the pb is that i need a way to display them in javascript by executing a POST request (any other method will not work)

is there a way this library can help me implement that?

thanks

[wkh237]

Hi @wowzaaa , this is very interesting, from my understanding if you send a POST request it should return something like this

---osclivepreview---
[frame data]

---osclivepreview---
[frame data]

...

---osclivepreview---

Then you can extract frames by split the data with boundary, for example

RNFetchBlob.fetch('POST', 'http://some.endpoint', headers, body)
.then((res) => {
   let frames = String(res.text()).split('---osclivepreview---')
   renderFrames(renderFrame)
})

basically it's possible, but I think there will be some performance issue when split and render the frames if the image resolution is high 😕

[rares-lupascu]

1. so frames[frames.length - 1] will have the latest frame right?
2. u mean because of the size of the response buffer?
3. will then get executed on every change of the stream? every 66 ms ( 1 000 / 15 = 66.. ) ?

i will try to implement this and get back to u ... until now i could not get even a console log from the success function (i did it the old way ... without promises)

[wkh237]

Well, after some investigation I think multipart/x-mixed-replace data will never reaches an end, each part will be considered as replacement of previous part, and that's why the success function never got called. If we're going to support this I need do some more tests, wondering if there's any way I can have a working sample for this ?

[rares-lupascu]

well in order to have that u need a one shot camera like a ricoh theta s, gear 360 or lg 360 ... that will be the only way to replicate the incoming stream

[wkh237]

okay .. I will write a video streaming service to imitate the multipart/x-mixed-replace response, and see what can I do 👍

[rares-lupascu]

u'r a star .. i am here to test 💃 :P

[fabio0]

Hi @wkh237 , I'm having some trouble with the part response in ios, basically I'm updating an image component with the part data adding the code in the state and using it as the image source uri, it was working fine but now I'm having a "error for object 0x7fff4725a000: double free" in a breakpoint at

if(self.isServerPush)
    {
        [partBuffer appendData:data];
        return ;
    }

any idea on how to solve?
thanks

[zzq1023]

@fabio0 hi ,

Have you solved this problem?

[fabio0]

@zzq1023
Hi, no I built a bridge for the Ricoh theta sdk for ios using a native View for the live streaming