Application streaming with H.264/H.265 in realtime to browser clients

For the developers that use FFmpeg in their software.
Post Reply
MaximilianTorggler
Posts: 1
Joined: Thu Dec 28, 2017 10:30 am

Application streaming with H.264/H.265 in realtime to browser clients

Post by MaximilianTorggler » Thu Dec 28, 2017 10:46 am

I am trying to build a solution which streams the visual content of a windows application (built with Unity 2017) to browser clients. Those applications provide high quality content which needs to be streamed in a 1:1 manner in high quality with the lowest latency possible. In essence, it's a very similar use case to game streaming.

The video is directly captured from within Unity and piped as raw video to a FFMPEG process spawned before. FFMPEG now converts this raw video into a H.264/H.265 stream. In addition, I would like to use the NVIDIA Video Codec SDK to speed up this process.

The questions are:
  • Is H.264/H.265 a suitable format for that use case?
  • If not, what would you suggest?
Note: I already tried to implement a solution with JSMPEG (so using mpeg-1/mpeg-ts, ffmpeg, and a custom server), but this implementation has several problems like high bandwidth usage and high CPU usage. I hope that by using H.264/H.265 in combination with the NVIDIA Video Codec SDK, I can at least lower the hardware and bandwidth usage.

On the client side, Flash or Silverlight can't be used. It should be a HTML5 solution with high browser compatbility.

I would appreciate any help. Thanks in advance.

AlcyonaHaramix
Posts: 7
Joined: Sat Jun 18, 2016 11:44 am

Re: Application streaming with H.264/H.265 in realtime to browser clients

Post by AlcyonaHaramix » Wed Jan 03, 2018 5:04 am

for a server... you could try... nginx-rtmp-module...

aka... https://github.com/illuspas/nginx-rtmp-win32 , https://github.com/illuspas/nginx-rtmp- ... master.zip ...

im using this version of nginx... ( https://github.com/illuspas/nginx-rtmp- ... master.zip ) ... to stream... H264 inside a FLV container over RTMP protocol to FLASH ... under WIN 10 ...

but... i havent tried HLS or MPEG DASH in this version of nginx... so im not sure if it ( HLS or MPEG DASH ) works correctly...

AlcyonaHaramix
Posts: 7
Joined: Sat Jun 18, 2016 11:44 am

Re: Application streaming with H.264/H.265 in realtime to browser clients

Post by AlcyonaHaramix » Wed Jan 03, 2018 6:08 am

also... see this... https://github.com/Bilibili/flv.js ... but im not sure that... this ( FLV.JS ) supports RTMP protocol...

Post Reply