Please add support for the srt protocol (Secure Reliable Transport)

[gargolito]

Overview

FFMpeg has support to fully utilize the SRT protocol

Existing FFmpeg API

libavformat/libsrt.c

Expected PyAV API

Example:

container = av.open(srt://ipaddress:port?mode=caller)

This will currently fail with "unable to open file"

Investigation

Tried to open an srt video stream in caller mode

container = av.open(srt://IPADDRESS:PORT/?mode=caller)

Reproduction

1. Start a listener (this is the server): ffmpeg -hide_banner -loglevel error -re -stream_loop -1 -i SOME_VIDEO_FILE -c copy -map 0 -f mpegts srt://localhost:5765/?mode=listener
2. try to open the stream with python script using pyav as usual

Versions

• OS: ubuntu linux 22.04
• PyAV runtime: 12.3.0

PyAV v12.3.0
library configuration: --disable-static --enable-shared --libdir=/tmp/vendor/lib --prefix=/tmp/vendor --disable-alsa --disable-doc --disable-libtheora --disable-mediafoundation --enable-fontconfig --enable-gmp --enable-gnutls --enable-libaom --enable-libbluray --enable-libdav1d --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libspeex --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libxcb --enable-libxml2 --enable-lzma --enable-zlib --enable-version3 --enable-libopenh264 --disable-libx264
library license: LGPL version 3 or later
libavcodec     60. 31.102
libavdevice    60.  3.100
libavfilter     9. 12.100
libavformat    60. 16.100
libavutil      58. 29.100
libswresample   4. 12.100
libswscale      7.  5.100

• PyAV build:
  pip installed, got version

v12.3.0

• FFmpeg:

ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100

Additional context

I really just need to be able to open srt streams, so that basic functionality would be enough for me.

[JoeSchiff]

@gargolito
I got you

Let me know if you have any advice for writing tests for this.

[gargolito]

I looked at the issue and you already did what I would have done to get a minimum viable product. There may be other tests, but I don't see it is necessary now that you've incorporated libsrt.

[JoeSchiff]

Sorry about the delay. There is some problem with our windows runner which has made building anything impossible. I can't implement srt until we get it resolved

[gargolito]

Understood. Thanks. (I don't use windows because of... reasons😉) Best Regards, Anthony Camilo

…

On Mon, Dec 2, 2024 at 3:33 PM Joe Schiff ***@***.***> wrote: Sorry about the delay. There is some problem with our windows runner which has made building anything impossible. I can't implement srt until we get it resolved — Reply to this email directly, view it on GitHub <#1503 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAMREEIEBXBEE4MONTGZS5D2DS7ZBAVCNFSM6AAAAABRMDV4BCVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCNBUGA4TMMQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[JoeSchiff]

@gargolito

Would it be a problem if we were to bundle srt without support for encryption? Building without openssl would simplify things.

(I also don't use windows)

[gargolito]

I need encryption for my use case. I'm perfectly comfortable compiling it if you can give me adhoc instructions for adding support for encryption.

[JoeSchiff]

This seems to work on my system. I have ffmpeg with --enable-libsrt installed through apt.

[gargolito]

Are you saying that pyav works with srt as it is?

[JoeSchiff]

Yes, I believe so. You just need a version of ffmpeg with --enable-libsrt, which it seems you have.

However, if you run pip install av then it will install a version of ffmpeg without --enable-libsrt.

Try out pip install av --no-binary av and let me know if it works for you.

[JoeSchiff]

PyAV 14.1.0 has been released and includes libsrt.

[gargolito]

Tested on my end with haivision srtgateway using encrypted stream and it works great. Thanks!

[gargolito]

Awesome, thanks for the update! Best Regards, Anthony Camilo

…

On Sun, Jan 26, 2025 at 9:16 AM Joe Schiff ***@***.***> wrote: PyAV 14.1.0 has been released and includes libsrt. — Reply to this email directly, view it on GitHub <#1503 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAMREELHPC3RGNABCYDLEI32MTU4HAVCNFSM6AAAAABRMDV4BCVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCOJVHA3DOOI> . You are receiving this because you were mentioned.Message ID: ***@***.***>