Qt Multimedia GStreamer backend

This page covers the limitations of the GStreamer backend of Qt Multimedia.

Limitations and Known Issues

GStreamer is not bundled with Qt, but it is typically deployed with the Linux distribution.

• Certain bugs may be due to the GStreamer version being used. We recommend to use the latest GStreamer bug fix release on your platform.
• Certain bugs may also be related to the libraries used by GStreamer, like Pulseaudio. Most notably Pulseaudio v16 has a known bug that causes the GStreamer pipeline to hang and requires backports of these two patches:
  • https://gitlab.freedesktop.org/pulseaudio/pulseaudio/-/merge_requests/745
  • https://gitlab.freedesktop.org/pulseaudio/pulseaudio/-/merge_requests/764

  This bug currently affects most mainstream Linux distributions, including Ubuntu 22.04, 23.10 and 24.04, Debian 11 and 12, as well as Fedora 39 and 40.

• Seeking, playback rates, loop, switching sinks have known bugs.

Customization points

Qt Multimedia provides certain customization points to allow access to the underlying GStreamer pipeline. These customization points are considered private APIs and may be subject to change. The entry point is class QGStreamerPlatformSpecificInterface.

Raw pipeline access

The GstPipeline underlying the QMediaPlayer and QMediaCaptureSession can be accessed.

 #include <QtMultimedia/private/qgstreamer_platformspecificinterface_p.h>

 [...]
 QMediaMediaPlayer player;
 GstPipeline *pipeline = QGStreamerPlatformSpecificInterface::instance()->gstPipeline(&player);
 [...]
 QMediaCaptureSession session;
 GstPipeline *pipeline = QGSreamerPlatformSpecificInterface::instance()->gstPipeline(&session);

Custom GStreamer elements as sinks and sources

It is possible to create GStreamer elements from a GStreamer pipeline decription and wrap them inside a QCamera or QAudioDevice:

 #include <QtMultimedia/private/qgstreamer_platformspecificinterface_p.h>

 [...]
 QByteArray pipelineString = "videotestsrc is-live=true ! gamma gamma=2.0";

 QMediaCaptureSession session;
 session.setVideoSink(wid.videoSink());

 QCamera *cam = QGStreamerPlatformSpecificInterface::instance()->makeCustomGStreamerCamera(
          pipelineString, &session);
 session.setCamera(cam);

Architectural Considerations.

Qt Multimedia is not a general purpose streaming framework and not necessarily the architecturally best way to use GStreamer with Qt. Developers, who need a high degree of control over the GStreamer pipeline, but only want to show the video output Qt, may want to consider using GStreamer's qml6glsink.