Create Simple RTSP Server on Raspberry Pi or Similar Computer

The RTSP streamer is an H264 video server with gstreamer. This will work for raspberry pi or jetson nano and likely any unix system.

Receiver / Client

This usually is Windows Computer.

Prerequisits on Client

gstreamer from https://gstreamer.freedesktop.org/download/ using 64bit runtime installer for MSVC
bonjour https://support.apple.com/downloads/DL999/en_US/BonjourPSSetup.exe to get mDNS working.
VC redistributable https://aka.ms/vs/17/release/vc_redist.x64.exe

Network

Plug the server directly into your notebook computer.

If you connect the server directly to your client with wired cable, the address is hostname.local. If both obtain IP through DHCP then the address is just hostname. If mDNS or DNS is not working then your hostname will be something like 10.TE.AM.11.

If you setup static IP on the server you will need to set the IP of your network connection to the same subnet. E.g. 10

10.TE.AM.6 your computer
255.255.255.0 netmask
10.TE.AM.1 as gateway

Script to run Viewer

Create a file such as LaunchViewer.bat on your client computer, with content such as:

cd %HOMEDRIVE%%HOMEPATH%
cd Desktop
gst-launch-1.0 rtspsrc location=rtsp://10.41.83.11:8554/test latency=10 buffer-mode=auto drop-on-latency=1 ! decodebin ! videoconvert ! videoflip method=rotate-180 ! rsvgoverlay location=Bucket0.svg width-relative=1 height-relative=1 x-relative=0 y-relative=0  ! autovideosink

The above assumes your have the script on your desktop and the overlay file is located there also.

Alternativel you can use VLC

vlc rtsp://hostname.local:8554/test

But make sure you set buffering to very small number (advanced options) otherwise your latency is going to be in the seconds.

Overlay

Create SVG graphics for example in Inkscape. You can use colored lines and text. gstreamer has module to overlay static SVG graphics onto your video feed.

Test the SVG Graphic Object

Test your script without RTSP, just with test video feed:

# Cross Hair in the center
gst-launch-1.0 videotestsrc ! rsvgoverlay location=CrossHair.svg width-relative=0.1 height-relative=0.133 x-relative=0.45 y-relative=0.433 ! videoflip method=clockwise ! autovideosink

# Grid Overlay
gst-launch-1.0 videotestsrc ! rsvgoverlay location=Bucket.svg width-relative=1 height-relative=1 x-relative=0 y-relative=0 ! videoflip method=clockwise ! autovideosink

Test with RTSP

gst-launch-1.0 rtspsrc location=rtsp://hostname.local:8554/test latency=10 ! decodebin ! videoconvert ! rsvgoverlay location=CrossHair.svg width-relative=0.1 height-relative=0.133 x-relative=0.45 y-relative=0.433 ! autovideosink

Modify the Server Settings

On the RTSP server there is a script executed at boot time to start RTSP server.

You can SSH to the server: ssh pi@10.TE.AM.11 and edit the file using nano run_server.sh. Password is the usual.

#! /bin/bash
cd /home/pi
./test-launch "( v4l2src device=/dev/video0 ! video/x-h264, width=1280, height=720, framerate=15/1 ! h264parse config-interval=1 ! rtph264pay name=pay0 pt=96 )" &
v4l2-ctl -c white_balance_auto_preset=10
v4l2-ctl -c auto_exposure=0
# v4l2-ctl -c exposure_time_absolute=10000
v4l2-ctl -c video_bitrate=500000
v4l2-ctl -c video_bitrate_mode=0

As you can see you can access any video camera in the /dev/ folder. This will not work on latest bullseye raspian image unless gstreamer uses libcam by default sometime in the future. You can set the resolution of the camera (check online what resolutions are supported, usually 1080p, 720p, 640x480, 320x240). You can set the frame rate. It will need to be experessed as ratio e.g. 15/1 You can use v4l2-ctl to change the camera properties. v4l2-ctl -l lists all properties you can change. It will take default dev/video0 camera. But you can choose the device. Recommended is autoexposure, to enable auto exposure you need set it 0 (not 1) Recommended is auto white balancing. This is not recommended for computer vision processing but is ideal for stream viewing. You will want to limit the amount of data sent over the network. The bitrate is bits per second. The bitrate mode is either constant bitrate or variable bitrate.

Build the RTSP Server

The RTSP server for gstreamer is not available on windows. Therefore the server will need to run on UNIX based OS. The RTSP server is not distributed as binary. So you will need to first install gstreamer, and the gstreamer development components and then build the RTSP server.

These programs might be helpful to explore camera properties and gstreamer options:
https://github.com/jetsonhacks/camera-caps https://github.com/jetsonhacks/gst-explorer

Server Dependencies

Not all dependencies below are needed for gstreamer but they are needed if you plan to use opencv. This is my basic vision processing setup.

sudo apt-get -y install libjpeg-dev libtiff-dev libtiff5-dev libjasper-dev libpng-dev
sudo apt-get -y install libavcodec-dev libavformat-dev libswscale-dev libv4l-dev libavresample-dev
sudo apt-get -y install libxvidcore-dev libx264-dev
sudo apt-get -y install libtbb2 libtbb-dev libdc1394-22-dev libv4l-dev
sudo apt-get -y install libjasper-dev libhdf5-dev
sudo apt-get -y install libopenblas-dev liblapack-dev libatlas-base-dev libblas-dev libeigen{2,3}-dev
sudo apt-get -y install python3-numpy python3-dev python3-pip python3-mock
sudo apt-get -y install cmake gfortran
sudo apt-get -y install protobuf-compiler
sudo apt-get -y install libgtk2.0-dev libcanberra-gtk* libgtk-3-dev 
sudo apt-get -y install python3-pyqt5
sudo pip3 install opencv-contrib-python==4.1.0.25

Create RTSP Server

Either install pre built or build your own server (not recommended)

Check current verison of gstreamer with:

dpkg -l | grep gstream*

2/14/2022 this version 1.14.4

# install base and plugins
sudo apt-get install -y libgstreamer1.0-dev \
     libgstreamer-plugins-base1.0-dev \
     libgstreamer-plugins-bad1.0-dev \
     gstreamer1.0-plugins-ugly \
     gstreamer1.0-tools
# install some optional plugins
sudo apt-get install -y gstreamer1.0-gl gstreamer1.0-gtk3
# if you have Qt5 install this plugin
sudo apt-get install -y gstreamer1.0-qt5
# install if you want to work with audio
sudo apt-get install -y gstreamer1.0-pulseaudio
# perhaps useful also
sudo apt-get install -y gstreamer1.0-python3-plugin-loader
sudo apt-get install -y gstreamer1.0-rtsp

Alternative: Installing latest gstreamer,build from source

Replace current version with a version of your choice
Source: https://qengineering.eu/install-gstreamer-1.18-on-raspberry-pi-4.html

Continue with steps outline at the end or the QEngineering Website.

Build and Install Gstreamer RTSP Server

You will need to build RTSP server regradless whether you built gstreamer or installed it with package manager.

sudo apt-get -y install gobject-introspection
sudo apt-get -y install libgirepository1.0-dev
sudo apt-get -y install gir1.2-gst-rtsp-server-1.0

# Download rtsp server version 1.14.4 or the one that matches your current isntallation.
wget https://gstreamer.freedesktop.org/src/gst-rtsp-server/gst-rtsp-server-1.14.4.tar.xz
tar -xf gst-rtsp-server-1.14.4.tar.xz
cd gst-rtsp-server-1.14.4
./configure --enable-introspection=yes
make
sudo make install
sudo ldconfig

The RTSP server is in the example folder and is called test-launch. It accessess libraries in .libs. If you copy test-launch you will also need to copy the hidden .libs folder.

Test the Streams

Before working with camera you will want to create a test stream such as:

cd ~/gst-rtsp-server-1.14.4/build/examples
# run the test pipeline
./test-launch "( videotestsrc ! x264enc ! rtph264pay name=pay0 pt=96 )"
# smaller number less output
export GST_DEBUG="*:5"

Watch with receiver as shown above on Windows or on same computer.

Create Shell Script to Simplify Start of Server

You will want to start the server with a simple script:

#! /bin/bash
cd /home/pi
./test-launch "( v4l2src device=/dev/video0 ! video/x-h264, width=1280, height=720, framerate=15/1 ! h264parse config-interval=1 ! rtph264pay name=pay0 pt=96 )" &
v4l2-ctl -c white_balance_auto_preset=10
v4l2-ctl -c auto_exposure=0
# v4l2-ctl -c exposure_time_absolute=10000
v4l2-ctl -c video_bitrate=500000
v4l2-ctl -c video_bitrate_mode=0

v4l2-ctl -l lists camera options. You will need to program the following

video bitrate
autoexposure or set exposure time, often auto_exposure ON means setting it to 0
white balancing
bitrate mode, you will want either constant bit rate or varibale bit rate
if you have more than one camera you can change the camera device=/dev/video1 etc.

On jetson nano your script might need to look like:

./test-launch "v4l2src device=/dev/video0 ! nvvidconv ! nvv4l2h264enc insert-sps-pps=1 insert-vui=1 ! h264parse ! rtph264pay name=pay0"

Run the Script at Boot

To run the above script each time the server boots you edit

sudo nano /etc/rc.local

and add the following line before exit 0

/home/pi/run_streamer.sh >> /home/pi/run_streamer.log 2>&1

Make the Device Wired and Compliant

For some usage scenarios you will need to turn off wireless and bluetooth.

You will want to set the hostname

sudo raspi-config

THen set hostname under system

Set static IP (this will require that your client is set also to static IP, advantage is that neither DNS nor mDNS needs to work):

sudo nano /etc/dhcpcd.conf
# use
# 10.TE.AM.11/24 
# /24 is netmask 255.255.255.0
# static routers = 10.41.83.1
# static domain_name_server = 10.41.83.1

Build from source 1.18.4

Not recommended

Remove the old version of gstreamer

sudo apt-get remove gstreamer1.0
sudo apt-get remove gstreamer-1.0

sudo rm -rf /usr/bin/gst-*
sudo rm -rf /usr/include/gstreamer-1.0
# install a few dependencies
sudo apt-get install -y cmake meson flex bison pkg-config
sudo apt-get install -y python3-dev
sudo apt-get install -y libglib2.0-dev libjpeg-dev libx264-dev
sudo apt-get install -y libgtk2.0-dev libcanberra-gtk* libgtk-3-dev
sudo apt-get install -y libasound2-dev
sudo apt-get install -y glib-2.0 
sudo apt-get install -y libcairo2-dev
sudo apt-get install -y gir1.2-gst-plugins-base-1.0
sudo apt-get install -y python-gi-dev
#sudo apt-get install -y libgirepository1.0-dev

Download and unpack gstreamer

wget https://gstreamer.freedesktop.org/src/gstreamer/gstreamer-1.18.4.tar.xz
sudo tar -xf gstreamer-1.18.4.tar.xz
cd gstreamer-1.18.4
# make an installation folder
mkdir build && cd build
# run meson (a kind of cmake)
meson --prefix=/usr \
        --wrap-mode=nofallback \
        -D buildtype=release \
        -D gst_debug=true \
        -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
        -D package-name="GStreamer 1.18.4 BLFS" ..
# build the software
ninja -j4
# test the software (optional)
ninja test
# install the libraries
sudo ninja install
sudo ldconfig

Download and unpack base plugins

cd ~
wget https://gstreamer.freedesktop.org/src/gst-plugins-base/gst-plugins-base-1.18.4.tar.xz
sudo tar -xf gst-plugins-base-1.18.4.tar.xz
# make an installation folder
cd gst-plugins-base-1.18.4
mkdir build
cd build
# run meson
meson --prefix=/usr \
-D buildtype=release \
-D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ ..
ninja -j4
# optional
# ninja test
# install the libraries
sudo ninja install
sudo ldconfig

Download and unpack good plugins

cd ~
sudo apt-get install -y libjpeg-dev
# download and unpack the plug-ins good
wget https://gstreamer.freedesktop.org/src/gst-plugins-good/gst-plugins-good-1.18.4.tar.xz
sudo tar -xf gst-plugins-good-1.18.4.tar.xz
cd gst-plugins-good-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
       -D buildtype=release \
       -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
       -D package-name="GStreamer 1.18.4 BLFS" ..
ninja -j4
# optional
ninja test
# install the libraries
sudo ninja install
sudo ldconfig

Download and unpack bad plugins

cd ~
# dependencies for RTMP streaming (YouTube)
sudo apt install -y librtmp-dev
sudo apt-get install -y libvo-aacenc-dev
# download and unpack the plug-ins bad
wget https://gstreamer.freedesktop.org/src/gst-plugins-bad/gst-plugins-bad-1.18.4.tar.xz
sudo tar -xf gst-plugins-bad-1.18.4.tar.xz
cd gst-plugins-bad-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
       -D buildtype=release \
       -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
       -D package-name="GStreamer 1.18.4 BLFS" ..
ninja -j4
# optional
# ninja test
# install the libraries
sudo ninja install
sudo ldconfig

Download and unpack ugly plugins

cd ~
# download and unpack the plug-ins ugly
wget https://gstreamer.freedesktop.org/src/gst-plugins-ugly/gst-plugins-ugly-1.18.4.tar.xz
sudo tar -xf gst-plugins-ugly-1.18.4.tar.xz
cd gst-plugins-ugly-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
      -D buildtype=release \
      -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
      -D package-name="GStreamer 1.18.4 BLFS" ..
ninja -j4
# optional
ninja test
# install the libraries
sudo ninja install
sudo ldconfig

# test if the module exists (for instance x264enc)
gst-inspect-1.0 x264enc
# if not, make sure you have the libraries installed
# stackoverflow is your friend here
sudo apt-get install libx264-dev
# check which the GStreamer site which plugin holds the module

download and unpack omxh264enc plugins

cd ~
# Download and unpack the plug-in gst-omx
wget https://gstreamer.freedesktop.org/src/gst-omx/gst-omx-1.18.4.tar.xz
sudo tar -xf gst-omx-1.18.4.tar.xz
cd gst-omx-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
       -D header_path=/opt/vc/include/IL \
       -D target=rpi \
       -D buildtype=release ..
ninja -j4
# optional
ninja test
# install the libraries
sudo ninja install
sudo ldconfig

Download and unpack rtsp server

cd ~
wget https://gstreamer.freedesktop.org/src/gst-rtsp-server/gst-rtsp-server-1.18.4.tar.xz
tar -xf gst-rtsp-server-1.18.4.tar.xz
cd gst-rtsp-server-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
       --wrap-mode=nofallback \
       -D buildtype=release \
       -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
       -D package-name="GStreamer 1.18.4 BLFS" ..
ninja -j4
# install the libraries
sudo ninja install
sudo ldconfig

sudo apt install gir1.2-gst-rtsp-server-1.0

gst python


cd ~
wget https://gstreamer.freedesktop.org/src/gst-python/gst-python-1.18.4.tar.xz
tar -xf gst-python-1.18.4.tar.xz
cd gst-python-1.18.4
# make an installation folder
mkdir build && cd build
# run meson
meson --prefix=/usr       \
      -D buildtype=release \
      -D package-origin=https://gstreamer.freedesktop.org/src/gstreamer/ \
      -D package-name="GStreamer 1.18.4 BLFS" ..
ninja -j4
# install the libraries
sudo ninja install
sudo ldconfig

Test the streams

cd ~/gst-rtsp-server-1.18.4/build/examples
# run the test pipeline
./test-launch "( videotestsrc ! x264enc ! rtph264pay name=pay0 pt=96 )"

# run camera pipeline
./test-launch "v4l2src device=/dev/video0 ! video/x-h264, width=640, height=480, framerate=30/1 ! h264parse config-interval=1 ! rtph264pay name=pay0 pt=96"

./test-launch "v4l2src device=/dev/video0 ! video/x-h264, width=640, height=480, framerate=30/1 ! h264parse config-interval=1 ! rtph264pay name=pay0 pt=96"

Receiver

gst-launch-1.0 rtspsrc location=rtsp://192.168.178.32:8554/test/ latency=10 ! decodebin ! autovideosink

or

vlc rtsp://serverip:8554/test

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Install_RTSP.md

Install_RTSP.md

Create Simple RTSP Server on Raspberry Pi or Similar Computer

Receiver / Client

Prerequisits on Client

Network

Script to run Viewer

Overlay

Test the SVG Graphic Object

Test with RTSP

Modify the Server Settings

Build the RTSP Server

Server Dependencies

Create RTSP Server

Alternative: Installing latest gstreamer,build from source

Build and Install Gstreamer RTSP Server

Test the Streams

Create Shell Script to Simplify Start of Server

Run the Script at Boot

Make the Device Wired and Compliant

Build from source 1.18.4

Remove the old version of gstreamer

Download and unpack gstreamer

Download and unpack base plugins

Download and unpack good plugins

Download and unpack bad plugins

Download and unpack ugly plugins

download and unpack omxh264enc plugins

Download and unpack rtsp server

gst python

Test the streams

Receiver

Files

Install_RTSP.md

Latest commit

History

Install_RTSP.md

File metadata and controls

Create Simple RTSP Server on Raspberry Pi or Similar Computer

Receiver / Client

Prerequisits on Client

Network

Script to run Viewer

Overlay

Test the SVG Graphic Object

Test with RTSP

Modify the Server Settings

Build the RTSP Server

Server Dependencies

Create RTSP Server

Alternative: Installing latest gstreamer,build from source

Build and Install Gstreamer RTSP Server

Test the Streams

Create Shell Script to Simplify Start of Server

Run the Script at Boot

Make the Device Wired and Compliant

Build from source 1.18.4

Remove the old version of gstreamer

Download and unpack gstreamer

Download and unpack base plugins

Download and unpack good plugins

Download and unpack bad plugins

Download and unpack ugly plugins

download and unpack omxh264enc plugins

Download and unpack rtsp server

gst python

Test the streams

Receiver