bigbluebutton-Github/labs/docker

IMPORTANT: this is a work in progress!

Purpose

The purpose of this repo is to get BigBlueButton working in a multi-container Docker configuration over a single port, then to deploy and scale it using Kubernetes

Launching BBB via Docker

Prerequisites

Ensure you have the latest version of Docker-CE by following the install steps

Ubuntu: https://docs.docker.com/install/linux/docker-ce/ubuntu/

Fedora: https://docs.docker.com/install/linux/docker-ce/fedora/

Make sure to also do the post install steps

https://docs.docker.com/install/linux/linux-postinstall/

Install docker-compose

Ubuntu:

sudo apt-get install docker-compose

Fedora:

sudo dnf install docker-compose

Build all docker images

Build all docker images with one command

cd labs/docker/
make release

Verify that you have all the necessary images

docker images

You should see:

• sbt
• bbb-common-message
• bbb-common-web
• bbb-fsesl-client
• bbb-apps-akka
• bbb-fsesl-akka
• bbb-web
• bbb-html5
• bbb-webrtc-sfu
• bbb-webhooks
• bbb-kurento
• bbb-freeswitch
• bbb-nginx
• bbb-coturn
• bbb-lti

In the event that any of the above images are missing, you'll need to build them individually

Build images individually

sbt is needed to build the Scala components

cd labs/docker/sbt/
docker build -t 'sbt:0.13.8' .

Build libraries

cd bbb-common-message/
docker build -t 'bbb-common-message' --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

cd bbb-common-web/
docker build -t 'bbb-common-web' --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

cd bbb-fsesl-client/
docker build -t 'bbb-fsesl-client' --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

Build akka components

cd akka-bbb-apps/
docker build -t bbb-apps-akka --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

# Not needed since we're setting up HTML5 only
cd akka-bbb-transcode/
docker build -t bbb-transcode --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

cd akka-bbb-fsesl/
docker build -t bbb-fsesl-akka --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

Build bbb-web

cd bigbluebutton-web/
docker build -t bbb-web --build-arg COMMON_VERSION=0.0.1-SNAPSHOT .

Build bbb-html5

cd bigbluebutton-html5/
docker build -t bbb-html5 .

Build bbb-webrtc-sfu

cd labs/bbb-webrtc-sfu/
docker build -t bbb-webrtc-sfu .

Build bbb-webhooks

cd bbb-webhooks/
docker build -t bbb-webhooks .

Build Kurento Media Server

cd labs/docker/kurento/
docker build -t bbb-kurento .

Build FreeSWITCH

cd labs/docker/freeswitch/
docker build -t bbb-freeswitch .

Build nginx

cd labs/docker/nginx/
docker build -t bbb-nginx .

Build coturn

cd labs/docker/coturn
docker build -t bbb-coturn .

(Optional) Build bbb-lti

cd bbb-lti/
docker build -t bbb-lti .

Setup

Export your configuration as environment variables

NOTE: replace the example SERVER_DOMAIN's value with your own FQDN

export SERVER_DOMAIN=docker.bigbluebutton.org
export EXTERNAL_IP=$(dig +short $SERVER_DOMAIN | grep '^[0-9]*\.[0-9]*\.[0-9]*\.[0-9]*$' | head -n 1)
export SHARED_SECRET=`openssl rand -hex 16`
export COTURN_REST_SECRET=`openssl rand -hex 16`
export SECRET_KEY_BASE=`openssl rand -hex 64`
export SCREENSHARE_EXTENSION_KEY=akgoaoikmbmhcopjgakkcepdgdgkjfbc
export SCREENSHARE_EXTENSION_LINK=https://chrome.google.com/webstore/detail/bigbluebutton-screenshare/akgoaoikmbmhcopjgakkcepdgdgkjfbc
export TAG_PREFIX=
export TAG_SUFFIX=

Create a volume for the SSL certs

docker volume create docker_ssl-conf	

Generate SSL certs

docker run --rm -p 80:80 -v docker_ssl-conf:/etc/letsencrypt -it certbot/certbot certonly --non-interactive --register-unsafely-without-email --agree-tos --expand --domain $SERVER_DOMAIN --standalone	

# certificate path: docker_ssl-conf/live/$SERVER_DOMAIN/fullchain.pem	
# key path: docker_ssl-conf/live/$SERVER_DOMAIN/privkey.pem	

NOTE: If running on AWS, you won't be able to use the default Public DNS for your SERVER_DOMAIN as Let's Encrypt doesn't allow generating SSL certs from any *.amazonaws.com domain. Alternatively, you can create a PTR record that goes from a non-AWS FQDN to the AWS FQDN.

Create a volume for the static files (optional)

docker volume create docker_static
cd bigbluebutton-config/web/
docker run -d --rm --name nginx -v docker_static:/var/www/bigbluebutton-default nginx tail -f /dev/null
docker cp . nginx:/var/www/bigbluebutton-default
docker exec -it nginx chown -R www-data:www-data /var/www/bigbluebutton-default
docker stop nginx

Ensure the following ports are open

• TCP/UDP 3478
• TCP 80
• TCP 443

Run

Launch everything with docker compose

cd labs/docker/
docker-compose up

Access your server via greenlight and create meetings

https://<your_fqdn_here>/b

To shut down and exit gracefully

CTRL+C

Setting up a Kubernetes Cluster

Prerequisites

Install kubeadm, kubelet, and kubectl

https://kubernetes.io/docs/setup/independent/install-kubeadm/

Disable swap by commenting out the "swap" line in /etc/fstab, then do a reboot

sudo vi /etc/fstab
sudo systemctl reboot

Verify swap is disabled

sudo free -h

Install Minikube

https://kubernetes.io/docs/tasks/tools/install-minikube/

Install VirtualBox Manager

Ubuntu:

sudo apt-get install virtualbox

Fedora:

sudo dnf install virtualbox

Setup

The following kernel modules are required to avoid preflight errors and warnings during cluster setup

• ip_vs
• ip_vs_rr
• ip_vs_wrr
• ip_vs_sh

Check if kernel modules are already loaded

lsmod | grep ip_vs

Add the kernel modules (if not already loaded)

sudo modprobe ip_vs
sudo modprobe ip_vs_rr
sudo modprobe ip_vs_wrr
sudo modprobe ip_vs_sh

Create a single master cluster with kubeadm

https://kubernetes.io/docs/setup/independent/create-cluster-kubeadm/