bigbluebutton-Github/bigbluebutton-tests/playwright
Gabriel Luiz Porfirio a5099854cf
test: fix chat tests on ci (#18702)
* fixing chat tests

* added id for testing

* fix chat tests on ci

* id for the tests

* fix failing tests

* removing .only

* fixing failing chat tests

* changed from id to data-test
2023-09-06 15:18:13 -03:00
..
api test: fix and update tests 2023-02-14 10:59:46 -03:00
audio test: 2.7 tests fixes 2023-08-22 17:25:50 -03:00
breakout adding flaky tag to failing tests on ci 2023-08-23 17:47:11 -03:00
chat test: fix chat tests on ci (#18702) 2023-09-06 15:18:13 -03:00
connectionFailure test: isolate function to check root permission and apply on connectionFailure tests 2023-06-08 14:56:14 -03:00
connectionStatus test: increase the amount of tests for CI runs 2023-05-19 10:11:24 -03:00
core test: fix chat tests on ci (#18702) 2023-09-06 15:18:13 -03:00
layouts test: minor fixes 2023-08-23 11:05:40 -03:00
learningdashboard test: 2.7 tests fixes 2023-08-22 17:25:50 -03:00
notifications Resolve conflicts 2023-08-30 15:31:32 -03:00
options adding flaky tag to failing tests on ci 2023-08-23 17:47:11 -03:00
parameters Resolve conflicts 2023-08-30 15:31:32 -03:00
polling Resolve conflicts 2023-08-30 15:31:32 -03:00
presentation Resolve conflicts 2023-08-30 15:31:32 -03:00
reconnection test: isolate function to check root permission and apply on connectionFailure tests 2023-06-08 14:56:14 -03:00
screenshare connection failure tests: this is what I wrote in February 2023 2023-03-07 21:33:22 -05:00
sharednotes test: minor fixes 2023-08-23 11:05:40 -03:00
stress update test usersJoinKeepingConnected 2022-07-22 17:44:46 -04:00
user Resolve conflicts 2023-08-30 15:31:32 -03:00
virtualizedlist test: fix and update tests 2023-02-14 10:59:46 -03:00
webcam fixing failing test on ci 2023-08-25 13:45:07 -03:00
whiteboard Resolve conflicts 2023-08-30 15:31:32 -03:00
.env.template test: add TIMEOUT_MULTIPLIER variable description 2023-05-19 09:30:40 -03:00
.gitignore add debug features 2022-02-28 18:21:50 -03:00
package-lock.json test: update playwright dependencies 2023-08-31 09:43:31 -03:00
package.json test: update playwright dependencies 2023-08-31 09:43:31 -03:00
playwright.config.js ci(tests): use sharding on CI test execution + use matrix on build step and set the merge branches action as a reusable workflow 2023-08-31 10:39:27 -03:00
README.md test: update instructions to only test specific browser 2023-03-31 15:37:07 -04:00

BigBlueButton Playwright Tests

Tests for BigBlueButton using Playwright.

Setup (with an existing BigBlueButton server)

You need to install the dependencies:

$ cd ../bigbluebutton-tests/playwright
$ npm install
$ npx playwright install

You may also need to run the following command:

$ npx playwright install-deps

To run these tests with an existing BigBlueButton server, you need to find the server's URL and secret (can be done with bbb-conf --secret command). You need to put them into the .env file inside bigbluebutton-tests/playwright folder (variables BBB_URL and BBB_SECRET). Note: the value for BBB_URL follows the format of https://<hostname>/bigbluebutton/api.

Run tests

We recommend to use Node version 16 or higher to avoid errors in JavaScript. Tests can be executed using npx and npm test. You can run all tests in each of 3 supported environments (chromium, firefox, webkit) with one of the following commands:

$ npx playwright test
or
$ npm test

You can also run a single test suite and limit the execution to only one browser:

$ npx playwright test chat --project="firefox"
or
$ npm test chat -- --project="firefox" # or "chromium" for example

Additional commands

To see the tests running visually, you must run them in headed mode:

$ npm run test:headed chat

If you want to run a specific test or a specific group of tests, you can do so with the following command:

$ npm run test:filter "Send public message"

(note that this filter needs to be passed in "double quotes")

You can also use this also through the test tree, adding the test suite / group of tests before the test filter:

$ npm run test:filter "notifications chat"

If you don't have BBB_URL and BBB_SECRET set, but have ssh access to the test server, you can use the following command to obtain BBB_URL and BBB_SECRET via ssh:

$ npm run test:ssh -- HOSTNAME

Recording Meteor messages

A modified version of websockify can be used to record the Meteor messages exchanged between client and server, by inserted a WebSocket proxy between the client and server, configured to record the sessions.

First, on the server, obtain the modified websockify:

git clone https://github.com/BrentBaccala/websockify.git

Install additional dependencies:

sudo apt install python3-numpy

Then add the following stanza to /usr/share/bigbluebutton/nginx/bbb-html5.nginx:

location ~* /html5client/.*/websocket {
  proxy_pass http://127.0.0.1:4200;
  proxy_http_version 1.1;
  proxy_set_header Upgrade $http_upgrade;
  proxy_set_header Connection "Upgrade";
}

From the websockify directory, run websockify configured to proxy WebSocket connections from port 4200 to port 4100, recording the sessions to files named bbb.1, bbb.2, etc.:

./run -v --record=bbb --ws-target=ws://localhost:4100{path} 4200

Now reload nginx:

sudo systemctl reload nginx

Meteor messages for Big Blue Button sessions will now be recorded for later review.

It doesn't seem necessary to relay cookies, but that could be done by giving a --ws-relay-header=Cookie argument to websockify.

You can print the browser console log to standard output by setting the environment variable CONSOLE:

$ CONSOLE= npm test chat -- --project=firefox

CONSOLE can be blank (as in the example), or can be a comma-separated list of the following options:

Option Meaning
color (or "colour") colorize the output
label label each line with the BigBlueButton user
norefs remove JavaScript reference URLs
nots remove timestamps
nocl remove "clientLogger:" strings