Matrix/element-android-Github
1
0
Fork 0
mirror of https://github.com/vector-im/element-android.git synced 2024-11-29 15:40:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
10ea166b2a
element-android-Github/.github/workflows/nightly.yml

358 lines
15 KiB
YAML
Raw Normal View History

Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
name: Nightly Tests
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
on:
push:
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
branches: [ release/* ]
schedule:
# At 20:00 every day UTC
- cron: '0 20 * * *'
workflow_dispatch:
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
# Enrich gradle.properties for CI/CD
env:
CI_GRADLE_ARG_PROPERTIES: >
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
-Porg.gradle.jvmargs=-Xmx4g
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
-Porg.gradle.parallel=false
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
-PallWarningsAsErrors=false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
jobs:
# Build Android Tests [Matrix SDK]
build-android-test-matrix-sdk:
name: Matrix SDK - Build Android Tests
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
runs-on: macos-latest
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# No concurrency required, runs every time on a schedule.
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
steps:
- uses: actions/checkout@v2
Allow workflows to be triggered manually without sending notification and force java 11
2022-02-28 22:37:14 +08:00
- uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: 11
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- uses: actions/cache@v2
with:
path: |
~/.gradle/caches
~/.gradle/wrapper
key: ${{ runner.os }}-gradle-${{ hashFiles('**/*.gradle*', '**/gradle-wrapper.properties') }}
restore-keys: |
${{ runner.os }}-gradle-
- name: Build Android Tests for matrix-sdk-android
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
run: ./gradlew clean matrix-sdk-android:assembleAndroidTest $CI_GRADLE_ARG_PROPERTIES --stacktrace
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
# Build Android Tests [Matrix APP]
build-android-test-app:
name: App - Build Android Tests
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
runs-on: macos-latest
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# No concurrency required, runs every time on a schedule.
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
steps:
- uses: actions/checkout@v2
Allow workflows to be triggered manually without sending notification and force java 11
2022-02-28 22:37:14 +08:00
- uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: 11
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- uses: actions/cache@v2
with:
path: |
~/.gradle/caches
~/.gradle/wrapper
key: ${{ runner.os }}-gradle-${{ hashFiles('**/*.gradle*', '**/gradle-wrapper.properties') }}
restore-keys: |
${{ runner.os }}-gradle-
- name: Build Android Tests for vector
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
run: ./gradlew clean vector:assembleAndroidTest $CI_GRADLE_ARG_PROPERTIES --stacktrace
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# Run Android Tests
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
integration-tests:
name: Matrix SDK - Running Integration Tests
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
runs-on: macos-latest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
strategy:
fail-fast: false
matrix:
api-level: [ 28 ]
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# No concurrency required, runs every time on a schedule.
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
steps:
- uses: actions/checkout@v2
- uses: gradle/wrapper-validation-action@v1
- uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: 11
- name: Set up Python 3.8
Bump actions/setup-python from 2 to 3 Bumps [actions/setup-python](https://github.com/actions/setup-python) from 2 to 3. - [Release notes](https://github.com/actions/setup-python/releases) - [Commits](https://github.com/actions/setup-python/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/setup-python dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2022-03-01 07:03:07 +08:00
uses: actions/setup-python@v3
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
with:
python-version: 3.8
- uses: actions/cache@v2
with:
path: |
~/.gradle/caches
~/.gradle/wrapper
key: ${{ runner.os }}-gradle-${{ hashFiles('**/*.gradle*', '**/gradle-wrapper.properties') }}
restore-keys: |
${{ runner.os }}-gradle-
- name: Start synapse server
run: |
Do not install `synapse` only `matrix-synapse`. Synapse is something entirely different: https://pypi.org/project/synapse/
2022-02-23 23:58:05 +08:00
pip install matrix-synapse
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
curl https://raw.githubusercontent.com/matrix-org/synapse/develop/demo/start.sh -o start.sh
chmod 777 start.sh
./start.sh --no-rate-limit
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# package: org.matrix.android.sdk.session
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Run integration tests for Matrix SDK [org.matrix.android.sdk.session] API[${{ matrix.api-level }}]
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
Update integration_tests.yml Undo 1 core usage Undo force-avd-creation
2022-01-07 19:59:43 +08:00
force-avd-creation: false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
script: |
adb root
adb logcat -c
touch emulator-session.log
chmod 777 emulator-session.log
adb logcat >> emulator-session.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -Pandroid.testInstrumentationRunnerArguments.package='org.matrix.android.sdk.session' matrix-sdk-android:connectedDebugAndroidTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Read Results [org.matrix.android.sdk.session]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
id: get-comment-body-session
Correct name of script
2022-02-24 19:40:04 +08:00
run: python3 ./tools/ci/render_test_output.py session ./matrix-sdk-android/build/outputs/androidTest-results/connected/*.xml
Use pkill (killall has a failuremode of killing PID 1 on some systems)
2022-03-01 01:08:52 +08:00
- name: Remove adb logcat
if: always()
run: pkill -9 adb
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Run integration tests for Matrix SDK [org.matrix.android.sdk.account] API[${{ matrix.api-level }}]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
Update integration_tests.yml Undo 1 core usage Undo force-avd-creation
2022-01-07 19:59:43 +08:00
force-avd-creation: false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
script: |
adb root
adb logcat -c
touch emulator-account.log
chmod 777 emulator-account.log
adb logcat >> emulator-account.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -Pandroid.testInstrumentationRunnerArguments.package='org.matrix.android.sdk.account' matrix-sdk-android:connectedDebugAndroidTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Read Results [org.matrix.android.sdk.account]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
id: get-comment-body-account
Correct name of script
2022-02-24 19:40:04 +08:00
run: python3 ./tools/ci/render_test_output.py account ./matrix-sdk-android/build/outputs/androidTest-results/connected/*.xml
Use pkill (killall has a failuremode of killing PID 1 on some systems)
2022-03-01 01:08:52 +08:00
- name: Remove adb logcat
if: always()
run: pkill -9 adb
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# package: org.matrix.android.sdk.internal
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Run integration tests for Matrix SDK [org.matrix.android.sdk.internal] API[${{ matrix.api-level }}]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
Update integration_tests.yml Undo 1 core usage Undo force-avd-creation
2022-01-07 19:59:43 +08:00
force-avd-creation: false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
script: |
adb root
adb logcat -c
touch emulator-internal.log
chmod 777 emulator-internal.log
adb logcat >> emulator-internal.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -Pandroid.testInstrumentationRunnerArguments.package='org.matrix.android.sdk.internal' matrix-sdk-android:connectedDebugAndroidTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Read Results [org.matrix.android.sdk.internal]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
id: get-comment-body-internal
Correct name of script
2022-02-24 19:40:04 +08:00
run: python3 ./tools/ci/render_test_output.py internal ./matrix-sdk-android/build/outputs/androidTest-results/connected/*.xml
Use pkill (killall has a failuremode of killing PID 1 on some systems)
2022-03-01 01:08:52 +08:00
- name: Remove adb logcat
if: always()
run: pkill -9 adb
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# package: org.matrix.android.sdk.ordering
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Run integration tests for Matrix SDK [org.matrix.android.sdk.ordering] API[${{ matrix.api-level }}]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
Update integration_tests.yml Undo 1 core usage Undo force-avd-creation
2022-01-07 19:59:43 +08:00
force-avd-creation: false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
script: |
adb root
adb logcat -c
touch emulator-ordering.log
chmod 777 emulator-ordering.log
adb logcat >> emulator-ordering.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -Pandroid.testInstrumentationRunnerArguments.package='org.matrix.android.sdk.ordering' matrix-sdk-android:connectedDebugAndroidTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Read Results [org.matrix.android.sdk.ordering]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
id: get-comment-body-ordering
Correct name of script
2022-02-24 19:40:04 +08:00
run: python3 ./tools/ci/render_test_output.py ordering ./matrix-sdk-android/build/outputs/androidTest-results/connected/*.xml
Use pkill (killall has a failuremode of killing PID 1 on some systems)
2022-03-01 01:08:52 +08:00
- name: Remove adb logcat
if: always()
run: pkill -9 adb
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# package: class PermalinkParserTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Run integration tests for Matrix SDK class [org.matrix.android.sdk.PermalinkParserTest] API[${{ matrix.api-level }}]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
Update integration_tests.yml Undo 1 core usage Undo force-avd-creation
2022-01-07 19:59:43 +08:00
force-avd-creation: false
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
script: |
adb root
adb logcat -c
touch emulator-permalink.log
chmod 777 emulator-permalink.log
adb logcat >> emulator-permalink.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -Pandroid.testInstrumentationRunnerArguments.class='org.matrix.android.sdk.PermalinkParserTest' matrix-sdk-android:connectedDebugAndroidTest
Quick hack python to render the xml test output including times in a easy to read format.
2022-02-24 22:47:23 +08:00
- name: Read Results [org.matrix.android.sdk.PermalinkParserTest]
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always()
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
id: get-comment-body-permalink
Correct name of script
2022-02-24 19:40:04 +08:00
run: python3 ./tools/ci/render_test_output.py permalink ./matrix-sdk-android/build/outputs/androidTest-results/connected/*.xml
Use pkill (killall has a failuremode of killing PID 1 on some systems)
2022-03-01 01:08:52 +08:00
- name: Remove adb logcat
if: always()
run: pkill -9 adb
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# package: class PermalinkParserTest
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- name: Find Comment
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always() && github.event_name == 'pull_request'
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: peter-evans/find-comment@v1
id: fc
with:
issue-number: ${{ github.event.pull_request.number }}
comment-author: 'github-actions[bot]'
body-includes: Integration Tests Results
- name: Publish results to PR
Move from `continue_on_error` to `if: always()`. This will allow previous steps to explicitly fail and be marked as failed but later steps will continue to run in order to display the outcomes. (there's probably a better way to do this, but this will at least start to expose the errors in the UI)
2022-02-24 02:00:54 +08:00
if: always() && github.event_name == 'pull_request'
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
uses: peter-evans/create-or-update-comment@v1
with:
comment-id: ${{ steps.fc.outputs.comment-id }}
issue-number: ${{ github.event.pull_request.number }}
body: |
### Matrix SDK
## Integration Tests Results:
- `[org.matrix.android.sdk.session]`<br>${{ steps.get-comment-body-session.outputs.session }}
- `[org.matrix.android.sdk.account]`<br>${{ steps.get-comment-body-account.outputs.account }}
fix typo
2022-01-06 06:38:05 +08:00
- `[org.matrix.android.sdk.internal]`<br>${{ steps.get-comment-body-internal.outputs.internal }}
- Fix integration tests (still not perfect while github actions are very very limited for that) - Split them in msdk and app test along with multiple smaller steps. - Mark the not working tests with @Ignore so that they will not run neither local or on github actions - Add user friendly comment on PR to view the results
2022-01-04 07:04:41 +08:00
- `[org.matrix.android.sdk.ordering]`<br>${{ steps.get-comment-body-ordering.outputs.ordering }}
- `[org.matrix.android.sdk.PermalinkParserTest]`<br>${{ steps.get-comment-body-permalink.outputs.permalink }}
edit-mode: replace
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
- name: Upload Test Report Log
uses: actions/upload-artifact@v2
if: always()
with:
name: integrationtest-error-results
path: |
emulator-permalink.log
emulator-internal.log
emulator-ordering.log
emulator-account.log
emulator-session.log
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
ui-tests:
name: UI Tests (Synapse)
runs-on: macos-latest
strategy:
fail-fast: false
matrix:
api-level: [ 28 ]
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# No concurrency required, runs every time on a schedule.
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
steps:
- uses: actions/checkout@v2
- name: Set up Python 3.8
Bump actions/setup-python from 2 to 3 Bumps [actions/setup-python](https://github.com/actions/setup-python) from 2 to 3. - [Release notes](https://github.com/actions/setup-python/releases) - [Commits](https://github.com/actions/setup-python/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/setup-python dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2022-03-01 07:03:07 +08:00
uses: actions/setup-python@v3
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
with:
python-version: 3.8
- uses: actions/cache@v2
with:
path: |
~/.gradle/caches
~/.gradle/wrapper
key: ${{ runner.os }}-gradle-${{ hashFiles('**/*.gradle*', '**/gradle-wrapper.properties') }}
restore-keys: |
${{ runner.os }}-gradle-
- name: Start synapse server
run: |
pip install matrix-synapse
curl -sL https://raw.githubusercontent.com/matrix-org/synapse/develop/demo/start.sh \
| sed s/127.0.0.1/0.0.0.0/g | sed 's/http:\/\/localhost/http:\/\/10.0.2.2/g' | bash -s -- --no-rate-limit
- uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: '11'
- name: Run sanity tests on API ${{ matrix.api-level }}
uses: reactivecircus/android-emulator-runner@v2
with:
api-level: ${{ matrix.api-level }}
arch: x86
profile: Nexus 5X
force-avd-creation: false
emulator-options: -no-snapshot-save -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
emulator-build: 7425822 # workaround to emulator bug: https://github.com/ReactiveCircus/android-emulator-runner/issues/160
script: |
adb root
adb logcat -c
touch emulator.log
chmod 777 emulator.log
adb logcat >> emulator.log &
./gradlew $CI_GRADLE_ARG_PROPERTIES -PallWarningsAsErrors=false connectedGplayDebugAndroidTest -Pandroid.testInstrumentationRunnerArguments.class=im.vector.app.ui.UiAllScreensSanityTest || (adb pull storage/emulated/0/Pictures/failure_screenshots && exit 1 )
- name: Upload Test Report Log
uses: actions/upload-artifact@v2
if: always()
with:
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
name: uitest-error-results
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
path: |
emulator.log
failure_screenshots/
Run sonarqube as part of nightly build
2022-03-01 21:17:25 +08:00
sonarqube:
runs-on: macos-latest
if: always()
needs:
- integration-tests
- ui-tests
# - unit-tests TODO: code coverage from here too
- build-android-test-matrix-sdk
- build-android-test-app
steps:
- uses: actions/checkout@v2
Ensure we run on java 11 on macos
2022-03-02 18:31:07 +08:00
- uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: '11'
Run sonarqube as part of nightly build
2022-03-01 21:17:25 +08:00
- uses: actions/cache@v2
with:
path: |
~/.gradle/caches
~/.gradle/wrapper
key: ${{ runner.os }}-gradle-${{ hashFiles('**/*.gradle*', '**/gradle-wrapper.properties') }}
restore-keys: |
${{ runner.os }}-gradle-
- run: ./gradlew sonarqube $CI_GRADLE_ARG_PROPERTIES
env:
Correct name of environment variable
2022-03-04 00:34:26 +08:00
ORG_GRADLE_PROJECT_SONAR_LOGIN: ${{ secrets.SONAR_TOKEN }}
Run sonarqube as part of nightly build
2022-03-01 21:17:25 +08:00
Allow workflows to be triggered manually without sending notification and force java 11
2022-02-28 22:37:14 +08:00
# Notify the channel about scheduled runs, do not notify for manually triggered runs
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
notify:
runs-on: ubuntu-latest
needs:
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
- integration-tests
- ui-tests
Run sonarqube as part of nightly build
2022-03-01 21:17:25 +08:00
# - unit-tests
- build-android-test-matrix-sdk
- build-android-test-app
- sonarqube
Allow workflows to be triggered manually without sending notification and force java 11
2022-02-28 22:37:14 +08:00
if: always() && github.event_name != 'workflow_dispatch'
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
# No concurrency required, runs every time on a schedule.
Rename sanity test to nightly test, incorporate integration tests for nightly runs. Also permit manual triggering of a run.
2022-02-25 22:18:56 +08:00
steps:
Bump michaelkaye/matrix-hookshot-action from 0.2.0 to 0.3.0 Bumps [michaelkaye/matrix-hookshot-action](https://github.com/michaelkaye/matrix-hookshot-action) from 0.2.0 to 0.3.0. - [Release notes](https://github.com/michaelkaye/matrix-hookshot-action/releases) - [Commits](https://github.com/michaelkaye/matrix-hookshot-action/compare/v0.2.0...v0.3.0) --- updated-dependencies: - dependency-name: michaelkaye/matrix-hookshot-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2022-03-01 07:03:03 +08:00
- uses: michaelkaye/matrix-hookshot-action@v0.3.0
Merge branch 'develop' of github.com:vector-im/element-android into feature/dla/ci_check_concurrency
2022-02-28 20:29:52 +08:00
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
matrix_access_token: ${{ secrets.ELEMENT_ANDROID_NOTIFICATION_ACCESS_TOKEN }}
matrix_room_id: ${{ secrets.ELEMENT_ANDROID_INTERNAL_ROOM_ID }}
text_template: "Nightly test run: {{#each job_statuses }}{{#with this }}{{#if completed }} {{name}} {{conclusion}} at {{completed_at}}, {{/if}}{{/with}}{{/each}}"
Ensure we have logcat for nightly runs
2022-03-01 01:06:34 +08:00
html_template: "Nightly test run results: {{#each job_statuses }}{{#with this }}{{#if completed }}<br />{{name}} {{conclusion}} at {{completed_at}} <a href=\"{{html_url}}\">[details]</a>{{/if}}{{/with}}{{/each}}"
Reference in New Issue Copy Permalink