Filip/playwright
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
2809 commits 34 branches 141 tags 223 MiB
Commit graph

55 commits

Author SHA1 Message Date
Joel Einbinder 012f9425bf
chore(test-runner): move into its own folder and typescript project (#3548) 2020-08-20 16:04:27 -07:00
Pavel Feldman 30f4c0c9fe
test runner: remove dependencies on playwright (#3539) 2020-08-19 17:47:24 -07:00
Max Schmitt 8ea280090d
devops: first implementation of browser auto-roll bot (#3455) 
Relates #3258

After a chat with @aslushnikov we add this in two iterations. The first one (this PR) is about scheduled runs for testing the latest tip-of-tree version of the browsers daily and the next PR is about opening an automated PRs once its passing (not sure if its worth to add for failing too) or sending Telegram/Slack notifications.

Current status is that Firefox (around 2 hours) and WebKit (around 3-4 hours) works.

Known issues which I fix before we merge:
- ~~Changes in `test/base.fixture.ts` will get extracted in #3453~~

Feel free to review, current blockers are before we can merge:
- ~~#3453~~
- potential git clone optimisation by aslushnikov
 2020-08-17 11:23:46 -07:00
Pavel Feldman 262e886940
test: organize golden files under __snapshots__ folder (#3494) 2020-08-16 19:19:52 -07:00
Dmitry Gozman 9b52ca8676
chore: remove unused non-rpc code, test options, infra, bots (#3444) 2020-08-13 16:00:23 -07:00
Dmitry Gozman 84ca0120f8
test: upload output from headful bots (#3439) 2020-08-13 09:33:43 -07:00
Joel Einbinder d3677357b8
feat(testrunner): take the first argument as the test root dir (#3423) 2020-08-12 20:01:13 -07:00
Yury Semikhatsky f0fcdc8f51
test(firefox): make headful screencast tests work under xvfb (#3421) 2020-08-12 16:07:01 -07:00
Pavel Feldman a4a07c46c3
test: support --grep, --forbid-only (#3417) 2020-08-12 14:57:37 -07:00
Pavel Feldman 962ddc09c4
test: consolidate runner files (#3415) 2020-08-12 13:47:44 -07:00
Pavel Feldman 7e07634cc6
test: use mocha in ci/cd (#3406) 2020-08-12 11:48:30 -07:00
Dmitry Gozman 8bb6d73b44
feat(rpc): keep non-rpc linux bots for now (#3381) 2020-08-10 20:49:53 -07:00
Andrey Lushnikov 421f6f48c7
devops: use playwright-github-action@v1 (#3221) 
The playwright-github-action@v1 now points to v1.4.3, so we can
switch to it once again.
 2020-07-30 17:47:39 -07:00
Andrey Lushnikov 77b1c4b883
devops: enable Ubuntu 20.04 tests (#3178) 2020-07-29 11:36:38 -07:00
Yury Semikhatsky 79ab07bd0d
devops: install Media Pack on Windows bot (#3137) 2020-07-23 18:06:16 -07:00
Dmitry Gozman d234dac752
chore: support esm imports (#3125) 2020-07-23 15:14:36 -07:00
Joel Einbinder 773ee08e9d
chore(test): restore api coverage checks (#3068) 
* chore(test): restore api coverage checks

* try to catch the correct error on the bots

* try to trick github into taking the new code

* uninstall coverage

* dgozman comments
 2020-07-22 09:08:10 -07:00
Joel Einbinder 3c151d8f1d
fix(test): don't output babel's debug info on the bots (#3073) 2020-07-21 16:23:46 -07:00
Pavel Feldman b5f9985d3a
devops: make headful a matrix, collect test results (#3027) 2020-07-18 10:50:58 -07:00
Pavel Feldman 9d9801192e
test: wire test commands to jest (#3014) 2020-07-17 16:09:27 -07:00
Pavel Feldman 424f11d165
test: convert some tests to the jest+fixtures (#2983) 2020-07-16 16:59:45 -07:00
Pavel Feldman ecc130c644
test: convert evaluation.spec to jest+fixtures (#2968) 2020-07-16 11:18:38 -07:00
Pavel Feldman 19cd96c46a
test: add the jest-circus experimental runner (#2962) 2020-07-15 16:52:41 -07:00
Dmitry Gozman 2151757621
feat(rpc): run rpc tests in-process and out-of-process (#2929) 2020-07-13 15:00:20 -07:00
Dmitry Gozman 6d94c92053
feat(rpc): support no-serialization mode, run hook tests (#2925) 
Added rpc_json_linux bots to excercise serialization - these
do not run hook tests.
 2020-07-13 08:31:20 -07:00
Pavel Feldman 982e5e3550
devops: collect artifacts from browser locations (#2913) 2020-07-10 16:15:00 -07:00
Pavel Feldman d561465214
devops: use matrix in GHA, add non-linux rpc (#2907) 2020-07-10 13:15:57 -07:00
Dmitry Gozman 5c4751d5dd
chore: generate protocol during browser roll (#2719) 
We now commit protocol.ts files during the roll.
New utils/roll_browser.js helps with that.

This makes our installation very shallow:
- build installer;
- download browsers.
 2020-07-01 15:22:29 -07:00
Andrey Lushnikov 6afb38d32f
devops: remove folder creation in github actions (#2779) 
This should be no longer required.
 2020-06-30 23:34:36 -07:00
Pavel Feldman 10a9eef832
chore(rpc): add a channel bot (#2773) 2020-06-30 18:51:36 -07:00
Yury Semikhatsky 22b4a6bd27
devops: enable coredumps for headful tests (#2678) 2020-06-23 17:18:29 -07:00
Yury Semikhatsky 49cb96c433
devops: enable core dumps in the subshell (#2555) 2020-06-11 23:58:24 -07:00
Yury Semikhatsky 48088222ed
devops: enable core dumps on Linux CI (#2552) 2020-06-11 16:41:58 -07:00
Andrey Lushnikov 37ec3a6ae6
fix(types): properly export typescript types from packages (#2364) 
Drive-by: move package tests from `//test/installation-tests` to
`//packages/installation-tests`

Fix #2349
 2020-05-26 17:19:05 -07:00
Dmitry Gozman 963dc72dd2
devops: add headful linux bot (#2060) 2020-05-04 15:15:51 -07:00
Ross Wollman 995c3eb4b5
devops: run install tests on common node versions (#2069) 
Fixes #2059
 2020-05-01 00:10:52 -07:00
Arjun Attam c921cc19ec
chore: use xvfb from newer github action (#2035) 2020-04-29 15:07:21 -07:00
Andrey Lushnikov c474c540a3
devops: run CI against release branches too (#1910) 2020-04-21 19:20:19 -07:00
Andrey Lushnikov 193582445d
devops: add package-lock.json (#1859) (#1889) 
We need to commit `package-lock.json` to repository to ensure
reproducible builds.

This also starts using [`npm ci`](https://docs.npmjs.com/cli/ci.html) to
install dependencies.

Drive-by: remove non-functioning `rebase` workflow.
 2020-04-20 16:57:01 -07:00
Pavel Feldman 92b6bc0eb9 Revert "devops: add package-lock.json (#1859)" 
This reverts commit 75f35e48a8.

It is unclear how to add/remove dependencies now.
 2020-04-18 22:27:25 -07:00
Andrey Lushnikov 75f35e48a8
devops: add package-lock.json (#1859) 
We need to commit `package-lock.json` to repository to ensure
reproducible builds.

This also starts using [`npm ci`](https://docs.npmjs.com/cli/ci.html) to
install dependencies.

Drive-by: remove non-functioning `rebase` workflow.
 2020-04-18 22:14:06 -07:00
Andrey Lushnikov 52fe02eea6
devops: enforce strict treatment of unhandled rejections (#1789) 
Run all our tests with node.js flag `--unhandled-rejections=strict`.
 2020-04-14 22:40:33 -07:00
Dmitry Gozman 274c6c1450
test(chromium): add more oopif tests (#1685) 2020-04-14 13:00:10 -07:00
Dmitry Gozman 7189d19913
feat(ci): upload test output folder from github actions (#1733) 2020-04-09 16:57:01 -07:00
Arjun Attam d5a746aaba
chore(ci): use playwright github action (#1712) 2020-04-08 15:23:00 -07:00
Andrey Lushnikov 65ca87cd9a
fix: fix PLAYWRIGHT_BROWSERS_PATH treatment (#1662) 
Drive-by: introduce installation tests that use `npm pack`
to simulate installation from NPM registry.

Fixes #1651
 2020-04-03 23:16:14 -07:00
Max Schmitt 692f4db0a7
devops(ci): added job for testing package installations (#1572) 
Closes #1518
 2020-04-02 11:25:03 -07:00
Andrey Lushnikov 19dd2338d9 devops: remove verbose on WebKit Win on Github Actions 2020-03-13 14:44:54 -07:00
Andrey Lushnikov 5c9ebfaa79
chore(ci): bump checkout action to v2 (#1263) 
This should fix the checkout problems we're facing.
Related discussion: https://github.com/actions/checkout/issues/23
 2020-03-06 09:40:54 -08:00
Andrey Lushnikov 0ded511d0b
feat(testrunner): better matchers (#1077) 
This patch re-implements matching and reporting for test runner.
Among other improvements:
- test failures now show a short snippet from test
- test failures now explicitly say what received and what was expected
- `expect.toBe()` now does text diff when gets strings as input
- `expect.toEqual` now does object diff
 2020-02-20 22:55:39 -08:00