playwright/tests/playwright-test
Yury Semikhatsky b5082e10fd
fix: do not retry missing snapshot errors (#29272)
When `updateSnapshots === 'missing'` we generate new expectations on the
first attempt and don't retry the test afterwards instead of trying it
retries-1 times and only writing new expectation on the last attempt.
This logic infects all serial mode suites that contain the test with
missing expectations, so they also will not be retried.

Reference https://github.com/microsoft/playwright/issues/29073
2024-01-31 15:33:38 -08:00
..
__screenshots__/playwright.artifacts.spec.ts feat: allow options in automatic screenshots (#19143) 2022-12-07 08:45:33 -08:00
assets chore: allow calling spawnSync on Node.js file inside test (#26429) 2023-08-11 18:37:14 +02:00
stable-test-runner chore: roll stable-test-runner to 1.41.0-beta-1705101589000 (#28993) 2024-01-16 08:59:55 -08:00
access-data.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
babel.spec.ts chore: allow marking scripts as external for transform (#23449) 2023-06-01 20:28:49 -07:00
basic.spec.ts fix(test runner): properly handle uncaught errors in test.fail() (#27734) 2023-10-23 09:14:31 -07:00
command-line-filter.spec.ts chore: remove unnecessary args in ttest (#21012) 2023-02-18 13:08:17 -08:00
config.spec.ts fix(components): make sure defineConfig(c1, c2) works (#28608) 2023-12-12 14:01:01 -08:00
decorators.spec.ts chore: allow ts decorators (#22080) 2023-03-29 20:43:08 -07:00
deps.spec.ts chore(test runner): do not produce some of the fake skipped test results (#27730) 2023-10-20 17:01:46 -07:00
esm.spec.ts fix: exit from merge-reports in type: "module" projects (#28725) 2023-12-19 16:49:25 -08:00
exit-code.spec.ts fix: collect stdio from forked processes (#27074) 2023-09-14 18:34:26 +02:00
expect-configure.spec.ts chore: populate matcherResult in web assertions (#27133) 2023-09-16 14:24:10 -07:00
expect-poll.spec.ts chore: show last poller error on test timeout (#24292) 2023-07-18 17:03:26 -07:00
expect-soft.spec.ts chore: introduce expect.configure (#22533) 2023-04-25 10:29:56 -07:00
expect-to-pass.spec.ts feat(expect): Make toPass's option configurable by TestConfig (#28231) 2024-01-16 12:28:38 +01:00
expect.spec.ts feat(expect): Allow expect timeout to be configured outside of the runner (#28716) 2023-12-19 10:55:05 -08:00
fixture-errors.spec.ts chore: do not lose error name for js errors (#28177) 2023-11-15 18:27:32 -08:00
fixtures.spec.ts fix(test runner): make sure auto worker fixtures run before auto test fixtures (#27131) 2023-09-15 14:51:31 -07:00
gitignore.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
global-setup.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
golden.spec.ts fix: Add support for exif jpeg file formats (#29208) 2024-01-29 14:58:13 -08:00
hooks.spec.ts Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360) 2023-11-27 16:08:20 -08:00
list-files.spec.ts chore: do not lose error name for js errors (#28177) 2023-11-15 18:27:32 -08:00
list-mode.spec.ts Revert "fix: respect .only in --list mode" (#28770) 2023-12-22 11:03:30 -08:00
loader.spec.ts chore: refactor import processing in ct (#28975) 2024-01-12 20:02:27 -08:00
match-grep.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
max-failures.spec.ts chore(test runner): do not produce some of the fake skipped test results (#27730) 2023-10-20 17:01:46 -07:00
override-timeout.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
playwright-test-fixtures.ts chore: migrate ct to vite5 (#29033) 2024-01-19 11:13:03 -08:00
playwright.artifacts.spec.ts chore: get rid of rimraf package (#27790) 2023-10-26 19:41:00 +02:00
playwright.config.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
playwright.config.ts fix(blob report): default location relative to package.json (#24481) 2023-07-28 15:49:31 -07:00
playwright.connect.spec.ts Fix various typos (Fixes #27396) (#27391) 2023-10-04 19:56:42 -07:00
playwright.ct-build.spec.ts chore: automatically detect the dev server (#29176) 2024-01-25 11:46:47 -08:00
playwright.ct-react.spec.ts chore: automatically detect the dev server (#29176) 2024-01-25 11:46:47 -08:00
playwright.fetch.spec.ts test: unflake "should stop tracing on requestContext.dispose()" (#23489) 2023-06-02 16:37:50 -07:00
playwright.reuse.browser.spec.ts fix: encode launch options correctly when reusing browser (#24174) 2023-07-12 16:40:55 +02:00
playwright.reuse.spec.ts fix(trace): render items under expect.toPass (#24016) 2023-07-05 11:20:28 -07:00
playwright.spec.ts chore: get rid of rimraf package (#27790) 2023-10-26 19:41:00 +02:00
playwright.trace.spec.ts fix(test runner): make TestTracing responsible for trace management (#29181) 2024-01-26 15:52:25 -08:00
playwright.unhandled.spec.ts fix(test runner): properly handle uncaught errors in test.fail() (#27734) 2023-10-23 09:14:31 -07:00
repeat-each.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
reporter-attachment.spec.ts fix: quote trace file path when printing error message (#29052) 2024-01-18 14:23:12 -08:00
reporter-base.spec.ts chore(test runner): do not produce some of the fake skipped test results (#27730) 2023-10-20 17:01:46 -07:00
reporter-blob.spec.ts fix: make TeleSuite.project work for all suites (#29177) 2024-01-25 13:44:08 -08:00
reporter-dot.spec.ts chore: run more reporter tests through blob report, some fixes (#23765) 2023-06-16 21:30:55 -07:00
reporter-github.spec.ts chore: run more reporter tests through blob report, some fixes (#23765) 2023-06-16 21:30:55 -07:00
reporter-html.spec.ts chore: reuse image diff component in trace/html (#28727) 2023-12-22 10:17:35 -08:00
reporter-json.spec.ts feat(json report): add expected/unexpected/skipped/flaky stats (#27685) 2023-10-18 12:55:31 -07:00
reporter-junit.spec.ts fix: render JUnit attachment paths relative to outputFile (#27024) 2023-09-14 12:58:09 -07:00
reporter-line.spec.ts chore: run more reporter tests through blob report, some fixes (#23765) 2023-06-16 21:30:55 -07:00
reporter-list.spec.ts chore: more network panel polish (#26780) 2023-08-29 22:20:28 -07:00
reporter-markdown.spec.ts fix(merge): normalize path separators when merging across platforms (#28227) 2023-11-27 12:43:56 -08:00
reporter-onend.spec.ts feat(onEnd): allow overriding the exit code (#27010) 2023-09-12 13:37:30 -07:00
reporter.spec.ts fix(test runner): make TestCase.id not depend on the path separator (#29010) 2024-01-16 13:32:47 -08:00
resolver.spec.ts fix(tsconfig): handle tsconfig paths without a baseUrl (#27846) 2023-11-02 11:27:49 -07:00
retry.spec.ts Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360) 2023-11-27 16:08:20 -08:00
runner.spec.ts Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360) 2023-11-27 16:08:20 -08:00
shard.spec.ts Fix various typos (Fixes #27396) (#27391) 2023-10-04 19:56:42 -07:00
snapshot-path-template.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
stdio.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
store.spec.ts chore: hide store from public (#21763) 2023-03-17 11:50:44 -07:00
test-extend.spec.ts chore: composed->merge (#27555) 2023-10-11 13:56:27 -07:00
test-grep.spec.ts Fix various typos (Fixes #27396) (#27391) 2023-10-04 19:56:42 -07:00
test-ignore.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-info.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-modifiers.spec.ts fix: test.fail wrapper method (#29112) 2024-01-22 19:47:27 -08:00
test-output-dir.spec.ts chore: do not lose error name for js errors (#28177) 2023-11-15 18:27:32 -08:00
test-parallel.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-serial.spec.ts Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360) 2023-11-27 16:08:20 -08:00
test-step.spec.ts chore: box step w/o modifying runtime errors (#28762) 2023-12-22 12:00:17 -08:00
test-use.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
timeout.spec.ts chrome: improve error messages on vscode side (#27521) 2023-10-09 19:55:24 -07:00
to-have-screenshot.spec.ts fix: do not retry missing snapshot errors (#29272) 2024-01-31 15:33:38 -08:00
types-2.spec.ts fix: test.fail wrapper method (#29112) 2024-01-22 19:47:27 -08:00
types.spec.ts fix(components): make sure defineConfig(c1, c2) works (#28608) 2023-12-12 14:01:01 -08:00
ui-mode-fixtures.ts chore: get rid of rimraf package (#27790) 2023-10-26 19:41:00 +02:00
ui-mode-test-attachments.spec.ts chore: fix ui mode to show screenshots (#26563) 2023-08-20 14:47:18 -07:00
ui-mode-test-ct.spec.ts chore: automatically detect the dev server (#29176) 2024-01-25 11:46:47 -08:00
ui-mode-test-filters.spec.ts test(ui-mode): make retries (#23136) 2023-05-18 11:28:28 -07:00
ui-mode-test-output.spec.ts chore: implement faster ansi2html format for console (#26826) 2023-09-01 09:09:47 -07:00
ui-mode-test-progress.spec.ts fix(test runner): make TestTracing responsible for trace management (#29181) 2024-01-26 15:52:25 -08:00
ui-mode-test-run.spec.ts chore: fix total progress reporting w/ deps (#27716) 2023-10-19 20:07:47 -07:00
ui-mode-test-screencast.spec.ts chore: do not select after hooks automatically (#27805) 2023-10-25 17:05:06 -07:00
ui-mode-test-setup.spec.ts fix(ui-mode): run teardown handlers with Command + C (#24267) 2023-07-19 17:50:25 +02:00
ui-mode-test-source.spec.ts chore: do not lose error name for js errors (#28177) 2023-11-15 18:27:32 -08:00
ui-mode-test-tree.spec.ts fix(ui): do not fail on clashing groups (#27943) 2023-11-02 20:50:08 -07:00
ui-mode-test-update.spec.ts test(ui-mode): make retries (#23136) 2023-05-18 11:28:28 -07:00
ui-mode-test-watch.spec.ts chore(ui): do not watch output folders (#27694) 2023-10-19 15:53:57 -07:00
ui-mode-trace.spec.ts chore: only highlight uncaught errors in source (#28772) 2023-12-22 14:19:53 -08:00
watch.spec.ts chore: populate matcherResult in web assertions (#27133) 2023-09-16 14:24:10 -07:00
web-server.spec.ts chore: automatically detect the dev server (#29176) 2024-01-25 11:46:47 -08:00
worker-index.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00