playwright/tests/playwright-test
Dmitry Gozman 10ce7af411
fix(steps): step should not get an unrelated error (#22773)
Previously, we would use any error that was added during the step
execution as an error for this particular step.

This produces false positives, for example failing `page.click` call
that happened during `context` teardown was producing an error and
marking teardown is failed. However, in reality, the test itself has
failed, while teardown has not.

New approach uses test step hierarchy to inherit errors from child steps
to the parent step. This does not regress the original fix where
`expect.soft` errors are surfaced in the parent step.

See also #19973 that introduced the original logic.
2023-05-02 18:50:00 -07:00
..
__screenshots__/playwright.artifacts.spec.ts feat: allow options in automatic screenshots (#19143) 2022-12-07 08:45:33 -08:00
assets Revert "feat: send SIGTERM to webserver before SIGKILL'ing it. (#18220)" (#18661) 2022-11-09 09:18:33 -08:00
stable-test-runner chore: roll the stable test runner (#22701) 2023-04-28 08:57:19 -07:00
access-data.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
babel.spec.ts chore: support TypeScript 5 in TS transformer (#21925) 2023-03-23 18:07:02 +01:00
basic.spec.ts test: unflake basic timeout test (#22745) 2023-05-02 09:14:57 -07:00
command-line-filter.spec.ts chore: remove unnecessary args in ttest (#21012) 2023-02-18 13:08:17 -08:00
config.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
decorators.spec.ts chore: allow ts decorators (#22080) 2023-03-29 20:43:08 -07:00
deps.spec.ts feat: project.teardown that runs after all dependents have finished (#22696) 2023-04-28 14:27:08 -07:00
esm.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
exit-code.spec.ts chore(ui): do not print global setup epilogue (#21976) 2023-03-24 20:56:45 -07:00
expect-configure.spec.ts chore: fix soft after poll (#22642) 2023-04-26 08:50:10 -07:00
expect-poll.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
expect-soft.spec.ts chore: introduce expect.configure (#22533) 2023-04-25 10:29:56 -07:00
expect-to-pass.spec.ts chore: should not spill toPass between tests (#22473) 2023-04-19 14:45:58 -07:00
expect.spec.ts fix(expect): report expect "Timed out" when it actually does (#22174) 2023-04-03 15:06:13 -07:00
fixture-errors.spec.ts test: unflake "should give enough time for fixture teardown" (#22763) 2023-05-02 17:40:10 -07:00
fixtures.spec.ts fix(test runner): separate test fixture scope for beforeAll/afterAll hooks (#22746) 2023-05-02 11:04:51 -07:00
gitignore.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
global-setup.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
golden.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
hooks.spec.ts fix(test runner): separate test fixture scope for beforeAll/afterAll hooks (#22746) 2023-05-02 11:04:51 -07:00
list-mode.spec.ts chore: remove usesCustomOutputDir from tests (#21011) 2023-02-18 11:41:41 -08:00
loader.spec.ts fix(testMatch): do not count test.ts and spec.ts as test files by default (#22440) 2023-04-17 12:57:33 -07:00
match-grep.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
max-failures.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
override-timeout.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
playwright-test-fixtures.ts chore: remove cli from playwright-core (#22612) 2023-04-25 11:19:37 -07:00
playwright.artifacts.spec.ts feat: Adding trace option 'on-all-retries' (#21985) 2023-03-31 13:04:24 -07:00
playwright.config.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
playwright.config.ts chore: bump vite to 4.3.3 (#22711) 2023-05-01 15:19:49 -07:00
playwright.connect.spec.ts feat(connect): support special headers for debug/attachments (#22106) 2023-03-31 08:57:07 -07:00
playwright.ct-build.spec.ts chore: bump vite to 4.3.3 (#22711) 2023-05-01 15:19:49 -07:00
playwright.ct-react.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
playwright.fetch.spec.ts chore: increase timeout for flaky "should stop tracing on requestContext.dispose()" (#21767) 2023-03-17 13:33:44 -07:00
playwright.reuse.browser.spec.ts chore: allow reusing browser between the tests (#22191) 2023-04-04 12:31:42 -07:00
playwright.reuse.spec.ts fix(reuse): serial mode with tracing should not throw (#21726) 2023-03-16 14:32:12 -07:00
playwright.spec.ts chore: hide store from public (#21763) 2023-03-17 11:50:44 -07:00
playwright.trace.spec.ts fix: preserve trace if context if closed manually during test run (#22442) 2023-04-18 09:02:33 -07:00
playwright.unhandled.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
repeat-each.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
reporter-attachment.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
reporter-base.spec.ts revert(#12706): also fix related bugs it introduced (#21070) 2023-02-21 14:15:11 -08:00
reporter-blob.spec.ts fix: call onExit when merging reports (#22718) 2023-05-01 12:58:40 -07:00
reporter-dot.spec.ts chore: remove unnecessary args in ttest (#21012) 2023-02-18 13:08:17 -08:00
reporter-github.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
reporter-html.spec.ts feat(html): matching labels with dash&spec symbol (#22709) 2023-05-01 09:13:30 -07:00
reporter-json.spec.ts chore: remove usesCustomOutputDir from tests (#21011) 2023-02-18 11:41:41 -08:00
reporter-junit.spec.ts chore: purify the junit reporter (#22624) 2023-05-01 09:15:08 -07:00
reporter-line.spec.ts chore: render failed steps in the basic reporters (#22200) 2023-04-05 13:03:42 -07:00
reporter-list.spec.ts test: make page-leaks tests pass in electron (#22277) 2023-04-07 17:20:49 -07:00
reporter-raw.spec.ts chore: remove usesCustomOutputDir from tests (#21011) 2023-02-18 11:41:41 -08:00
reporter.spec.ts chore: make _setupArtifacts a worker-scoped fixture (#22739) 2023-05-01 13:53:15 -07:00
resolver.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
retry.spec.ts chore: remove unnecessary args in ttest (#21012) 2023-02-18 13:08:17 -08:00
runner.spec.ts fix(runner): do not hang on worker exit before tests (#22742) 2023-05-01 14:54:48 -07:00
shard.spec.ts fix(shards): shard test groups instead of files (#21638) 2023-03-14 10:41:37 -07:00
snapshot-path-template.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
stdio.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
store.spec.ts chore: hide store from public (#21763) 2023-03-17 11:50:44 -07:00
test-extend.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-grep.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-ignore.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-info.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-modifiers.spec.ts chore: nest test steps based on zones (#22108) 2023-03-30 21:05:07 -07:00
test-output-dir.spec.ts chore: remove unnecessary args in ttest (#21012) 2023-02-18 13:08:17 -08:00
test-parallel.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-serial.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
test-step.spec.ts fix(steps): step should not get an unrelated error (#22773) 2023-05-02 18:50:00 -07:00
test-use.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00
timeout.spec.ts fix(test runner): separate test fixture scope for beforeAll/afterAll hooks (#22746) 2023-05-02 11:04:51 -07:00
to-have-screenshot.spec.ts chore: make client-side instrumentation non-nullable (#22694) 2023-04-28 08:57:43 -07:00
types-2.spec.ts test: add a ui teardown test (#22010) 2023-03-29 13:57:19 -07:00
types.spec.ts chore: update typescript to 5.0.2 (#22079) 2023-03-29 17:13:09 -07:00
ui-mode-fixtures.ts chore: unflake ui tests (3) (#22741) 2023-05-01 15:18:34 -07:00
ui-mode-test-filters.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-output.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-progress.spec.ts chore: render live trace for the serial mode (#22715) 2023-04-28 17:47:57 -07:00
ui-mode-test-run.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-setup.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-source.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-tree.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-update.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-test-watch.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
ui-mode-trace.spec.ts chore: add image diff test to ui mode (#22637) 2023-04-28 14:18:46 -07:00
watch.spec.ts fix(expect): report expect "Timed out" when it actually does (#22174) 2023-04-03 15:06:13 -07:00
web-server.spec.ts feat(web-server): add stdout: "pipe"|"ignore" option (#22564) 2023-04-26 23:39:42 +02:00
worker-index.spec.ts test: remove magic headers in ttest (#20867) 2023-02-14 19:20:56 -08:00