Shriphad Rao
82804cce64
fix: time in ms for skip test ( #30078 )
...
Fixes https://github.com/microsoft/playwright/issues/29861
2024-03-25 08:51:09 -07:00
Pavel Feldman
ef924c14e7
chore: do not use project id in telereporter ( #29776 )
2024-03-01 21:44:08 -08:00
Dmitry Gozman
bd5403dcad
chore: remove --tag and tagFilter ( #29468 )
...
This makes new tags filtered by the `grep`. New `TestCase.tags` API now
includes both old and new tags.
2024-02-15 11:37:16 -08:00
Dmitry Gozman
3331a40647
feat(test runner): tags/annotations ( #29248 )
...
API changes:
- `test(title, details, body)` where details contain `tag` and
`annotation`.
- similar `details` property added to `test.skip`, `test.fail`,
`test.fixme`, `test.only`, `test.describe` and other `test.describe.*`
variations.
- `TestProject.tagFilter`/`TestConfig.tagFilter` that supports logical
tag expressions with `(`, `)`, `and`, `or` and `not`.
- `--tag` CLI option to filter by tags.
- New annotations are available in `TestInfo.annotations` and
`TestCase.annotations`.
- New tags are available in `TestCase.tags`.
Reporter changes:
- `json` reporter includes new tags in addition to old `@smoke`-style
tags. **Breaking**: tags are now listed with the leading `@` symbol.
- `html` reporter filters by old and new tags with the same `@smoke`
token.
Fixes #29229 , fixes #23180 .
2024-02-07 16:31:25 -08:00
Pavel Feldman
b5e175e6e2
fix: tolerate wrongly-typed annotations ( #29162 )
...
Fixes https://github.com/microsoft/playwright/issues/29149
2024-01-25 11:35:17 -08:00
Pavel Feldman
41c15cb176
chore: move vite root dir into template folder ( #29081 )
2024-01-23 09:40:05 -08:00
Pavel Feldman
f5c57d0e98
chore: reuse image diff component in trace/html ( #28727 )
...
Fixes https://github.com/microsoft/playwright/issues/28685
2023-12-22 10:17:35 -08:00
Yury Semikhatsky
f88288d71d
feat: config.botName for describing environment in the reports ( #28507 )
...
Reference https://github.com/microsoft/playwright/issues/27284
2023-12-06 13:34:16 -08:00
Yury Semikhatsky
86c78c1e0f
fix(html): do not update total time when filtering tests ( #27808 )
...
Fixes #27758
2023-10-26 08:20:14 -07:00
Dmitry Gozman
c8134bca5d
feat(html): show top-level errors ( #27763 )
...
Drive-by:
- extract `TestErrorView`;
- replace `data-test-id` with `data-testid` and `getByTestId()`.
---
<img width="1001" alt="top-level errors in html report"
src="https://github.com/microsoft/playwright/assets/9881434/2d6c0c52-8df1-46a9-b3fd-06ddc6f16796 ">
2023-10-24 09:35:07 -07:00
Dmitry Gozman
823b104a9e
feat(html): "copy to clipboard" for text attachments ( #27556 )
...
Mostly copied from trace viewer. Not reused due to different
colors/icons.
Screenshot:
<img width="999" alt="copy-to-clipboard"
src="https://github.com/microsoft/playwright/assets/9881434/2bb38442-3b8d-42ba-a3ed-4b9052b22854 ">
2023-10-11 17:56:05 -07:00
Max Schmitt
ce43ea7d99
chore: roll @zip.js/zip.js to 2.7.29 ( #27047 )
2023-09-13 18:39:10 +02:00
Max Schmitt
d0945192a4
feat: make it possible to filter by column in HTML report ( #27020 )
2023-09-12 22:13:15 +02:00
Max Schmitt
54f36bee93
chore: make html report image attachment clickable ( #26978 )
2023-09-11 08:44:00 +02:00
Dmitry Gozman
186f86905c
chore: make @playwright/test depend on playwright ( #26946 )
2023-09-08 14:23:35 -07:00
Max Schmitt
cb67427d56
chore: fix html-reporter/trace-viewer TSC errors ( #26813 )
2023-08-31 18:08:38 +02:00
Pavel Feldman
34c6197f9e
chore: include start/endTime and duration in onEnd report callback ( #26760 )
...
Fixes https://github.com/microsoft/playwright/issues/23637
2023-08-29 10:56:21 -07:00
Yury Semikhatsky
39a6b23309
devops: create blob reports for all "tests 1" ( #26694 )
2023-08-24 16:06:41 -07:00
Marcin Strzyz
192b697488
chore: remove old webpack folder structure ( #26560 )
2023-08-19 16:16:44 -07:00
Max Schmitt
4c4525c9e0
chore: make html report produce named attachments ( #26421 )
...
https://github.com/microsoft/playwright/issues/26326
2023-08-16 18:06:04 +02:00
Dmitry Gozman
27c15b705d
fix(blob): replace projectSuffix with reportName ( #25017 )
...
Always ensure unique project/test ids across blobs.
Show `reportName` as a label in the html report.
References #24451 .
2023-08-07 13:38:09 -07:00
Pavel Feldman
009f9994df
fix(html): mobile layout for filters ( #24506 )
2023-07-31 16:54:07 -07:00
Pavel Feldman
0409bfca56
chore: ensure module deps in ct-core ( #24056 )
...
Fixes https://github.com/microsoft/playwright/issues/23823
2023-07-06 12:01:45 -07:00
Yury Semikhatsky
11770156eb
feat(html): show number of filtered tests, update total time ( #23743 )
2023-06-16 09:22:57 -07:00
Pavel Feldman
b9e7a91368
fix(html): fix the filter to respect status ( #23208 )
2023-05-22 15:35:19 -07:00
Pavel Feldman
631edc9744
chore(internal): generate code in jsonl ( #23124 )
2023-05-20 10:15:33 -07:00
Pavel Feldman
49370cb6fd
chore: fix file view padding ( #23166 )
2023-05-19 11:07:49 -07:00
Pavel Feldman
37b2853b7b
chore: fix the test view mobile layout ( #23061 )
...
Fixes https://github.com/microsoft/playwright/issues/23036
2023-05-16 12:47:37 -07:00
Alex Neo
5bd5cea705
feat(html): describe labels ( #22870 )
2023-05-08 18:59:01 -07:00
Alex Neo
26cad0b31f
feat(html): matching labels with dash&spec symbol ( #22709 )
...
Fixes #22700
2023-05-01 09:13:30 -07:00
Alex Neo
7937699b28
fix(html): label not matched if first with describe ( #22680 )
2023-04-27 20:04:54 -07:00
Pavel Feldman
78acb5ef58
chore: do not layer box shadows on top of one another in image diff ( #22604 )
2023-04-24 15:23:01 -07:00
Max Schmitt
49c9284bc7
Revert "feat(html reporter): render multiple annotations of the same type together ( #21580 )" ( #22466 )
...
Fixes https://github.com/microsoft/playwright/issues/22323
2023-04-18 20:43:07 +02:00
Alex Neo
6947f47f05
feat(html): added labels to test cases and test files ( #21468 )
2023-03-22 14:35:58 -07:00
Alex Neo
9c8d0822d6
fix(html-reporter): annotations.size rendered 0 on UI ( #21635 )
...
Co-authored-by: Max Schmitt <max@schmitt.mx>
2023-03-13 21:23:17 +01:00
Dmitry Gozman
21950bc8ce
feat(html reporter): render multiple annotations of the same type together ( #21580 )
...
Multiple annotations are rendered as comma-separated lists. Fixes
#21253 .
2023-03-10 15:26:02 -08:00
Pavel Feldman
e737ff83b4
chore: migrate to useRef take 2 ( #21552 )
2023-03-09 19:34:05 -08:00
Dmitry Gozman
d904a6129f
chore: run check-deps for all packages ( #21395 )
2023-03-03 14:50:43 -08:00
Sebastian Silbermann
fbaf56a13f
feat(ct-react): Support React 18 only ( #19814 )
...
BREAKING CHANGE: Drop support for React 17 and earlier
Support for React 17 an earlier is provided by
`@playwright/experimental-ct-react-17`
Closes #19923
2023-03-03 14:28:33 -08:00
Pavel Feldman
de3a5e2a91
chore(trace): include expect steps in a trace ( #21199 )
2023-02-28 13:26:23 -08:00
Max Schmitt
f3a46f7405
feat(html): render annotations as links if needed ( #21165 )
...
Fixes https://github.com/microsoft/playwright/issues/20584
2023-02-23 21:57:02 +01:00
Yury Semikhatsky
90c4e6f9b2
chore: revert sharded html report ( #20923 )
...
We've decided not to ship it in the current form.
#10437
2023-02-15 12:38:03 -08:00
Max Schmitt
161f3f144a
fix(html-reporter): do not show empty project name ( #20735 )
2023-02-08 01:07:25 +01:00
Yury Semikhatsky
f10b29fd5e
feat: show warning when some report shards are missing ( #20731 )
...
When some of the report shards are missing still show the report but
display an error in the status line:
#10437
2023-02-07 14:22:10 -08:00
Yury Semikhatsky
8f53bf7b41
feat: sharded html report ( #20700 )
...
This implementation is based on the [original
PR](https://github.com/microsoft/playwright/pull/19691 ) by @kevin940726.
It makes the reporter produce single file when there is no sharding and
multiple out-of-line report-x-of-y.zip reports which are automatically
merged together when put in one folder.
References https://github.com/microsoft/playwright/issues/10437
Co-authored-by: Kai Hao <kevin830726@gmail.com>
2023-02-07 10:21:26 -08:00
Sam Chen
340cacf4fd
feat: show diff tab by default ( #19820 )
...
Close https://github.com/microsoft/playwright/issues/19803
I had to manually inject `window.playwrightReportBase64` data into
`playwright/packages/html-reporter/index.html` when developing,
wondering if there's any method I don't know.
2023-02-03 10:32:23 -08:00
Dmitry Gozman
1196b4f0f5
chore: do not use docker for "Web Components" tests ( #20339 )
2023-01-24 14:00:10 -08:00
Dmitry Gozman
b700c08dc5
feat(screenshots): when actual and expected have different sizes, pad and produce the diff image ( #20208 )
...
Also show sizes in the html report to easier spot the size mismatch
issue.
<img width="1030" alt="diff"
src="https://user-images.githubusercontent.com/9881434/213327632-b8fcd69c-8d08-460c-9de1-b5f4f8c56359.png ">
Fixes #15802 .
2023-01-20 19:41:43 -08:00
Pavel Feldman
e065d608b6
chore: introduce defineConfig for easier JS typing ( #20061 )
...
Fixes https://github.com/microsoft/playwright/issues/19694
2023-01-12 13:12:02 -08:00
Dmitry Gozman
9a5df720ff
chore: fix build/watch script for bundles and vite-powered packages ( #20055 )
2023-01-11 18:36:04 -08:00
Max Schmitt
e2a2196e6a
chore(html-reporter): show project name always for the test file ( #19905 )
...
Fixes https://github.com/microsoft/playwright/issues/19874
2023-01-10 17:11:38 +01:00
Ross Wollman
0844394270
feat(html): display overall duration ( #19576 )
...
<img width="1390" alt="Screenshot 2022-12-19 at 4 15 33 PM"
src="https://user-images.githubusercontent.com/11915034/208552484-c0127615-d2c6-414f-ae3b-e7836553d890.png ">
* Adds duration (time ellapsed from `onBegin` to `onEnd`); roughly
equivalent to `time npx playwright test …`.
* Removes cumulative per-file time
Resolves #19566 .
2022-12-20 14:13:10 -08:00
Andrey Lushnikov
db826c9c8c
chore: drive-by fixes for the snapshotPathTemplate ( #18715 )
...
- Use `snapshotPathTemplate` for docker screenshots in html-reporter
- Mark the snapshot path template test as slow since it re-spawns
worker for each project.
- Fix docker smoke tests
2022-11-10 15:50:13 -08:00
Pavel Feldman
c07f06aa3f
chore: support dark theme in recorder & tv ( #18389 )
2022-10-27 16:50:41 -07:00
Pavel Feldman
6e839ff404
fix(test): remove component.get usages ( #17723 )
2022-09-29 20:18:26 -07:00
Pavel Feldman
d9a28bd244
feat(api): introduce get/getByText/getByRole ( #17577 )
2022-09-27 16:13:56 -07:00
Pavel Feldman
df143031e7
chore: move protocol and trace types into the top-level packages ( #17486 )
2022-09-20 18:41:51 -07:00
Andrey Lushnikov
58873908ba
devops: add docker screenshot expectations for html-reporter tests ( #17341 )
2022-09-14 15:44:13 -07:00
Max Schmitt
7e2aec7454
chore: align more ESLint rules with VSCode formatting ( #16647 )
2022-08-18 20:12:33 +02:00
Dmitry Gozman
445fe032f5
feat(test runner): separate interrupted status from skipped ( #16124 )
2022-08-02 12:55:43 -07:00
Dmitry Gozman
44e214a972
chore(html report): title row UI fixes ( #15632 )
2022-07-13 15:12:15 -07:00
Pavel Feldman
0e7d6661d7
chore(html-report): follow up ui fixes ( #15599 )
2022-07-13 12:49:11 -07:00
Dmitry Gozman
7727ebe758
feat(html report): improve test list view ( #15543 )
...
- Two lines per test: title and location.
- Align project labels.
- Add trace badge that opens trace viewer.
- Add video and image diff badges that show scrolled test result view.
2022-07-11 19:47:15 -07:00
Pavel Feldman
765ac5f0a7
chore: do not embed copyright in redistributable assets ( #14928 )
2022-06-16 16:18:25 -07:00
Pavel Feldman
4cc25725f9
fix(types): follow up to react 18 changes ( #14671 )
2022-06-06 21:05:47 -07:00
Pavel Feldman
39489931d1
chore: add more ct options to allow redirecting templates/cache ( #14077 )
2022-05-10 12:21:29 -07:00
Pavel Feldman
1bbefce9af
Revert "chore: use plugins for component testing again ( #13977 )" ( #13998 )
...
This reverts commit a2f9f15e3e
2022-05-06 12:02:07 -07:00
Pavel Feldman
a2f9f15e3e
chore: use plugins for component testing again ( #13977 )
2022-05-05 14:26:56 -07:00
Pavel Feldman
214117c9c5
clean: speed up ct ( #13915 )
2022-05-03 21:25:50 -07:00
Pavel Feldman
13224d1c9f
chore: restore component testing options ( #13910 )
2022-05-03 15:48:46 -07:00
Pavel Feldman
29fd1d86df
chore: hide plugins for now ( #13908 )
2022-05-03 14:25:56 -07:00
Ross Wollman
3b3cad7d69
feat: rewrite gitCommitInfo plugin, drop GlobalInfo & attachments ( #13837 )
2022-05-02 16:28:14 -07:00
Pavel Feldman
2bc36794d1
chore: vite all frameworks ( #13780 )
2022-04-26 16:15:08 -07:00
Pavel Feldman
5e51c17d41
chore: use plugin story for components ( #13717 )
2022-04-25 10:40:58 -07:00
Pavel Feldman
3d4caab153
chore: move playwright gallery into a subfolder ( #13695 )
2022-04-21 21:07:43 -07:00
Pavel Feldman
5990eb6074
chore: use vite plugin for registry ( #13658 )
2022-04-21 17:30:17 -07:00
Max Schmitt
7151284147
chore(html-reporter): missing space between git date and time ( #13656 )
2022-04-20 18:10:55 +02:00
Andrey Lushnikov
8a24c95e08
chore: introduce experimental VRT rebaseline workflow ( #13560 )
2022-04-19 07:05:43 -07:00
Pavel Feldman
5ae2017a5b
chore: always import type ( #13365 )
2022-04-06 14:57:14 -07:00
Pavel Feldman
66cf82766e
test(html-reporter): add image diff tests ( #13262 )
2022-04-01 18:11:15 -07:00
Pavel Feldman
55ee41c848
feat(html): render image diff slider ( #13257 )
2022-04-01 15:27:51 -07:00
Pavel Feldman
c262a80762
chore: extract image diff component ( #13221 )
2022-04-01 12:53:56 -07:00
Pavel Feldman
6a463195c4
chore: allow multiple image diffs ( #13202 )
2022-03-31 14:11:34 -07:00
Pavel Feldman
42f260c688
chore: prepare image diff for refactornig ( #13197 )
2022-03-30 17:42:08 -07:00
Ross Wollman
2932da33f2
chore(html-reporter): remove no-longer-needed code ( #13167 )
2022-03-29 21:08:10 -07:00
Pavel Feldman
81e7c0a77c
chore(html-report): render metainfo as a chip ( #13166 )
2022-03-29 18:13:08 -07:00
Pavel Feldman
5e17ed137b
fix(html-report): only invoke git once ( #13165 )
2022-03-29 15:49:58 -07:00
Pavel Feldman
8758cf8cbf
chore: migrate html reporter to vite ( #13116 )
2022-03-28 18:21:19 -07:00
Ross Wollman
541fb39a51
feat(html-reporter): add report context header ( #12734 )
...
Resolves #11318 .
* Adds `TestConfig.attachments` public API. (We opted to not implement an analog to the async `TestInfo.attach(…)` API.)
* Adds `TestConfig.attachments` to common reporters.
* Dogfoods some git and CI-info inference to generate useful atttachments
* Updates HTML Reporter to include a side bar to present a pre-defined set of attachments (a.k.a git/commit context sidebar)
Here's what it looks like:
<img width="1738" alt="Screen Shot 2022-03-21 at 3 23 28 PM" src="https://user-images.githubusercontent.com/11915034/159373291-8b937d30-fba3-472a-853a-766018f6b3e2.png ">
See `tests/playwright-test/reporter-html.spec.ts` for an example of usage (for dogfood-ing only). In the future, if this becomes user-facing, there the Global Setup bit would likely become unnecessary (as would interaction with attachments array); there would likely just be a nice top-level config and/or CLI flag to enable collecting of info.
2022-03-22 16:28:04 -07:00
Pavel Feldman
25c0369eaf
chore: prepare to publish component packages ( #12697 )
2022-03-12 13:51:27 -08:00
Pavel Feldman
e9fa098bf3
chore: add ct examples ( #12693 )
2022-03-11 15:46:11 -08:00
Andrey Lushnikov
95c774cf84
feat: support multiple screenshots in HTML report ( #12577 )
...
This patch adds support to multiple diffs. These are possible
due to soft assertions.
Drive-by: rename second screenshot in `toHaveScreenshot` failure when
re-generating expectations from "expected" to "previous".
2022-03-11 08:46:13 -08:00
Pavel Feldman
af55f48754
chore: add experimental mount ( #12657 )
2022-03-11 08:00:46 -08:00
Dmitry Gozman
4a768294b4
chore: cleanup hooks notion from raw/html reporters ( #12610 )
2022-03-08 19:08:31 -08:00
Ben Lu
f933f65d03
feat(html): put diff first in image comparison ( #12254 )
2022-02-22 11:29:58 -08:00
Pavel Feldman
51344c6924
chore: parse-skip .tsx ( #12143 )
2022-02-16 15:45:35 -08:00
Yury Semikhatsky
7ee35ae30d
fix(html-report): open all test traces in one viewer ( #12142 )
2022-02-16 09:09:42 -08:00
Andrey Lushnikov
ba0c7e679b
feat(test-runner): support expect.soft ( #11800 )
...
Soft expects will still fail the test, but will not abort it's execution. As a consequence of this:
- `TestResult` now might have multiple errors, which is reflected with a new `testResult.erros: TestError[]` field.
- `TestInfo` now might have multiple errors as well, which is reflected with a new `testInfo.errors: TestError[]` field.
Fixes #7819
2022-02-02 18:33:51 -08:00
Max Schmitt
3fb3ba7b96
chore: fix html report bottom padding ( #11541 )
2022-01-21 13:58:55 +01:00
Pavel Feldman
5751a1255b
fix(html): set default link color for safari ( #11353 )
2022-01-12 09:05:45 -08:00
