Commit Graph

16 Commits

Author SHA1 Message Date
Will Chen
47992f48dd Leave GitHub comment with playwright results (#1965)
<!-- CURSOR_SUMMARY -->
> [!NOTE]
> Posts a per-OS Playwright test summary as a PR comment by adding a
JSON reporter and a CI step to generate and publish the results.
> 
> - **CI / Reporting**
> - Add permissions and a GitHub Script step in
`.github/workflows/ci.yml` to generate and post/update a Playwright test
summary comment after merging shard reports.
>   - Upload merged HTML report artifact and link to full run.
> - **Playwright config**
> - Update `merge.config.ts` to add JSON reporter output to
`playwright-report/results.json` alongside HTML.
> - **New Script**
> - Add `scripts/generate-playwright-summary.js` to parse Playwright
JSON, compute per-OS (macOS/Windows) pass/fail/flaky/skipped counts,
list top failures/flaky tests, and write both PR comment and job
summary.
> 
> <sup>Written by [Cursor
Bugbot](https://cursor.com/dashboard?tab=bugbot) for commit
d5ca6987f65e9a7063533960382516af89e67391. This will update automatically
on new commits. Configure
[here](https://cursor.com/dashboard?tab=bugbot).</sup>
<!-- /CURSOR_SUMMARY -->





<!-- This is an auto-generated description by cubic. -->
---
## Summary by cubic
Posts Playwright test results as a PR comment with a per-OS summary,
flaky test counts, and top failures, improving CI visibility across
macOS and Windows. Adds a JSON reporter and a GitHub Script step that
links to the full report.

- **New Features**
  - Adds JSON reporter output to playwright-report/results.json.
- Adds a script to parse results, include flaky tests, post/update the
PR comment, and write the job summary.
- Updates CI workflow permissions and runs the summary script after
report merge.

<sup>Written for commit d5ca6987f65e9a7063533960382516af89e67391.
Summary will update automatically on new commits.</sup>

<!-- End of auto-generated description by cubic. -->
2025-12-15 23:24:08 -08:00
Will Chen
60b1f509e6 increase mem size to avoid OOM (#942) 2025-08-14 14:21:28 -07:00
Will Chen
8ef84285fc Shard E2E tests (#941) 2025-08-14 13:48:27 -07:00
Will Chen
9694e4a2e8 Add Windows ARM to CI (#430) 2025-06-17 16:37:17 -07:00
Will Chen
d7f7f15afd use npm ci (#383) 2025-06-10 14:59:36 -07:00
Will Chen
e7941bc6f7 cache nextjs template (#381) 2025-06-10 12:46:13 -07:00
Will Chen
89f509fcfa Cache pnpm scaffold deps and postfix playwright artifacts (#380) 2025-06-10 11:53:20 -07:00
Will Chen
ac98a52ab1 Fix unit test & run in CI (#372) 2025-06-09 15:23:10 -07:00
Will Chen
b8f7490288 Stabilize E2E test by alphabetically sorting files for context (#321) 2025-06-03 17:58:59 -07:00
Will Chen
7235eab227 Make CI run cross-platform (#295) 2025-06-03 13:04:16 -07:00
Will Chen
8a743ca4f5 LM studio e2e test (#297) 2025-05-31 23:04:28 -07:00
Will Chen
509e044137 Boilerplate free tests (#277) 2025-05-28 22:55:54 -07:00
Will Chen
644012c9a5 Simple playwright e2e test (#234) 2025-05-23 10:44:52 -07:00
Will Chen
cb9ffcc550 Add presubmit checks to CI (#113) 2025-05-08 17:28:48 -07:00
Will Chen
086adc9955 infra(gha): fix ci workflow 2025-04-14 23:22:23 -07:00
Will Chen
d527bb0095 Add minimal CI GitHub action 2025-04-14 23:18:11 -07:00