Challenge
Manual regression for a Web3 experience was slow and hard to audit, especially with crypto wallet flows and transaction-driven state changes.
Approach
- Built a Playwright framework with multi-environment targeting and browser projects.
- Implemented cookie-based auth to bypass flaky OAuth flows.
- Integrated Xray to generate BDD-style tests and upload results.
- Added evidence capture: logs, traces, screenshots, and videos on failure.
- Enabled CI parameterization for browser, env, and test scope selection.
Results
- Deterministic automation made releases faster and more predictable.
- Evidence-first debugging reduced triage time and context switching.
- Jira/Xray traceability improved cross-team confidence.
Key metrics
| Metric | Before | After |
|---|---|---|
| Regression coverage | Manual runs | Deterministic Playwright runs |
| Traceability | Disconnected reports | Jira/Xray-linked results |
| Triage effort | Manual log collection | Auto evidence capture |
- Cookie-based auth kept tests stable across environments.
- Evidence-first debugging cut triage time dramatically.
- Traceable automation built confidence outside engineering.