Skip to content

test: Fix flaky errorsInSession replay test #7309

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 1, 2023

Conversation

mydea
Copy link
Member

@mydea mydea commented Mar 1, 2023

Hopefully fix #7269

@mydea mydea added Type: Tests Package: replay Issues related to the Sentry Replay SDK labels Mar 1, 2023
@mydea mydea requested a review from Lms24 March 1, 2023 11:44
@mydea mydea self-assigned this Mar 1, 2023
@mydea mydea force-pushed the fn/fix-flaky-error-session-test branch from 5168f1a to 8b122b7 Compare March 1, 2023 12:00
@github-actions
Copy link
Contributor

github-actions bot commented Mar 1, 2023

Replay SDK metrics 🚀

    Plain +Sentry +Replay
Revision Value Value Diff Ratio Value Diff Ratio
LCP This PR 73a1bbb 71.93 ms 61.93 ms -10.00 ms -13.90 % 62.05 ms -9.88 ms -13.74 %
Previous 3ba8e0b 61.25 ms 73.45 ms +12.20 ms +19.92 % 72.64 ms +11.39 ms +18.60 %
CLS This PR 73a1bbb 0.00 ms 0.00 ms 0.00 ms 0.00 % 0.24 ms +0.23 ms +5061.68 %
Previous 3ba8e0b 0.00 ms 0.00 ms 0.00 ms 0.00 % 0.26 ms +0.26 ms +5553.44 %
CPU This PR 73a1bbb 18.62 % 21.13 % +2.51 pp +13.49 % 37.63 % +19.01 pp +102.14 %
Previous 3ba8e0b 17.48 % 19.51 % +2.03 pp +11.61 % 36.08 % +18.59 pp +106.36 %
JS heap avg This PR 73a1bbb 3.52 MB 6.81 MB +3.28 MB +93.15 % 11.05 MB +7.53 MB +213.52 %
Previous 3ba8e0b 3.54 MB 6.91 MB +3.37 MB +95.28 % 11.18 MB +7.64 MB +216.09 %
JS heap max This PR 73a1bbb 3.88 MB 8.3 MB +4.42 MB +114.08 % 14 MB +10.12 MB +261.11 %
Previous 3ba8e0b 3.89 MB 8.29 MB +4.4 MB +113.13 % 14.31 MB +10.42 MB +267.77 %
netTx This PR 73a1bbb 0 B 348.76 kB +348.76 kB n/a 106.05 kB +106.05 kB n/a
Previous 3ba8e0b 0 B 360.35 kB +360.35 kB n/a 105.73 kB +105.73 kB n/a
netRx This PR 73a1bbb 17.62 kB 19.04 kB +1.41 kB +8.02 % 17.26 kB -365 B -2.07 %
Previous 3ba8e0b 18.13 kB 18.35 kB +222 B +1.22 % 18.46 kB +332 B +1.83 %
netCount This PR 73a1bbb 1 2 +1 +100.00 % 4.6 +3.5999999999999996 +360.00 %
Previous 3ba8e0b 1 2 +1 +100.00 % 4 +3 +300.00 %
netTime This PR 73a1bbb 420.73 ms 450.51 ms +29.78 ms +7.08 % 628.26 ms +207.54 ms +49.33 %
Previous 3ba8e0b 601.86 ms 692.68 ms +90.82 ms +15.09 % 669.72 ms +67.85 ms +11.27 %

Previous results on branch: develop

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms
c46c56c+65.45 ms-0.00 ms+5.38 pp+930.26 kB+1.07 MB+2.21 kB+41 B+1+91.29 ms

*) pp - percentage points - an absolute difference between two percentages.
Last updated: Wed, 01 Mar 2023 12:04:13 GMT

@mydea mydea force-pushed the fn/fix-flaky-error-session-test branch 3 times, most recently from 8f90a29 to 678c5d7 Compare March 1, 2023 13:54
@mydea mydea force-pushed the fn/fix-flaky-error-session-test branch from f3ec6e3 to d691af7 Compare March 1, 2023 14:29
@mydea mydea marked this pull request as ready for review March 1, 2023 14:30
@@ -89,7 +90,7 @@ sentryTest(
const url = await getLocalTestPath({ testDir: __dirname });

await page.goto(url);
await page.click('#go-background');
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This could probably sometimes lead to a second flush, which we didn't actually want/need. It will flush on page visit anyhow!

@@ -37,8 +37,10 @@ type SnapshotNode = {
* @param segmentId the segment_id of the replay event
* @returns
*/
export function waitForReplayRequest(page: Page, segmentId?: number): Promise<Request> {
return page.waitForRequest(req => {
export function waitForReplayRequest(page: Page, segmentId?: number): Promise<Response> {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We actually wait on a response here now, as that may be a bit better/more expected timing.

@mydea mydea requested a review from lforst March 1, 2023 14:31
Copy link
Member

@Lms24 Lms24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this!

@mydea mydea merged commit 8a5e0c3 into develop Mar 1, 2023
@mydea mydea deleted the fn/fix-flaky-error-session-test branch March 1, 2023 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Package: replay Issues related to the Sentry Replay SDK Type: Tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Flaky CI]: Playwright Replay errors in session mode test
2 participants