flaky
acme / storefront
Checking AI
SK
All test cases
83%Flakiness score

member cannot access admin settings

tests/auth/permissions.spec.ts·owned by @identity
Run history
18 runs
6 commits
Outcome flips
5 commits
same SHA, mixed result
Failure rate
28%
5 observed failures
Median duration
1.9s
all recent runs
Test sourcetests/auth/permissions.spec.ts
1const user = sharedFixtures.member;23test('member cannot access admin settings', async () => {4  const response = await api.get('/admin/settings', { user });5  expect(response.status).toBe(403);6});78test('admin can update settings', async () => {9  user.role = 'admin';10  await api.put('/admin/settings', { user, theme: 'dark' });11});
Failure evidence5 samples
LATEST FAILURE7b15e4a
AssertionError: expected 200 to equal 403
  at tests/auth/permissions.spec.ts:5:27
Metadata: previous test = "admin can update settings"
Flakiness by commit
Score is zero when outcomes are consistent—even if they fail.
0%50%100%a91cfc04bde72a9f38d219ac67b15e
Same-commit inconsistencyEach point is one commit
Run history18 events
ResultCommitDurationContext
PASS7b15e4a776 ms#16 · parallel
FAIL7b15e4a3069 ms#18 · serial
PASS7b15e4a2182 ms#10 · parallel
PASS19ac6ee2087 ms#16 · serial
PASS19ac6ee1840 ms#13 · parallel
PASS19ac6ee1593 ms#10 · parallel
PASSf38d2ca1498 ms#16 · parallel
FAILf38d2ca1891 ms#18 · parallel
PASSf38d2ca1004 ms#10 · serial
PASSe72a98b909 ms#16 · parallel
FAILe72a98b3202 ms#18 · serial
PASSe72a98b2315 ms#10 · parallel
PASSc04bd112220 ms#16 · serial
FAILc04bd112613 ms#18 · parallel
PASSc04bd111726 ms#10 · parallel
PASSa91cf021631 ms#16 · parallel
FAILa91cf022024 ms#18 · parallel
PASSa91cf021137 ms#10 · serial