Skip to content

flaky: benchmark/test-benchmark-crypto #52690

Closed
Closed
flaky: benchmark/test-benchmark-crypto#52690
Labels
flaky-testIssues and PRs involving tests that fail intermittently in CI.linuxIssues and PRs related to the Linux platform.

Description

@mhdawson
mhdawson
opened on Apr 25, 2024

Test

test-benchmark-crypto

Platform

Linux x64

Console output

11:19:53 not ok 4009 benchmark/test-benchmark-crypto
11:19:53   ---
11:19:53   duration_ms: 3234.66800
11:19:53   severity: fail
11:19:53   exitcode: 1
11:19:53   stack: |-
11:19:53     node:assert:126
11:19:53       throw new AssertionError(obj);
11:19:53       ^
11:19:53     
11:19:53     AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
11:19:53     
11:19:53     1 !== 0
11:19:53     
11:19:53         at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10)
11:19:53         at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9
11:19:53         at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
11:19:53       generatedMessage: true,
11:19:53       code: 'ERR_ASSERTION',
11:19:53       actual: 1,
11:19:53       expected: 0,
11:19:53       operator: 'strictEqual'
11:19:53     }
11:19:53     
11:19:53     Node.js v22.0.0-pre
11:19:53     node:assert:126
11:19:53       throw new AssertionError(obj);
11:19:53       ^
11:19:53     
11:19:53     AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
11:19:53     
11:19:53     1 !== 0
11:19:53     
11:19:53         at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12)
11:19:53         at ChildProcess.emit (node:events:520:28)
11:19:53         at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
11:19:53       generatedMessage: true,
11:19:53       code: 'ERR_ASSERTION',
11:19:53       actual: 1,
11:19:53       expected: 0,
11:19:53       operator: 'strictEqual'
11:19:53     }
11:19:53     
11:19:53     Node.js v22.0.0-pre

Build links

Additional information

No response

Activity

  1. mhdawson
    added
    flaky-testIssues and PRs involving tests that fail intermittently in CI.
    on Apr 25, 2024
  2. github-actions
    added
    linuxIssues and PRs related to the Linux platform.
    on Apr 25, 2024

  3. richardlau commented on Apr 25, 2024

    @richardlau
    richardlau
    on Apr 25, 2024
    Member

    Given this stack trace

    11:19:53         at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10)

    this is most likely going to be for the same reason as #38226.

  4. jakecastelli commented on Jun 14, 2024

    @jakecastelli
    jakecastelli
    on Jun 14, 2024
    Member

    Flaky again here in this PR

    see Detail 
    not ok 4016 benchmark/test-benchmark-crypto
19:42:55   ---
19:42:55   duration_ms: 2513.95400
19:42:55   severity: fail
19:42:55   exitcode: 1
19:42:55   stack: |-
19:42:55     node:assert:126
19:42:55       throw new AssertionError(obj);
19:42:55       ^
19:42:55     
19:42:55     AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
19:42:55     
19:42:55     1 !== 0
19:42:55     
19:42:55         at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10)
19:42:55         at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9
19:42:55         at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
19:42:55       generatedMessage: true,
19:42:55       code: 'ERR_ASSERTION',
19:42:55       actual: 1,
19:42:55       expected: 0,
19:42:55       operator: 'strictEqual'
19:42:55     }
19:42:55     
19:42:55     Node.js v23.0.0-pre
19:42:55     node:assert:126
19:42:55       throw new AssertionError(obj);
19:42:55       ^
19:42:55     
19:42:55     AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
19:42:55     
19:42:55     1 !== 0
19:42:55     
19:42:55         at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/benchmark.js:28:12)
19:42:55         at ChildProcess.emit (node:events:520:28)
19:42:55         at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
19:42:55       generatedMessage: true,
19:42:55       code: 'ERR_ASSERTION',
19:42:55       actual: 1,
19:42:55       expected: 0,
19:42:55       operator: 'strictEqual'
19:42:55     }
  5. jasnell
    added a commit that references this issue on Jun 30, 2024

    test: mark `test-benchmark-crypto` as flaky

    fe2d4dc
  6. targos
    added a commit that references this issue on Jul 1, 2024

    test: mark `test-benchmark-crypto` as flaky

    6e66d97

  7. github-actions commented on May 22, 2026

    @github-actions
    github-actionsbot
    on May 22, 2026 – with GitHub Actions
    Contributor

    This issue has been marked as stale due to 210 days of inactivity.
    It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

  8. github-actions
    added
    staleIssues and PRs marked stale due to inactivity and scheduled for automatic closure.
    on May 22, 2026
  9. jakecastelli
    removed
    staleIssues and PRs marked stale due to inactivity and scheduled for automatic closure.
    on May 24, 2026

  10. trivikr commented on Jul 16, 2026

    @trivikr
    trivikr
    on Jul 16, 2026
    Member

    Closing as last time this test was flaky was in Aug 2024

    https://github.com/nodejs/reliability/issues?q=sort%3Aupdated-desc%20is%3Aissue%20state%3Aopen%20test-benchmark-crypto%20AssertionError

  11. trivikr
    closed this as completedon Jul 16, 2026
  12. panva
    reopened this on Sep 20, 2026
  13. panva
    added a commit that references this issue on Sep 20, 2026

    test: deflake test-benchmark-crypto

    355fa18
  14. nodejs-github-bot
    closed this as completedin 194eb69on Sep 21, 2026
  15. pull
    added 2 commits that reference this issue on Sep 21, 2026

    test: deflake test-benchmark-crypto

    194eb69

    test: deflake test-http2-debug

    3f76564
  16. aduh95
    added 2 commits that reference this issue on Sep 27, 2026

    test: deflake test-benchmark-crypto

    b9f61ea

    test: deflake test-http2-debug

    1be62ae
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    flaky-testIssues and PRs involving tests that fail intermittently in CI.linuxIssues and PRs related to the Linux platform.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions