Skip to content

release-26.4: roachtest: perturbation/full/splits/asleep=false failed #175662

Closed
Closed
release-26.4: roachtest: perturbation/full/splits/asleep=false failed#175662
Labels
A-testingTesting tools and infrastructureC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.T-kvKV Teambranch-release-26.4Used to mark GA and release blockers, technical advisories, and bugs for 26.4release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.target-release-26.4.0target-release-27.1.0

Description

@cockroach-teamcity
cockroach-teamcity
opened on Sep 19, 2026

roachtest.perturbation/full/splits/asleep=false failed with artifacts on release-26.4 @ b4884d371d74d172ab184bc4ef0924ccb758f3c2:

Failed with:

(splits.go:243).startPerturbation: query Cockroach node ID: dial tcp 10.91.96.185:26257: connect: connection refused
test artifacts and logs in: /artifacts/perturbation/full/splits/asleep=false/run_1

Cluster Node to Ip Mapping:

Node Public IP Private IP
teamcity-21523842-1789803587-60-n13cpu16sm-0001 10.91.98.223
teamcity-21523842-1789803587-60-n13cpu16sm-0002 10.91.98.124
teamcity-21523842-1789803587-60-n13cpu16sm-0003 10.91.98.126
teamcity-21523842-1789803587-60-n13cpu16sm-0004 10.91.98.35
teamcity-21523842-1789803587-60-n13cpu16sm-0005 10.91.98.133
teamcity-21523842-1789803587-60-n13cpu16sm-0006 10.91.98.13
teamcity-21523842-1789803587-60-n13cpu16sm-0007 10.91.98.129
teamcity-21523842-1789803587-60-n13cpu16sm-0008 10.91.98.47
teamcity-21523842-1789803587-60-n13cpu16sm-0009 10.91.98.227
teamcity-21523842-1789803587-60-n13cpu16sm-0010 10.91.98.40
teamcity-21523842-1789803587-60-n13cpu16sm-0011 10.91.97.229
teamcity-21523842-1789803587-60-n13cpu16sm-0012 10.91.96.20
teamcity-21523842-1789803587-60-n13cpu16sm-0013 10.91.96.185

Parameters:

  • acMode=defaultOption
  • arch=amd64
  • blockSize=4096
  • cloud=gce
  • concurrency=500
  • coverageBuild=false
  • cpu=16
  • diskBandwidthLimit=0
  • diskCount=2
  • disks=2
  • encrypted=false
  • fillDuration=10m0s
  • followerReadPercent=50
  • fs=ext4
  • leaseType=leader
  • localSSD=true
  • mem=standard
  • numNodes=12
  • numWorkloadNodes=1
  • perturbationDuration=10m0s
  • ratioOfMax=0.5
  • readPercent=50
  • runtimeAssertionsBuild=false
  • seed=0
  • splits=500
  • validationDuration=5m0s
  • vcpu=16
  • workloadConnInit=
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

See: Datadog Logs

/cc @cockroachlabs/kv-triage

Improve this report!

Jira issue: CRDB-68557

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    A-testingTesting tools and infrastructureC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.T-kvKV Teambranch-release-26.4Used to mark GA and release blockers, technical advisories, and bugs for 26.4release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.target-release-26.4.0target-release-27.1.0

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions