kv/kvserver: TestMergeQueueWithSlowNonVoterSnaps failed

[cockroach-teamcity]

kv/kvserver.TestMergeQueueWithSlowNonVoterSnaps failed on release-26.1 @ 5faafce527c4fee87c3902b7a6faa2e5a0ef0224:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference
	(1) attached stack trace
	  -- stack trace:
	  | runtime.gopanic
	  | 	GOROOT/src/runtime/panic.go:783
	  | github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait
	  | 	pkg/util/ctxgroup/ctxgroup.go:151
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.muxRangeFeed
	  | 	pkg/kv/kvclient/kvcoord/dist_sender_mux_rangefeed.go:94
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed
	  | 	pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:207
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed
	  | 	pkg/kv/kvclient/rangefeed/db_adapter.go:82
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1
	  | 	pkg/kv/kvclient/rangefeed/rangefeed.go:370
	  | [...repeated from below...]
	Wraps: (2) attached stack trace
	  -- stack trace:
	  | runtime.gopanic
	  | 	GOROOT/src/runtime/panic.go:783
	  | runtime.panicmem
	  | 	GOROOT/src/runtime/panic.go:262
	  | runtime.sigpanic
	  | 	GOROOT/src/runtime/signal_unix.go:925
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*activeMuxRangeFeed).start
	  | 	pkg/kv/kvclient/kvcoord/dist_sender_mux_rangefeed.go:285
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*rangefeedMuxer).restartActiveRangeFeed
	  | 	pkg/kv/kvclient/kvcoord/dist_sender_mux_rangefeed.go:587
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*rangefeedMuxer).receiveEventsFromNode.func1
	  | 	pkg/kv/kvclient/kvcoord/dist_sender_mux_rangefeed.go:514
	  | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*rangefeedMuxer).receiveEventsFromNode.Group.GoCtx.func2
	  | 	pkg/util/ctxgroup/ctxgroup.go:200
	  | golang.org/x/sync/errgroup.(*Group).Go.func1
	  | 	external/org_golang_x_sync/errgroup/errgroup.go:93
	  | runtime.goexit
	  | 	src/runtime/asm_amd64.s:1693
	Wraps: (3) runtime error: invalid memory address or nil pointer dereference
	Error types: (1) *withstack.withStack (2) *withstack.withStack (3) runtime.errorString

Stack:

goroutine 9872 [running]:
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00d81d100?, {0x8fc8b40?, 0xc00d8344b0?}, 0xc00d84a0a8?})
	pkg/util/ctxgroup/ctxgroup.go:151 +0xbb
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x8fc8b78?, 0xc008df7aa0?}, {0xc0083dbcb0, 0x2, 0x7230cc0?})
	pkg/util/ctxgroup/ctxgroup.go:224 +0x11d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc004bd7180, {0x8fc8b78, 0xc008df7aa0}, {0x9031a40, 0xc009516410}, 0x0)
	pkg/kv/kvclient/rangefeed/rangefeed.go:396 +0xabd
github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).start.func1({0x8fc8b40?, 0xc009516460?})
	pkg/kv/kvclient/rangefeed/rangefeed.go:256 +0x2e9
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0x8fc8b40, 0xc009516460})
	pkg/util/stop/stopper.go:440 +0x8a
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 9868
	pkg/util/stop/stopper.go:438 +0x125

Log preceding fatal error

=== RUN   TestMergeQueueWithSlowNonVoterSnaps
    test_log_scope.go:171: test logs captured to: outputs.zip/logTestMergeQueueWithSlowNonVoterSnaps899737223
    test_log_scope.go:82: use -show-logs to present logs inline
    test_server_shim.go:668: DRPC is enabled (via override by TestingGlobalDRPCOption)

Parameters:

• attempt=1
• run=2
• shard=25

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-58362

[stevendanna]

Duplicate of #157997