Skip to content

Improved warning for Observer mode#7433

Merged
neilalexander merged 1 commit intonats-io:mainfrom
roeschter:Observer-mode-info-improvements---SYS-leaf-node-connect
Oct 14, 2025
Merged

Improved warning for Observer mode#7433
neilalexander merged 1 commit intonats-io:mainfrom
roeschter:Observer-mode-info-improvements---SYS-leaf-node-connect

Conversation

@roeschter
Copy link
Copy Markdown
Contributor

This is purely a documentation/info update, which catches a situation where a correctly configured leaf cluster would fail to elect a meta leader, but the user would be left completely clueless as to why.

When a cluster is started the first time(!) it will check if leaf nodes connections to SYS are configured. If this is the case the leaf cluster MAY be an extension of a hub cluster. It cannot verify this until the connection is actually made and it can compare jetstream domains (its an extension only if the domains are the same)
As a result the cluster goes into "Observer mode" in which meta leader election is deferred till the hub is connection via a SYS leaf node connection.

BUT, not hint is printed on the FIRST start- only on the SECOND start of the cluster a hint was printed.
The /healthz probe fails with a 503 and no further details beyond "JetStream has not established contact with a meta leader"

This leaves the user completely clueless as to why the meta leader was not elected. nats server report jetstream also gives no hint as to the reason.

This change prints the extension_hint warning on first start and extends the explanation.

Signed-off-by: Michael Röschter michael@roeschter.de

Signed-off-by: Michael Röschter <michael@roeschter.de>
@roeschter roeschter requested a review from a team as a code owner October 14, 2025 11:26
Copy link
Copy Markdown
Member

@MauriceVanVeen MauriceVanVeen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@neilalexander neilalexander merged commit c739352 into nats-io:main Oct 14, 2025
65 of 67 checks passed
neilalexander added a commit that referenced this pull request Oct 28, 2025
Includes the following:

- #7380
- #7384
- #7385
- #7388
- #7395
- #7400
- #7399
- #7401
- #7402
- #7423
- #7424
- #7411
- #7428
- #7429
- #7431
- #7435
- #7433
- #7443
- #7455
- #7465
- #7466
- #7460
- #7484
- #7479

Signed-off-by: Neil Twigg <neil@nats.io>
neilalexander added a commit that referenced this pull request Oct 30, 2025
Includes the following:

- #7435
- #7433
- #7436
- #7443
- #7440
- #7444
- #7452
- #7455
- #7458
- #7465
- #7466
- #7474
- #7469
- #7460
- #7449
- #7484
- #7479
- #7486
- #7495
- #7482
- #7496

Signed-off-by: Neil Twigg <neil@nats.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants