Skip to content

Document that primary instance scale-out is limited to error ingestion - #5970

Open
johnsimons wants to merge 1 commit into
masterfrom
john/primary_ha_docs
Open

johnsimons wants to merge 1 commit into
masterfrom
john/primary_ha_docs

Conversation

@johnsimons

Copy link
Copy Markdown
Member

An audit of every hosted service, handler, controller and persister path in the primary found five places in the retry pipeline, heartbeat monitoring, integration event dispatch and throughput collection that assume a single process. Add a decision record concluding that exactly one full primary instance may run against a database, with --error-ingestion-only workers providing horizontal scale and active-passive failover providing HA, plus a topic page listing what each component would need to become deployment-global.

An audit of every hosted service, handler, controller and persister path
in the primary found five places in the retry pipeline, heartbeat
monitoring, integration event dispatch and throughput collection that
assume a single process. Add a decision record concluding that exactly
one full primary instance may run against a database, with
`--error-ingestion-only` workers providing horizontal scale and
active-passive failover providing HA, plus a topic page listing what
each component would need to become deployment-global.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants