Skip to content

Reduce physrep-sql against the metadb#5822

Closed
markhannum wants to merge 1 commit intobloomberg:mainfrom
markhannum:physrep_less_sql
Closed

Reduce physrep-sql against the metadb#5822
markhannum wants to merge 1 commit intobloomberg:mainfrom
markhannum:physrep_less_sql

Conversation

@markhannum
Copy link
Contributor

We noticed a spike in the number of metadb connections under version 8.2.190. This PR reduces the amount of metadb traffic by removing sql which is no longer required, and by reducing the frequency of our periodic checks from 10 seconds to 1 minute.

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
2026-03-18T16:55:48EDT [243073] truncatesc **quarantined**
2026-03-18T16:55:48EDT [243073] truncatesc_offline_generated **quarantined**
2026-03-18T16:55:48EDT [243073] physrep_ignore_table
2026-03-18T16:55:48EDT [243073] log_trigger
2026-03-18T16:55:48EDT [243073] consumer_non_atomic_default_consumer_generated **quarantined**
2026-03-18T16:55:48EDT [243073] remsql_locks_rte_connect_generated **quarantined**
2026-03-18T16:55:48EDT [243073] remsql_locks **quarantined**
2026-03-18T16:55:48EDT [243073] sc_downgrade [timeout] **quarantined**

@markhannum markhannum force-pushed the physrep_less_sql branch 6 times, most recently from 974c9f6 to bbccd0e Compare March 19, 2026 18:56
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
scindex_logicalsc_generated
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
physrep_ignore_table [timeout]
log_trigger [timeout]
guid [timeout]

@markhannum markhannum force-pushed the physrep_less_sql branch 6 times, most recently from 9c10865 to 24a8a3f Compare March 19, 2026 20:33
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
sc_timepart [failed with core dumped] **quarantined**
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep_via_comdb2_files_generated
phys_rep
tunables
physrep_ignore_table [timeout]

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
sc_timepart [failed with core dumped] **quarantined**
sc_truncate_multiddl_generated [db unavailable at finish] **quarantined**
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
sp_snapshot_generated
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep_via_comdb2_files_generated
phys_rep

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep_via_comdb2_files_generated
phys_rep
tunables
dohsql_leaks [timeout]
physrep_ignore_table [timeout]

@markhannum markhannum force-pushed the physrep_less_sql branch 2 times, most recently from 5b969e1 to e6df601 Compare March 20, 2026 13:07
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
sc_resume_logicalsc_generated **quarantined**
sc_parallel_logicalsc_generated
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep
phys_rep_via_comdb2_files_generated
physrep_ignore_table [timeout]

@markhannum markhannum force-pushed the physrep_less_sql branch 2 times, most recently from a9609e0 to 6eef5e9 Compare March 20, 2026 15:47
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
phys_rep_tiered_firstfile_generated
phys_rep_tiered
analyze **quarantined**
consumer_non_atomic_default_consumer_generated **quarantined**
sc_transactional_rowlocks_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep

@markhannum markhannum force-pushed the physrep_less_sql branch 3 times, most recently from b2ce90a to c184d56 Compare March 20, 2026 18:39
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
sc_timepart [failed with core dumped] **quarantined**
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
phys_rep_tiered
phys_rep_tiered_firstfile_generated
sc_resume_logicalsc_generated **quarantined**
consumer_non_atomic_default_consumer_generated **quarantined**
sc_transactional_rowlocks_generated **quarantined**
remsql_locks **quarantined**
remsql_locks_rte_connect_generated **quarantined**

Signed-off-by: Mark Hannum <mhannum@bloomberg.net>
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cbuild submission: Success ✓.
Regression testing: Success ✓.

The first 10 failing tests are:
sc_timepart [failed with core dumped] **quarantined**
truncatesc **quarantined**
truncatesc_offline_generated **quarantined**
reco-ddlk-sql **quarantined**
triggersc_latency
consumer_non_atomic_default_consumer_generated **quarantined**
remsql_locks_rte_connect_generated **quarantined**
remsql_locks **quarantined**
phys_rep_via_comdb2_files_generated
phys_rep

@markhannum markhannum closed this Mar 22, 2026
@markhannum
Copy link
Contributor Author

went with a different strategy- see #5829

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants