Skip to content

[ISSUE #9719] Fix Static Variable Conflicts in Multi-Broker Metrics Management#9720

Merged
ltamber merged 9 commits intoapache:developfrom
RongtongJin:develop-20250920-3
Sep 22, 2025
Merged

[ISSUE #9719] Fix Static Variable Conflicts in Multi-Broker Metrics Management#9720
ltamber merged 9 commits intoapache:developfrom
RongtongJin:develop-20250920-3

Conversation

@RongtongJin
Copy link
Copy Markdown
Contributor

Which Issue(s) This PR Fixes

Fixes #9719

Brief Description

  1. Convert Static Variables to Instance Variables

    • Transform all static fields in metrics managers to instance fields
    • Each broker instance will have its own metrics manager instance
    • Remove static method dependencies
  2. Instance-Based Metrics Management

    • BrokerMetricsManager creates and manages individual instances of metrics managers
    • Each broker gets its own RemotingMetricsManager, PopMetricsManager, and RocksDBStoreMetricsManager
    • Metrics are collected and stored per-broker instance
  3. Dependency Injection Pattern

    • Pass metrics manager instances to classes that need them
    • Update NettyRemotingAbstract to accept RemotingMetricsManager instance
    • Modify processor classes to use instance-based metrics calls
  4. Interface Updates

    • Add instance-based methods to RemotingServer interface
    • Update NettyRemotingServer to delegate to instance methods
    • Maintain backward compatibility where possible

How Did You Test This Change?

- Remove all static global instance related code
- Convert all static methods to instance methods
- Remove static wrapper methods for backward compatibility
- Add constructor and getter/setter methods for instance variables
- This ensures each broker instance manages its own metrics in multi-broker scenarios
- Remove all static global instance related code
- Convert all static methods to instance methods
- Remove static wrapper methods for backward compatibility
- Add constructor and getter/setter methods for instance variables
- This ensures each broker instance manages its own Pop metrics in multi-broker scenarios
…r scenarios

- Add RemotingMetricsManager instance variable to NettyRemotingAbstract
- Add setter/getter methods for RemotingMetricsManager in NettyRemotingAbstract
- Update writeResponse method to use instance-based metrics recording
- Add writeResponse method to RemotingServer interface
- Update BrokerController to set RemotingMetricsManager on NettyRemotingServer instances
- Update InnerBrokerController to set RemotingMetricsManager on SubRemotingServer instances
- Update all processor classes to use instance-based writeResponse calls
- Update RocksDBStoreMetricsManager integration in DefaultStoreMetricsManager
- Remove unused imports and clean up code

This ensures each broker instance manages its own metrics independently,
solving the static variable conflict issue in multi-broker processes.
- Fix ChangeInvisibleTimeProcessorTest by using @SPY instead of @mock for BrokerController
- Inject BrokerMetricsManager into BrokerController using reflection
- Remove unnecessary mock stubbings
- Update all processors to use new static writeResponse method
- Fix BrokerMetricsManager initialization issues in AckMessageProcessorTest and PopReviveServiceTest

These changes ensure all related tests pass after refactoring metrics managers from static variables to instance variables.
- Remove duplicate import in PopMessageProcessor.java
- Clean up unused imports in ChangeInvisibleTimeProcessorTest.java
- Clean up unused imports in AckMessageProcessorTest.java
- Ensure all modules compile successfully without checkstyle violations

These changes complete the metrics manager refactoring from static variables to instance variables, resolving statistical information conflicts in multi-broker processes.
- Add PopMetricsManager mock to PopReviveServiceTest
- Fix NullPointerException in reviveRetry method
- Ensure rePutCK method is called correctly when retry fails
- Test now passes successfully with proper metrics manager setup
- Remove debug logging statements from reviveMsgFromCk method
- Clean up test output for better readability
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Sep 20, 2025

Codecov Report

❌ Patch coverage is 24.09091% with 167 lines in your changes missing coverage. Please review.
✅ Project coverage is 48.12%. Comparing base (8fc57f1) to head (7b99c37).
⚠️ Report is 168 commits behind head on develop.

Files with missing lines Patch % Lines
...rocketmq/remoting/netty/NettyRemotingAbstract.java 4.61% 59 Missing and 3 partials ⚠️
...etmq/store/metrics/RocksDBStoreMetricsManager.java 23.52% 39 Missing ⚠️
...che/rocketmq/broker/metrics/PopMetricsManager.java 46.87% 16 Missing and 1 partial ⚠️
...ketmq/remoting/metrics/RemotingMetricsManager.java 0.00% 11 Missing ⚠️
...rocketmq/broker/processor/PopMessageProcessor.java 10.00% 9 Missing ⚠️
...cketmq/broker/processor/QueryMessageProcessor.java 0.00% 8 Missing ⚠️
...ker/processor/DefaultPullMessageResultHandler.java 0.00% 4 Missing ⚠️
...ocketmq/broker/processor/PeekMessageProcessor.java 0.00% 4 Missing ⚠️
...ache/rocketmq/container/InnerBrokerController.java 0.00% 2 Missing and 2 partials ⚠️
...cketmq/broker/processor/PopBufferMergeService.java 33.33% 2 Missing ⚠️
... and 6 more
Additional details and impacted files
@@              Coverage Diff              @@
##             develop    #9720      +/-   ##
=============================================
- Coverage      48.29%   48.12%   -0.18%     
+ Complexity     12181    12141      -40     
=============================================
  Files           1313     1313              
  Lines          93233    93325      +92     
  Branches       11944    11958      +14     
=============================================
- Hits           45031    44912     -119     
- Misses         42633    42832     +199     
- Partials        5569     5581      +12     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Copy Markdown
Contributor

@fuyou001 fuyou001 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Contributor

@guyinyou guyinyou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@ltamber ltamber merged commit 7d75021 into apache:develop Sep 22, 2025
12 of 15 checks passed
@RongtongJin RongtongJin added the ha label Sep 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Enhancement] Fix Static Variable Conflicts in Multi-Broker Metrics Management

5 participants