This repository was archived by the owner on Jan 7, 2022. It is now read-only.
Commit 3494e39
Title: [logdevice] Cutting version 2.44.0
Summary:
Change log for 2.44.0:
D16623099 Retry stream append request with exponential backoff
D16570786 [logdevice][NCM] EASY / FUN: explicitly specify node id in addNewNodeUpdate
D16676885 [logdevice] Fix `maintenance' command
D16224645 Compile admin command table as a separate target.
D16274643 Move deserialize and handshake processing to SocketDependencies.
D16269572 Making Connection independent of worker
D16274677 Separate SocketDependencies into a separate file.
D16686572 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D16687370 [logdevice] Support dual-powered rows for failure domains
D16678391 [logdevice] Consolidate type checking configuration
D16682066 Added filename argument to ldshell dump-logs-config
D16627706 Set an LD cluster name to a tier name instead of a job name
D16676125 Fix bug after Landing #D16620600, update test_cli.py
D16590760 ld kobold zeus library case of logdevice.production parent
D16689288 [phabricator] rm base_module from phabricator TARGETS, part 6 new_phabricator_graphql_helpers
D16671357 Add support for passing explicit hostnames to ldshell
D16574274 cleanup the location where the alarm cb flag is disabled
D16715260 Don't throw away ldtrash
D16272020 Make FlowGroup independent of Sender and Worker
D16274690 Admin command table to compile socket as separate target
D16716451 Fix type annotations in open source part of LDOps 2
D16709073 [logdevice] Add universal convenient get_admin_client method to service_discovery library in LDOps2
D16648313 [logdevice] Integrate Kafka Client with ldbench
D16617073 [logdevice] fix environment module in coordinator
D16728895 Modify Cluster schema to store entire tier name
D16723808 Fix some type annotations bugs in models/lib
D16739996 Fix Chronos capture failure
D16531941 Fix and improve ldbench stats a little
D16637155 Add stat for bytes queued in sockets per message type
D16673865 Adding stream info in STORE_Message and LocalLogStoreRecord
D16728028 Fix logsdb iterator pinning memtable for too long
D16723929 Add CLI command for "list"
D16776635 Update 'list' command options naming
D16763337 [logdevice] Add Client Session ID to logdevice all read streams debug info
D16786217 ZK sync vaklues between multiple LD nodes
D16761398 [logdevice] Enable coroutines in C++ flavour of AdminAPI
D16723992 Unit test for "list" command
D16790094 Add show command & Update naming of 'list' command
D16802244 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D16687424 [logdevice][tw] Implement a dummy task controller
D16782296 [logdevice] Add Client Session ID to logdevice readers flow sampling
D16599551 Tuning for dissagregated clusters
D16647208 LDShell expand pool cleanup
D16711125 [logdevice] Get sequencer to storage ratio from CFGR
D16647433 [logdevice] all read streams debug info to debug-ztail
D16732021 [logdevice] Integrate ldshell pool expand with ldshell expand
D16762334 [logdevice][pools] Integrating pool expand with kobold
D16762751 [logdevice][pools] make the creation of failure domains part of the score
D16787199 [logdevice] Fix `is_config_log_readable'
D16782483 [logdevice] simplify the drop of in-maintenance or in-use hosts before expands
D16784346 [logdevice] add all constrains from CFGR and tested for eunomia and global pools
D16541492 [logdevice] Use `LocationScope' enum in `getReplicationInfo' [2/2]
D16577599 React to settings update in RebuildingSupervisor
D16829503 [logdevice][pools] Fixed a typo in ldshell pool command
D16723751 Update schema in logdevice/fb/ops/ldops/characterize_load
D16809199 Make 'ls-snapshot' format consistent with 'ls-cluster'
D16816231 Add log message for invalid node ID case in HELLO message handler
D16797725 Add delete command
D16824320 Add unit test for new functions in 'wlman.py'
D16852566 [typing] Update pyre version for global configuration
D16676908 Sending FIFO order replies from sequencer for stream appends.
D16863876 [typing] Update pyre version for logdevice
D16443324 [logdevice] fix RELEASE issue during starting state and move NodeSet selection related files to their own folder
D15275040 Handle histogram overflow better
D16852544 Fix race condition in StatsHolder when threads are destroyed
D16830380 [logdevice] add rsid to debug client table and change time format
D16890907 [logdevice] Fix worker benchmark
D16894195 [logdevice] Fix histogram warning
D16839499 Add 'create' command to manually create snapshot
D16749304 Sequencer logic for allotting LSNs to ensure FIFO order
D16751993 Recovery protocol to plug holes for write stream records after first hole
D16572751 Tag to detect dataloss either partially or wholly due to losing copies
D16897893 [logdevice] Processor initialization order bug fix
D15754781 Implementation of MetadataNodeSetSelector
D16808602 chown audit logs file
D16832598 Log an error when we can't reopen a log file
D15709768 [logdevice] Add a timer to periodically monitor Metadata Nodeset and request membership updates
D16863329 Add 'update' commands to update cluster/snapshot
D16800812 Stats about ClientReadStream rewinds and SCD, and integration test for underreplicated regions handling
D16824369 Fix ClientReadStream getting stuck when a node is down and another node has underreplicated ranges
D16824372 Fix read-stream-guaranteed-delivery-efficiency getting stuck when a node is down but not in rebuilding set
D16751507 Fix ~6 bugs in BufferedWriter, and add a stat
D16897594 [logdevice] possible starvation in TrafficShaper fixed
D16827524 [logdevice] Add client session ID to ldquery readers table
D16896737 [logdevice] Fix not bumping config version when metadata config changes
D16908204 Integrate with 'cogwheel/user_tests/logdevice/LoadgenTestBase.py'
D16908175 Use libfb.py.asyncio.runners run method instead of asynio.run
D16914968 [logdevice] Remove UpdateableSecurityInfo::getSecurityConfig
D16885458 ldshell wth improvements
D16809392 [logdevice] Add support for snapshotting ClusterMaintenanceState
D16809537 [phabricator][py][codemod] phabricator_service_user_auth_strategies -> phabricator_auth_strategy_factory
D16878732 Fix localhost-cluster not working out of the box because of certificate settings
D16936062 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D16919062 [logdevice] Create opsstream events for test runs
D16894163 [logdevice]Add enable/disable sampling by client session ID possibility
D16827137 [logdevice][pools] Expand eunomia pool unit-test
D16828248 [logdevice][pools] Unit test for cluster_needs_sequencer
D16829122 [logdevice][pools] Unit tests for get_new_tier_name
D16829453 [logdevice][pools] Move kobold stuff from pools into ldshell command
D16830030 [logdevice][pools] Expand global pool unit-test
D16830505 [logdevice][pools] Use new cluster name template from CFGR
D16830592 [logdevice][pools] Fix a bug in ldshell pool command
D16856574 [logdevice][pools] Some cleanup in unit tests
D16890003 [logdevice][pools] Modify weights for expands from ldshell
D16936920 [logdevice] Propagate job skip check from Shrink to disable
D16813615 Allow WikiGenerator to accept both dynamic tables and strings
D16922982 [logdevice] Remove EvbufferTextOutput usage from admin commands.
D16897434 [logdevice][tw] Basic restart support in LogDevice task controller
D16891158 [logdevice]Add CSID as argument for filter in debug client
D16919488 [logdevice] Automatic config changes for "debug client"
D16274722 SocketDependencies created outside Socket
D16274734 New target for connection
D16953438 [logdevice] IntegrationTestUtils: bump server config version when doing expand() and shrink()
D16950276 Make _reshard_base_load async
D16962558 [logdevice][tw] Support forced restarts in task controller
D16859181 Extend the VersionedConfigStore::updateConfig() to support a mutation functor
D16932318 Add command to sync continuous e2e tests snapshots to database
D16890540 [logdevice][pools] Bug fix
D16949567 Pull Mike's consistent hashing algorithm into its own structure
D16950434 Stats for delay in socket send
D16995120 re-add footer to features-per-customer wiki page
D16934208 Edit load_generator to load environment workloads from production database
D16992679 Update wlman library functions support storing e2e_tests params in database
D16983207 [logdevice][NCM] Integration test: allow setting NodesConfiguration Source of truth on Servers
D16930321 [logdevice] perturb less in update_nodes_configuration_for_test
D16653101 Add LogDevice concepts and designs documentation.
D17056183 [codemod] Migrate to optional_field_ref Thrift API
D17070233 [logdevice] Fix location string for incorrect SeRF failure domains
D16985182 [logdevice] add differentiation of records by ReadStreamID in debug client
D16735993 [LogDevice in ServiceLab]: Smc2ThriftClient to RetryingSmc2Client
D17066449 Add workload manager to packman.yml as 'ld-wlman'
D16837093 Modifying ACK behavior of stream write append sink
D15631488 [logdevice] ACL cache for PermissionChecker
D16284275 [logdevice] Add options to enable/configure ACL Cache
D16997890 [logdevice] Add stats to ACL cache
D16997889 [logdevice] Add integration tests for ACL cache
D17081892 Fix workload_manager job failures on chronos
D16924931 Bug Fixes
D16926248 Integration Tests for StreamWriter
D16978998 Make WeightAwareNodeSetSelector pick nodeset size mentioned in config for internal logs
D17066103 Public API
D17074151 [logdevice] Fix MaintenanceManager storage state calculation
D17090919 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D16970654 [logdevice] stats benchmarks revamp
D16584195 [logdevice] ClientReadersFlowTracer: fix issues with time lag correction in lagging readers metric
D16998041 print tags from ldshell gap analysis. And always perform gap analyis whether data was trimmed or not
D17066970 Assigning write stream id
D17116825 Garbage collection for write streams in epoch sequencer
D17104640 [opensource] Adopt Contributor Covenant
D17130746 [logdevice] Regenerate settings.md
D17130996 [logdevice][ldshell] Fix status when there's a config file vs SMC mismatch
D17052300 [codemod][logdevice] migrate python3 ThriftServer to SvcThriftServer
D15880649 Check for existence of log ID early in SequencerRouter/SequencerLocator
D17135309 [typing] Update pyre version for logdevice
D17135103 [typing] Update pyre version for global configuration
D16903597 Check whether SSL authentication is required when determining whether to use an SSL socket
D17139972 [quick] apply location change to scribe hosts too
D16752100 Fix error message in request_util
D17126664 Make rocksdb-metadata-compaction-period flush+compact even if there's only one sst file
D17146270 [phabricator][conduit] rm conduit in logdevice/py/ldshell/fb/commands/diff_status.py
D16938914 [logdevice][pools] Introducing pool shrinks
D16937327 [logdevice] CommandProcessor
D17126462 Print warning if rocksdb iterator skips lots of keys
D17087344 Fix sequencer getting stuck in ACTIVATING state if log was removed from config at the wrong time
D17111109 [logdevice][easy] Delete test runner service
D17156639 [scribe.capacity_lib] Enable autodeps for all TARGETS in scribe/lib + scribe/scripts.
D17096126 Modify ld-characterize-load to include comparable fields of worker arguments for deviation detection
D17165673 [typing] Update pyre version for logdevice
D17099744 Move get_prefix_by_type and similar methods into util
D17107069 Implement deviation detection function
D17132302 Fixing documentation
D17174285 Increase length of type in db schema
D16714478 [logdevice][MaintenanceManager] Add support for marking shards as unrecoverable
D16863872 [logdevice] Kickoff rebuilding if NC transtition appears stuck
D17180041 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D16890896 [logdevice][ldshell] Add autodeps in ldshell
D17091127 [logdevice] Separate boycotting stats from the rest of stats
D17182585 [logdevice][tw] Move TaskControl operation serialization to JSON
D17165338 Print logdeviced's command line arguments on startup.
D17177532 [logdevice] fix the bias selection due to ignoring the domain storage state in WeightedCopysetSelector
D17174937 Add restart-backlog-depth to comparable fields
D17181182 [logdevice] Remove old / unused columns from feature wiki
D16920368 [rocksdb] Release 6.4 branch of RocksDB to fbcode
D17187808 Fix missing parameter in tier.sequencer_prefix
D17185764 A high but sane default for deletetion rate-limit
D17125145 Check if LogIsEmpty in memory before checking with rocksdb
D17184075 Add a setting to tune queue latency log lines
D17202853 [logdevice] Don't subscribe to boycotting stats retention period update
D17205038 [logdevice][tw] Encode TaskControl operation as base64(thrift)
D17202933 [logdevice] Support both trace-logger and trace_logger fields
D17205322 [logdevice] Make setting rocksdb-first-key-in-index false by default
D17212143 Fix smc check in feature tier script
D17138026 Make onStartedRunning and onStoppedRunning non-static
D17181157 [logdevice][oss] Expose the ConfigPermissionChecker and HELLOPrincipalParser as builtin plugins
D15805701 [SelfRegistration] Register node on startup if it's not in config
D17224641 [logdevice] Resync settings
D17130977 [logdevice][pools] Add the ability to specify custom tier of spare machines
D17219764 [logdevice] Fix reliability of MaintenanceAPITest
D17215877 Edit get_workload function to show log info in ld-characterize-load
D17193016 [logdevice][AdminAPI] Fix the equivalence of two MaintenanceDefinitions
D17214153 Pass shared_ptr for sequencers list to SequencerLocator instead of raw pointer
D17192594 Modify the number of samples used in _calculate_p_value function
D16356056 [Thrift] Bake templates into the compiler binary
D16761319 [Folly] Switch from -defs.h pattern
D17254934 [typing] Update pyre version for global configuration
D17183703 Clean up HASHMAP_SUPPORT_IN_GOSSIP protocol version
D17228963 [logdevice] Exclude ServiceLab tiers from Scuba retention adjuster
D17255135 [typing] Update pyre version for logdevice
D17239265 ldshell status2 added support for --hosts
D17257956 [logdevice][easy][NCM] Return Publisher NC instead of NCM NC in CONFIG_FETCH response
D17239833 Modify wlman.py, add WorkloadManager class
D17217421 cpp TaskControllers to use helper to build response
D17207608 Authenticate servers during handshake if configured
D17169760 Fixing destroy-after-use bug
D17128401 Constrain most logsdb directory iterators to a single log
D17293937 Increase the LDbench load for ServiceLab tests
D17312861 Refresh hotfuncs data for logdevice-server-logdeviced (via Dataswarm)
D17261989 Remove the default value of callbacks in VersionedConfigStores
Reviewed By: artemg
fbshipit-source-id: 9b6ce0faea8a30122a94a7bb2f2d665edbbf50991 parent 9204ecf commit 3494e39
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
| 11 | + | |
0 commit comments