Skip to content

Niu/multiprovider merge#17709

Open
NiuYawei wants to merge 159 commits intomasterfrom
niu/multiprovider-merge
Open

Niu/multiprovider merge#17709
NiuYawei wants to merge 159 commits intomasterfrom
niu/multiprovider-merge

Conversation

@NiuYawei
Copy link
Contributor

Steps for the author:

  • Commit message follows the guidelines.
  • Appropriate Features or Test-tag pragmas were used.
  • Appropriate Functional Test Stages were run.
  • At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • Gatekeeper requested (daos-gatekeeper added as a reviewer).

kjacque and others added 30 commits March 9, 2022 08:54
- Add secondary providers to internal DAOS gRPC/dRPC messages.
- Add secondary providers and URIs to member database.
- Parse multiple providers and their corresponding interfaces/ports
  from the yaml config file.

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
This patch allows the agent to support secondary providers if any
are returned by the server in the GetAttachInfo call.

The client requires no knowledge of primary and secondary providers.
The agent decides which provider to return based on its config file.

- Add support for secondary providers to GetAttachInfo messages.
- Add optional "provider" parameter for the agent configuration. If
  specified the agent will search secondary providers for the
  requested provider, and return the appropriate network info to
  the client as if it was the primary provider.

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
* DAOS-9928 srv: xstreams for secondary cart contexts

This patch adjusted xstream starting and core assignment code to
support xstreams for secondary Cart contexts. It also have two minor
fixes to current code:

- Oversubscribe doesn't work in NUMA mode, fallthrough to legacy mode
  when oversubscribe is specified;
- 'Core offset' should be ignored when NUMA mode is used;

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Use a comma to separate the multiple provider list instead of a
space. This matches up with what CART is expecting.

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
The new parameter in the server config, secondary_provider_endpoints,
defines the number of secondary CART contexts to be created by
each engine for each secondary fabric provider. The primary
provider is not affected.

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
- Check all the fabric interfaces in the server.

Test-tag: pr daily

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
* DAOS-9623 agent: Let client specify desired fabric iface

If the client has an OFI_INTERFACE/OFI_DOMAIN specified, the agent
should select the GetAttachInfo payload for the provider that matches
their choice.

- Include OFI_INTERFACE/OFI_DOMAIN in client GetAttachInfo request.
- If the requested interface/domain doesn't exist in the system,
  the primary provider is used.
- The client requested interface and domain will be used even if
  not detected or they don't seem to support the configured provider.
  The mismatch will be logged as an error to make errors with the
  env variables easier to debug.

Features: control

Signed-off-by: Kris Jacque <kristin.jacque@intel.com>
Cart level changes for multiprovider support, phase1. No bulk support yet.

Signed-off-by: Alexander A Oganezov <alexander.a.oganezov@intel.com>
@NiuYawei NiuYawei requested review from a team as code owners March 16, 2026 08:27
@github-actions
Copy link

Errors are component not formatted correctly,Ticket number prefix incorrect,PR title is malformatted. See https://daosio.atlassian.net/wiki/spaces/DC/pages/11133911069/Commit+Comments,Unable to load ticket data
https://daosio.atlassian.net/browse/Niu/multiprovider

@NiuYawei NiuYawei requested a review from kjacque March 16, 2026 08:28
@daosbuild3
Copy link
Collaborator

Copy link
Contributor

@tanabarr tanabarr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Go changes LGTM. It looks like some of the Copyright and compiled protobuf changes may not be strictly necessary but this isn't a big deal.

Copy link
Contributor

@kjacque kjacque left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not ready to merge into master yet

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

5 participants