Repository navigation
Add per-channel RDMA SL and Traffic Class configuration - #93
Draft
Spicy-cream wants to merge 1 commit into
Draft
Spicy-cream wants to merge 1 commit into
Spicy-cream wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
当前 RDMA QP 的 SL 和 Traffic Class 固定为 0,业务无法通过 Channel 选择网络服务等级。本 PR 增加业务级 RDMA QoS 配置,并将配置应用到 QP 的 RTR 地址属性。
新增 RdmaQosOptions:service_level 范围为 0–15,traffic_class 为完整的 8 位 GRH/IP Traffic Class,范围为 0–255,默认均为 0。ChannelOptions.rdma_qos 控制请求发送方向,ServerOptions.rdma_qos 控制响应发送方向。客户端和服务端分别配置各自的发送策略,V2/V3 握手沿用现有格式。
SL 和 Traffic Class 纳入 Channel 连接签名。相同配置可以共享连接,不同配置使用独立连接和 QP;默认 TCP 与 RDMA 连接也按传输模式区分。配置传递到直连、服务发现、连接池、短连接和服务端 accept 路径,并在 QP 重建时重新应用。连接调试信息显示 rdma_sl 和 rdma_traffic_class。
中文及英文文档增加配置方法,rdma_performance client/server 增加 rdma_sl、rdma_traffic_class 命令行参数。SL 的调度待遇由网络侧映射决定,RoCE 部署结合网卡和交换机 PCP/DSCP 策略配置。
WSL Ubuntu 下 WITH_RDMA=ON 生产静态库与性能示例构建通过。Channel 测试 87 项、RDMA mock 测试 95 项通过,共 182 项,其中新增 5 项,覆盖范围校验、连接共享与隔离、子连接和服务发现继承、服务端重启,以及客户端/服务端 QP RTR 属性。性能示例 TCP 烟测及越界 SL 校验通过。RDMA 实机报文标记与竞争流量性能测试待验证。