{"id":3167,"date":"2024-03-16T19:29:33","date_gmt":"2024-03-16T11:29:33","guid":{"rendered":"https:\/\/www.yaoge123.com\/blog\/?p=3167"},"modified":"2024-03-16T19:29:33","modified_gmt":"2024-03-16T11:29:33","slug":"%e4%b8%bavsan%e5%90%af%e7%94%a8rdma","status":"publish","type":"post","link":"https:\/\/www.yaoge123.com\/blog\/archives\/3167","title":{"rendered":"\u4e3avSAN\u542f\u7528RDMA"},"content":{"rendered":"\n<p>\u4ea4\u6362\u673a\u4e0a\u542f\u7528LLDP\u3001PFC\u548cDCBx\uff0cPFC\u4f18\u5148\u7ea7\u4e3a3\uff08\u9ed8\u8ba4\u503c\uff09\uff0cDCBx\u7684\u6807\u51c6\u4e3aIEEE\uff08\u9ed8\u8ba4\u503c\uff09\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>dcb pfc\r\n#\r\ninterface 25GE1\/0\/10\r\n description Host-01\r\n port link-type trunk\r\n undo port trunk allow-pass vlan 1\r\n port trunk allow-pass vlan 125\r\n stp edged-port enable\r\n lldp tlv-enable dcbx\r\n dcb pfc enable mode manual\r\n#\r\ninterface 25GE1\/0\/12\r\n description Host-02\r\n port link-type trunk\r\n undo port trunk allow-pass vlan 1\r\n port trunk allow-pass vlan 125\r\n stp edged-port enable\r\n lldp tlv-enable dcbx\r\n dcb pfc enable mode manual\r\n#\r\nlldp enable\n#<\/code><\/pre>\n\n\n\n<p>\u901a\u8fc7\u4e3b\u673a-\u914d\u7f6e-\u7269\u7406\u9002\u914d\u5668\u786e\u8ba4\u7528\u4e8evSAN\u7f51\u5361\u7684\u8bbe\u5907\u4f4d\u7f6e\u548c\u7aef\u53e3\uff0c\u4ee5\u4e0b\u793a\u4f8b\u4e2d\u662f0000:8a:00\u7684\u7aef\u53e32(vmnic3)\u548c0000:8b:00\u7684\u7aef\u53e31(vmnic4)\uff0c\u9996\u5148\u67e5\u770b\u4e00\u4e0bLLDP\u548cDCBx\u7684\u76f8\u5173\u914d\u7f6e\u3002\u9700\u8981\u5148\u5b89\u88c5MFT\u624d\u80fd\u4f7f\u7528\u76f8\u5173\u547d\u4ee4\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8a:00.1 query|grep -iE \"dcb|lldp\"\r\n        LLDP_NB_DCBX_P1                             False(0)            \r\n        LLDP_NB_RX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_DCBX_P2                             False(0)            \r\n        LLDP_NB_RX_MODE_P2                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P2                          OFF(0)              \r\n        DCBX_IEEE_P1                                True(1)             \r\n        DCBX_CEE_P1                                 True(1)             \r\n        DCBX_WILLING_P1                             True(1)             \r\n        DCBX_IEEE_P2                                True(1)             \r\n        DCBX_CEE_P2                                 True(1)             \r\n        DCBX_WILLING_P2                             True(1)             \r\n\n&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8b:00.0 query|grep -iE \"dcb|lldp\"\r\n        LLDP_NB_DCBX_P1                             False(0)            \r\n        LLDP_NB_RX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_DCBX_P2                             False(0)            \r\n        LLDP_NB_RX_MODE_P2                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P2                          OFF(0)              \r\n        DCBX_IEEE_P1                                True(1)             \r\n        DCBX_CEE_P1                                 True(1)             \r\n        DCBX_WILLING_P1                             True(1)             \r\n        DCBX_IEEE_P2                                True(1)             \r\n        DCBX_CEE_P2                                 True(1)             \r\n        DCBX_WILLING_P2                             True(1)       <\/code><\/pre>\n\n\n\n<p>\u53d1\u73b0LLDP\u6ca1\u6709\u542f\u52a8\uff0c\u542f\u7528LLDP\u548cDCBx\uff0cDCBx IEEE\u5df2\u542f\u7528\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8a:00.1 set LLDP_NB_DCBX_P2=1 LLDP_NB_RX_MODE_P2=2 LLDP_NB_TX_MODE_P2=2 DCBX_WILLING_P2=1 DCBX_IEEE_P2=1 \n\nDevice #1:\n----------\n\nDevice type:        ConnectX5           \nName:               MCX512A-ACU_Ax_Bx   \nDescription:        ConnectX-5 EN network interface card; 10\/25GbE dual-port SFP28; PCIe3.0 x8; UEFI Enabled (x86\/ARM)\nDevice:             0000:8a:00.1        \n\nConfigurations:                                          Next Boot       New\n        LLDP_NB_DCBX_P2                             False(0)             True(1)             \n        LLDP_NB_RX_MODE_P2                          OFF(0)               ALL(2)              \n        LLDP_NB_TX_MODE_P2                          OFF(0)               ALL(2)              \n        DCBX_WILLING_P2                             True(1)              True(1)             \n        DCBX_IEEE_P2                                True(1)              True(1)             \n\n Apply new Configuration? (y\/n) &#91;n] : y\nApplying... Done!\n-I- Please reboot machine to load new configurations.\n\n&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8b:00.0 set LLDP_NB_DCBX_P1=1 LLDP_NB_RX_MODE_P1=2 LLDP_NB_TX_MODE_P1=2 DCBX_WILLING_P1=1 DCBX_IEEE_P1=1 \n\nDevice #1:\n----------\n\nDevice type:        ConnectX5           \nName:               MCX512A-ACU_Ax_Bx   \nDescription:        ConnectX-5 EN network interface card; 10\/25GbE dual-port SFP28; PCIe3.0 x8; UEFI Enabled (x86\/ARM)\nDevice:             0000:8b:00.0        \n\nConfigurations:                                          Next Boot       New\n        LLDP_NB_DCBX_P1                             False(0)             True(1)             \n        LLDP_NB_RX_MODE_P1                          OFF(0)               ALL(2)              \n        LLDP_NB_TX_MODE_P1                          OFF(0)               ALL(2)              \n        DCBX_WILLING_P1                             True(1)              True(1)             \n        DCBX_IEEE_P1                                True(1)              True(1)             \n\n Apply new Configuration? (y\/n) &#91;n] : y\nApplying... Done!\n-I- Please reboot machine to load new configurations.\n<\/code><\/pre>\n\n\n\n<p>\u91cd\u542f\u540e\u67e5\u770b\u7f51\u5361\u5f53\u524d\u914d\u7f6e\uff0c\u786e\u8ba4LLDP\u548cDCBx\u5747\u5df2\u542f\u7528<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8a:00.1 query|grep -iE \"dcb|lldp\"\r\n        LLDP_NB_DCBX_P1                             False(0)            \r\n        LLDP_NB_RX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P1                          OFF(0)              \r\n        LLDP_NB_DCBX_P2                             True(1)             \r\n        LLDP_NB_RX_MODE_P2                          ALL(2)              \r\n        LLDP_NB_TX_MODE_P2                          ALL(2)              \r\n        DCBX_IEEE_P1                                True(1)             \r\n        DCBX_CEE_P1                                 True(1)             \r\n        DCBX_WILLING_P1                             True(1)             \r\n        DCBX_IEEE_P2                                True(1)             \r\n        DCBX_CEE_P2                                 True(1)             \r\n        DCBX_WILLING_P2                             True(1)             \r\n&#91;root@yaoge123:~] \/opt\/mellanox\/bin\/mlxconfig -d 0000:8b:00.0 query|grep -iE \"dcb|lldp\"\r\n        LLDP_NB_DCBX_P1                             True(1)             \r\n        LLDP_NB_RX_MODE_P1                          ALL(2)              \r\n        LLDP_NB_TX_MODE_P1                          ALL(2)              \r\n        LLDP_NB_DCBX_P2                             False(0)            \r\n        LLDP_NB_RX_MODE_P2                          OFF(0)              \r\n        LLDP_NB_TX_MODE_P2                          OFF(0)              \r\n        DCBX_IEEE_P1                                True(1)             \r\n        DCBX_CEE_P1                                 True(1)             \r\n        DCBX_WILLING_P1                             True(1)             \r\n        DCBX_IEEE_P2                                True(1)             \r\n        DCBX_CEE_P2                                 True(1)             \r\n        DCBX_WILLING_P2                             True(1)             \r\n<\/code><\/pre>\n\n\n\n<p>\u67e5\u770b\u7f51\u5361\u7684DCB\u72b6\u6001\uff0c\u6a21\u5f0f\u4e3aIEEE\uff0cPFC\u5df2\u542f\u7528\u4e14\u4f18\u5148\u7ea7\u4e3a3\uff080 0 0 1 0 0 0 0\uff09<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@2288Hv6-05:~] esxcli network nic dcb status get -n vmnic3\r\n   Nic Name: vmnic3\r\n   Mode: 3 - IEEE Mode\r\n   Enabled: true\r\n   Capabilities: \r\n         Priority Group: true\r\n         Priority Flow Control: true\r\n         PG Traffic Classes: 8\r\n         PFC Traffic Classes: 8\r\n   PFC Enabled: true\r\n   PFC Configuration: 0 0 0 1 0 0 0 0\r\n   IEEE ETS Configuration: \r\n         Willing Bit In ETS Config TLV: 1\r\n         Supported Capacity: 8\r\n         Credit Based Shaper ETS Algorithm Supported: 0x0\r\n         TX Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         RX Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         TSA Assignment Table Per TC: 2 2 2 2 2 2 2 2\r\n         Priority Assignment Per TC: 1 0 2 3 4 5 6 7\r\n         Recommended TC Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         Recommended TSA Assignment Per TC: 2 2 2 2 2 2 2 2\r\n         Recommended Priority Assignment Per TC: 1 0 2 3 4 5 6 7\r\n   IEEE PFC Configuration: \r\n         Number Of Traffic Classes: 8\r\n         PFC Configuration: 0 0 0 1 0 0 0 0\r\n         Macsec Bypass Capability Is Enabled: 0\r\n         Round Trip Propagation Delay Of Link: 0\r\n         Sent PFC Frames: 0 0 0 0 0 0 0 0\r\n         Received PFC Frames: 0 0 0 0 0 0 0 0\r\n   DCB Apps: \r\n&#91;root@2288Hv6-05:~] esxcli network nic dcb status get -n vmnic4\r\n   Nic Name: vmnic4\r\n   Mode: 3 - IEEE Mode\r\n   Enabled: true\r\n   Capabilities: \r\n         Priority Group: true\r\n         Priority Flow Control: true\r\n         PG Traffic Classes: 8\r\n         PFC Traffic Classes: 8\r\n   PFC Enabled: true\r\n   PFC Configuration: 0 0 0 1 0 0 0 0\r\n   IEEE ETS Configuration: \r\n         Willing Bit In ETS Config TLV: 1\r\n         Supported Capacity: 8\r\n         Credit Based Shaper ETS Algorithm Supported: 0x0\r\n         TX Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         RX Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         TSA Assignment Table Per TC: 2 2 2 2 2 2 2 2\r\n         Priority Assignment Per TC: 1 0 2 3 4 5 6 7\r\n         Recommended TC Bandwidth Per TC: 13 13 13 13 12 12 12 12\r\n         Recommended TSA Assignment Per TC: 2 2 2 2 2 2 2 2\r\n         Recommended Priority Assignment Per TC: 1 0 2 3 4 5 6 7\r\n   IEEE PFC Configuration: \r\n         Number Of Traffic Classes: 8\r\n         PFC Configuration: 0 0 0 1 0 0 0 0\r\n         Macsec Bypass Capability Is Enabled: 0\r\n         Round Trip Propagation Delay Of Link: 0\r\n         Sent PFC Frames: 0 0 0 0 0 0 0 0\r\n         Received PFC Frames: 0 0 0 0 0 0 0 0\r\n   DCB Apps: \r\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>\u4ea4\u6362\u673a\u4e0a\u542f\u7528LLDP\u3001PFC\u548cDCBx\uff0cPFC\u4f18\u5148\u7ea7\u4e3a3\uff08\u9ed8\u8ba4\u503c\uff09\uff0cDCBx\u7684\u6807\u51c6\u4e3aIEEE\uff08\u9ed8\u8ba4\u503c\uff09\u3002 \u901a\u8fc7 [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[8,10],"tags":[],"class_list":["post-3167","post","type-post","status-publish","format-standard","hentry","category-network","category-vmware-computer-2"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paOwEq-P5","_links":{"self":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3167","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/comments?post=3167"}],"version-history":[{"count":4,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3167\/revisions"}],"predecessor-version":[{"id":3171,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3167\/revisions\/3171"}],"wp:attachment":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/media?parent=3167"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/categories?post=3167"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/tags?post=3167"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}