{"id":3129,"date":"2024-02-07T16:57:42","date_gmt":"2024-02-07T08:57:42","guid":{"rendered":"https:\/\/www.yaoge123.com\/blog\/?p=3129"},"modified":"2024-02-08T04:13:14","modified_gmt":"2024-02-07T20:13:14","slug":"nvme-over-roce-%e7%bd%91%e7%bb%9c%e9%85%8d%e7%bd%ae","status":"publish","type":"post","link":"https:\/\/www.yaoge123.com\/blog\/archives\/3129","title":{"rendered":"NVMe over RoCE \u7f51\u7edc\u914d\u7f6e"},"content":{"rendered":"\n\n\n<p>NVMe over RoCE \u8981\u6c42\u65e0\u635f\u7f51\u7edc\uff0c\u56e0\u6b64\u4ea4\u6362\u673a\u548c\u4e3b\u673a\u7f51\u5361\u5747\u9700\u8981\u4e00\u4e9b\u914d\u7f6e\u6765\u4fdd\u8bc1\u65e0\u635f\u3002<\/p>\n<p>QoS\u6807\u8bb0\u91c7\u7528PCP\u4e3a\u4f8b\uff0cPCP\u662f\u5728VLAN\u6807\u7b7e\u4e2d\u6807\u8bb0\u4f18\u5148\u7ea7\uff0c\u6240\u4ee5\u6d41\u91cf\u5fc5\u987b\u5728VLAN\u4e2d\uff0cDorado \u4e0d\u662f\u6240\u6709\u7684\u524d\u7aef\u63a5\u53e3\u5361\u90fd\u652f\u6301DSCP\u3002<\/p>\n<ul>\n<li>\u4ea4\u6362\u673a\u542f\u7528PFC\u4f18\u5148\u7ea73\uff0c1\u5206\u949f\u53d1\u751f\u6b7b\u950120\u6b21\uff0c\u5173\u95ed\u7aef\u53e3PFC<\/li>\n<li>\u4ea4\u6362\u673a\u914d\u7f6ePFC\u6b7b\u9501\u68c0\u6d4b\uff0c\u68c0\u6d4b\u65f6\u95f41000ms\uff0c\u6062\u590d\u65f6\u95f41500ms<\/li>\n<li>\u4ea4\u6362\u673a\u4e0e\u5b58\u50a8\u548c\u670d\u52a1\u5668\u94fe\u63a5\u7528\u4e8eNVMe over RoCE\u7684\u6240\u6709\u7aef\u53e3\u914d\u7f6ePFC\u3001VLAN\u548cMTU<\/li>\n<li>\u4e24\u53f0\u4ea4\u6362\u673a\u4f7f\u7528\u4e0d\u540c\u7684VLAN\uff0c\u9632\u6b62\u51fa\u73b0\u8de8\u4ea4\u6362\u673a\u7684\u6d41\u91cf<\/li>\n<li>\u4ea4\u6362\u673a\u5728\u961f\u52173\u542f\u7528AI-ECN\u5e76\u52a0\u8f7d\u96c6\u4e2d\u5b58\u50a8\u6a21\u578b<\/li>\n<li>\u4ea4\u6362\u673a\u542f\u7528LLDP\uff08iNOF\u7684\u57fa\u672c\u8981\u6c42\uff09<\/li>\n<li>\u4ea4\u6362\u673a\u542f\u7528\u7b80\u5355\u7684iNOF\uff08\u9ed8\u8ba4\u57df\u3001\u65e0\u53cd\u5c04\u5668\uff09<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>dcb pfc nof\n priority 3 turn-off threshold 20\n#\ndcb pfc deadlock-detect timer 1000\ndcb pfc deadlock-recovery timer 1500\n#\ninterface 25GE1\/0\/1\n description Dorado-A\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#               \ninterface 25GE1\/0\/2\n description Dorado-A\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#\ninterface 25GE1\/0\/3\n description Dorado-B\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#               \ninterface 25GE1\/0\/4\n description Dorado-B\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#\ninterface 25GE1\/0\/9\n description Host-01\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#\ninterface 25GE1\/0\/11\n description Host-02\n port link-type trunk\n port trunk allow-pass vlan 123\n stp edged-port enable\n dcb pfc enable nof mode manual\n jumboframe enable 5500\n#\nlldp enable\n#\nai-service\n #\n ai-ecn\n  ai-ecn enable\n  assign queue 3 model ai_ecn_centralizedstorage\n #\n inof\n#\nreturn<\/code><\/pre>\n\n\n\n<ul>\n<li>\u4e3a\u786e\u4fdd RoCE \u6d41\u91cf\u65e0\u635f\uff0c\u5728 ESXi \u4e3b\u673a\u4e2d\u5c06 PFC \u4f18\u5148\u7ea7\u503c\u914d\u7f6e\u4e3a 3<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@yaoge123:~] esxcli system module parameters set -m nmlx5_core -p \"pfctx=0x08 pfcrx=0x08\"<\/code><\/pre>\n\n\n\n<ul>\n<li>\u91cd\u542f\u540e\u67e5\u770b\uff0cpfctx\u548cpfcrx\u503c\u5747\u4e3a0x08<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;root@yaoge123:~] esxcli system module parameters list -m nmlx5_core | grep pfc\npfcrx                int            0x08   Priority based Flow Control policy on RX.\n   Notes: Must be equal to pfctx.\npfctx                int            0x08   Priority based Flow Control policy on TX.\n   Notes: Must be equal to pfcrx.\n\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>NVMe over RoCE \u8981\u6c42\u65e0\u635f\u7f51\u7edc\uff0c\u56e0\u6b64\u4ea4\u6362\u673a\u548c\u4e3b\u673a\u7f51\u5361\u5747\u9700\u8981\u4e00\u4e9b\u914d\u7f6e\u6765\u4fdd\u8bc1\u65e0\u635f\u3002 QoS\u6807\u8bb0\u91c7\u7528PC [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[8],"tags":[],"class_list":["post-3129","post","type-post","status-publish","format-standard","hentry","category-network"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paOwEq-Ot","_links":{"self":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3129","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/comments?post=3129"}],"version-history":[{"count":5,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3129\/revisions"}],"predecessor-version":[{"id":3135,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/posts\/3129\/revisions\/3135"}],"wp:attachment":[{"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/media?parent=3129"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/categories?post=3129"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.yaoge123.com\/blog\/wp-json\/wp\/v2\/tags?post=3129"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}