From patchwork Tue Jun 26 12:39:24 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yongseok Koh X-Patchwork-Id: 41570 X-Patchwork-Delegate: shahafs@mellanox.com Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 7C1FB1B5A3; Tue, 26 Jun 2018 14:40:11 +0200 (CEST) Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70048.outbound.protection.outlook.com [40.107.7.48]) by dpdk.org (Postfix) with ESMTP id 03ED21B581 for ; Tue, 26 Jun 2018 14:40:02 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nNmJ/JTZve/gbkDt6yMSoF6H/bg5Jh+AIwIa7FqiSQI=; b=SC0LAGIXAq4ereVAhJXl70EWVofh+5dzMwR93KGQGetZTF5enrrZSbAubyaKlFU3IqxW2rt2jcefYjAUqmFjPfKwUl7IDUJE2XKp1C9QA1UKkeG6hoJEY4g6wnmmsZndB4soQIJu2NPoRxRF7wWoS5uuZ0IHy+xPbNNkIo8kQC8= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=yskoh@mellanox.com; Received: from mellanox.com (209.116.155.178) by HE1PR0501MB2043.eurprd05.prod.outlook.com (2603:10a6:3:35::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.884.23; Tue, 26 Jun 2018 12:39:58 +0000 From: Yongseok Koh To: adrien.mazarguil@6wind.com, nelio.laranjeiro@6wind.com Cc: dev@dpdk.org, shahafs@mellanox.com, Yongseok Koh Date: Tue, 26 Jun 2018 05:39:24 -0700 Message-Id: <20180626123925.37439-5-yskoh@mellanox.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20180626123925.37439-1-yskoh@mellanox.com> References: <20180626123925.37439-1-yskoh@mellanox.com> MIME-Version: 1.0 X-Originating-IP: [209.116.155.178] X-ClientProxiedBy: CO1PR15CA0100.namprd15.prod.outlook.com (2603:10b6:101:21::20) To HE1PR0501MB2043.eurprd05.prod.outlook.com (2603:10a6:3:35::21) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: c3a490cd-554a-4fd8-20ca-08d5db61ee91 X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(8989117)(4534165)(4627221)(201703031133081)(201702281549075)(8990107)(5600026)(711020)(48565401081)(2017052603328)(7153060)(7193020); SRVR:HE1PR0501MB2043; X-Microsoft-Exchange-Diagnostics: 1; HE1PR0501MB2043; 3:yhhm3YQeyszZ12dWXdxQ28PnNhdrQGYMJJZNdnPQEfa8jz0bTI+zd32XUSAshKxhkNbsXP74Nznvqshr56Ir5B8XQ6JFhLu/SDroJT8Pbw2mRl1wi94oB7Qn7mvPmQzyisbWT4WCQBlJlKj3mwSU8339Kw/7vF1eSIJW+xQhxTBbn36hG1Zd0nVsIHlERhV33aeJWlnMGpsFW0fEv4lm7QQ0Rp2j6Y8nYYCeQZhbOUFn2DXbhhiaIPz/D0G9PJmX; 25:Ojz8m1FokFnUu8Xp9EDZ1RruB7CCAGRLJ/7mJJPfo8EYzXzJ4m04QafV++jidt94hGqSqWOacDobLf7ERBORriH/i4vPuGlTqcC4h4F2di7CxvOM5xnNRpMgxQj8mLHO3LT2eEBl3eF5+knFOPZWvs3GyQcaqHzG04mcaKEPiSFHAWXX9Cm5N+UVv9xFSagNZS2E40aLcXqtsQUVRtEQpI9J9mtd0xHvUTN8rkcCnb+avjV73yHOn5XFg+DBlxg4K+8lfjiWvp/guwVv/SFt9K2FqAiRkbO5/SFWIq9ADqQxBLX1cXymM/Kk8Nvtaj9eyDab9omJCYIDeSCYkXm8Eg==; 31:Z48cC7qx0qNcHGc4hYxQv7mKRVkYwNsA0H5GdZoPeuAo4F34rKDbhPzs2hZB1N9CmUbWodidJpdECiCAEc5JWneNYgbc8+OhS7l/SHBFbH76VRFd1IEuBQvYPgXrVM2Zzq3/tLi6azDFnd4z7HkTqCixzEh5yWiY8nlIhk1vN4kK3lEKjrYjff2dHxqTWpxeUIPsmurynx24fG9i6u6T3vF5G9DIlaK6Pp432imHld8= X-MS-TrafficTypeDiagnostic: HE1PR0501MB2043: X-LD-Processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; HE1PR0501MB2043; 20:AWSAdKvGFhkUbIe26ZpqHpo5mIZJW3VVZm8RLa3EwJZ3iHX19y7p3M4x/n2LdfQrjoB7C5nTjDEcoU7F+QLhEjx4t5ayzrcKUm37BkM/vgGhBx8mFxyDa/sHg8f0/JABlRIOI7IbuwHHxpJi2icq7WYxtUtFzHk1KkQrK8+rbn35IZoZANy2SVArMMJrZUDki+4CUYPqqZaeEJWUCT0eXlEBeYaGLx0k3snV8aZpWYVuK7fYMWVVcXVhFMPQpnpKPTrInKz94AClp7XZuh+J8Om2b+QC3juIdVZwBLlKrqEUu2qmY4CvFeHvAXJ5Of8X1IPLzkDTnb3T26Lj61D98oDSGwut0U/pCnNlrF8Xu+95ZTsHHuvwbv7TkkJ7mXYufkZp/9j2lgHW3nZx3jQ9AHwDT5rfw001hjmh/x157BRrb5qo68ncyxAOn94l4pAvd6So5PGULLr1ooKDjVLt99h2f1TZTW2BchTMcJiiQnBEA9S94rRPPhZ5TnF7T+06; 4:DVx6lVR3j/SqaGrrzoZsEIzVbpUmnb2bjkjKQEKHEGC7PotVFbxe14WvYTPYYc25HxCF8EZcfD2/QWkRXv5hwgjv2dnDWpCYoyj5Rq9GaPe4upKa/qfB0oglGL/NuxQGT+jiZfw3HJQ852Gp/J5aZ+amDIVJKi/faAXDNOiT/W0AruEPuXjUVTPTTnry8pDn+KgFeDLZ+iVMCZuh/WZx3z13BeVGemQ9jVcsC01IWL5OZdjEgMntGxdYDAiQm/dCBTwgvfjre5vaZxtsT7zuKAj3vEoVaqt/bBIDW7pWAUlmsLolsitsIq3yYoJLdzU/ X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(788757137089); X-MS-Exchange-SenderADCheck: 1 X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(10201501046)(3231254)(944501410)(52105095)(6055026)(149027)(150027)(6041310)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(20161123558120)(20161123562045)(6072148)(201708071742011)(7699016); SRVR:HE1PR0501MB2043; BCL:0; PCL:0; RULEID:; SRVR:HE1PR0501MB2043; X-Forefront-PRVS: 071518EF63 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(396003)(346002)(136003)(39860400002)(376002)(366004)(189003)(199004)(66066001)(7736002)(956004)(478600001)(386003)(8676002)(48376002)(50466002)(486006)(107886003)(86362001)(16586007)(47776003)(316002)(186003)(68736007)(6666003)(4326008)(69596002)(25786009)(2616005)(11346002)(305945005)(476003)(446003)(81166006)(81156014)(21086003)(55016002)(2906002)(53936002)(76176011)(51416003)(97736004)(26005)(1076002)(105586002)(7696005)(5660300001)(36756003)(50226002)(3846002)(52116002)(6116002)(106356001)(8936002)(16526019)(14444005); DIR:OUT; SFP:1101; SCL:1; SRVR:HE1PR0501MB2043; H:mellanox.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; Received-SPF: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; HE1PR0501MB2043; 23:RG7RFGlh2YkvE5klbewSP+f/Zne7UVQd9b8+sa0?= +nL8RP2FDFLGWAki+SNtPtTVegmPLhI78lNPQTAcNQu1X2v5cApHAxGugDsQJ4x+AvFTpImRbTaus5BqjeMxRYGFuSMVDgtNj+YjN5PQS1fnwExjWFa+NZsvQRCxz/Q1cQxHpmS0Tp3gzd7gzaNNPF+J4tYQcyOJkgHIEBsa6YvySlGgEXDTp5/0Z/dwLHoDbFuql4yiUl0le5jWJPb36rHYw+dVk4A7p7QLcg7/cj7/WLLF/lx5OB4i0w90Ps6nuOk4xjEPpPtQgdE2k3Dt3Hmt8mSAco/S8Hs/iNrypyhIamQ8vvrCcTmQtZeoxoEu9xbcbsMPVZHcrSTYsvw5EFcOW/W5ZL2i/4dd2JS2+2E1w9tapHDoG+5vG89eNuCSqW8GVD8H5SmXT+W3k7FEZRCZimMLEgKFpoVwiuGjWcnwx03Zg+FdzgD90zhSEArIxZzBspGIuSrYgHEQb8bufw9D03WiHbWbq6yWAqR3KlUD3jYeDyLjdp/0TobcuLLvzsI0pOWjjji80/+k3cBssiyGryviJ3wGdDcNY8QCjefv7PhcBYADyz+vhYbxFqkaktGs+VQCJjdV4rRHHuhN9vioavOemxPqXzhn12lPocaqbS4/1O78N7kdx0+C17B6z1uOWWaWzvi/p4Zyqj/5Pp0jaB1ZtGYb7UgzJSWRwRHbzG2ueJF7Cc3xUmMNYfIbW2VLkmlQ8Jd0owU0WQ7hy+L6uKsuaw1SptxSGQm3/tzCkbKqxk/Woq7UWUDzHSUB7Kvl0P3rJUVbSjxtIYVjsJBdX+5ZQDRbpaS23RdMlRdtWYDs2wfNGtYETcfjdqhMOwtG2SkImrJoInkIgB7+dCr2k7DF1fJXvxupIlt4koQYbDesdgC1S3nyxveodYR3VrbL6F6wywxwDkVSh4DUQOudnFIH5iBJi2rdakUpntaoMC+42+3ApK930IWCjSi39+BZqSE7ao3e1QHeiqS1poUE/mSQcByanXusPbg2rXXMVrDkTNBc/dRMD/cmUklD3+GQU2m15+1Fm8puAN4gZZsK9AICS7NZj2VgfeSrCZtvSRZt9IosMAxwGodLUdxGFNCd1MOQXL3alQFth+TAIXl1h8sGHHNdM9X0U1dxQLzgIcESIx7q/YgNwEIIemfGALA6skmSPRzr4zB/BzqpheJGyXkfNzac58ajKS1XDucF5lQ== X-Microsoft-Antispam-Message-Info: gk2j1zptEZaEkRtC6MD1UC8bcGp/aGIckQqZUsUC0yzaF/MwKkBHuFNg96QqGYS6paJfY35OjzzuCl+9i5pVKc7NkSyG5V1fx/2DgUIt4ekFE6F/k+lJ/4c0LmII7Tph716hSHfOilJlbHw1W3NTkAN+rpNJ2nNDd3vMdE7uiWd29fSltGVajBFAltN73JErzb5eu+yVZsW5v9NrhU/E8ON0b123krlCyb0ZWKSAXwPlUMlpkXeoYvjNPRARW21RXQBB4Tp73glrLkCsxqF/jv4MmkyZFg41R2JTgXbs7Whu/LHS8MUuTnC4RS3rfEZ6rTQdylNf9zdineK0WIfYxNfc/LOYAKQuBnT+WLWK0h0= X-Microsoft-Exchange-Diagnostics: 1; HE1PR0501MB2043; 6:25n4cPsfU5/ic/DKP05Pp1z0jKqORmisaGlP47CnDoXCxhdrkRntY5Jkdu4d69ffXSyZfmWdVXKCAi/ipfRsc20v0kdr64tl9iD5yLuuI8bqVf4pR8u1bfguGNDjglNnN4S6/wTMtzYf7G2BKwf/s4jp4vjg718Byt50c6sxIYLbdBgfrAUF9cm7hXN1+QMl9I5qlBpgjR6VjUKBYk11ejw0/vyfAO9TdhEScD+kIGutzwut9LCW9IIHCDJNhcWUZmPyScceYmtNq1d+dyjiFShkxjyMX0gHEd4HXahBcjkpz4/mN6IJKM6kWb+IELtOs814U8iRPxkGZsInuqF4SC0qRUqFN3d1ehH++6URw/B9MCQFjGjhsa5470Gy2C0cXgs+UG7nuqSm/DOrpXegPVN+I5sCIL+fmmmlhdqAt4imrHU0BK30BG2mzrUbYK03XTWBKgI77oTJcWa4Mp/7Cg==; 5:IJX3bQcS/xYegz66YM9OYjYKmQ7JIgdao9I+TIHohngyXP8ZQ1EKThzM7vgDAJBuvZbPWj2/5MOySDvhcuiN/CaPug8chMsI+YMnnWYt6HCBIgBBvfW/9OvLTDP1/a4B0LHC5sq2uOvMDnnXxWf/5yY4i7+kYgCp1t71aWoDqpg=; 24:Rn9hSwkiouHS7JDfhdlcYSMTcF2mrV4dEscLjMS6NtmjER0twAJF9loTgpdEqel4Yi+YTJL/skR5cwvWwiT7omCTAUQrU0+ed1P+4E2+ZAk= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; HE1PR0501MB2043; 7:6Q9GfCG3JKHa7X3okAxkaKa2yAEiPeO14Y0ZiraRIqTFEOJ+vbjKaAHjuyaiYeh3/H5x00OgTcDLo0mZ2eEkavBTPbuKd4y1SHxdW1amlTTrzPmFQ/x/96LMZ5huM/kR6INDWPjRkEcUK1t2dLMxHnpX6I9bS8Bh/EEP5jGIzUksDtoHWpEX4NEtLnvHbEJ8cHpDdWT+ZJetSy75nUlmRg57qKlpYHDy+g/zgC5vWD8loCprFC719JMODU+imdkz X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Jun 2018 12:39:58.9372 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: c3a490cd-554a-4fd8-20ca-08d5db61ee91 X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0501MB2043 Subject: [dpdk-dev] [PATCH v2 4/5] net/mlx5: use stride index in Rx completion entry X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Multi-Packet Receive Queue is to receive multiple packets on a single large buffer. The number of consumed strides in CQE is accumulated to keep track of the current stride index. However, it is safer to directly use stride index in CQE to avoid out-of-order situation which can possibly be caused by introducing LRO in the future. If Rx CQE compression is enabled, HW can be configured to store the stride index in a mini-CQE but this will need newer version of library/driver. Therefore, since this change, MPRQ is only supported with the newer library/driver and Rx hash result is not supported if MPRQ is enabled along with Rx CQE compression. Signed-off-by: Yongseok Koh Acked-by: Shahaf Shuler --- doc/guides/nics/mlx5.rst | 4 ++++ drivers/net/mlx5/Makefile | 2 +- drivers/net/mlx5/mlx5_rxq.c | 8 +++++++- drivers/net/mlx5/mlx5_rxtx.c | 41 +++++++++++++++++++++++------------------ drivers/net/mlx5/mlx5_rxtx.h | 2 +- 5 files changed, 36 insertions(+), 21 deletions(-) diff --git a/doc/guides/nics/mlx5.rst b/doc/guides/nics/mlx5.rst index 79c982e29..7dd9c1c5e 100644 --- a/doc/guides/nics/mlx5.rst +++ b/doc/guides/nics/mlx5.rst @@ -132,6 +132,10 @@ Limitations the external buffers will be freed by PMD and the application which still holds the external buffers may be corrupted. +- If Multi-Packet Rx queue is configured (``mprq_en``) and Rx CQE compression is + enabled (``rxq_cqe_comp_en``) at the same time, RSS hash result is not fully + supported. Some Rx packets may not have PKT_RX_RSS_HASH. + Statistics ---------- diff --git a/drivers/net/mlx5/Makefile b/drivers/net/mlx5/Makefile index 8a5229e61..955861a41 100644 --- a/drivers/net/mlx5/Makefile +++ b/drivers/net/mlx5/Makefile @@ -100,7 +100,7 @@ mlx5_autoconf.h.new: $(RTE_SDK)/buildtools/auto-config-h.sh $Q sh -- '$<' '$@' \ HAVE_IBV_DEVICE_STRIDING_RQ_SUPPORT \ infiniband/mlx5dv.h \ - enum MLX5DV_CONTEXT_MASK_STRIDING_RQ \ + enum MLX5DV_CQE_RES_FORMAT_CSUM_STRIDX \ $(AUTOCONF_OUTPUT) $Q sh -- '$<' '$@' \ HAVE_IBV_DEVICE_TUNNEL_SUPPORT \ diff --git a/drivers/net/mlx5/mlx5_rxq.c b/drivers/net/mlx5/mlx5_rxq.c index 17db7c160..08dd5596b 100644 --- a/drivers/net/mlx5/mlx5_rxq.c +++ b/drivers/net/mlx5/mlx5_rxq.c @@ -818,7 +818,13 @@ mlx5_rxq_ibv_new(struct rte_eth_dev *dev, uint16_t idx) if (config->cqe_comp && !rxq_data->hw_timestamp) { attr.cq.mlx5.comp_mask |= MLX5DV_CQ_INIT_ATTR_MASK_COMPRESSED_CQE; +#ifdef HAVE_IBV_DEVICE_STRIDING_RQ_SUPPORT + attr.cq.mlx5.cqe_comp_res_format = + mprq_en ? MLX5DV_CQE_RES_FORMAT_CSUM_STRIDX : + MLX5DV_CQE_RES_FORMAT_HASH; +#else attr.cq.mlx5.cqe_comp_res_format = MLX5DV_CQE_RES_FORMAT_HASH; +#endif /* * For vectorized Rx, it must not be doubled in order to * make cq_ci and rq_ci aligned. @@ -976,7 +982,7 @@ mlx5_rxq_ibv_new(struct rte_eth_dev *dev, uint16_t idx) rxq_data->rq_db = rwq.dbrec; rxq_data->cqe_n = log2above(cq_info.cqe_cnt); rxq_data->cq_ci = 0; - rxq_data->strd_ci = 0; + rxq_data->consumed_strd = 0; rxq_data->rq_pi = 0; rxq_data->zip = (struct rxq_zip){ .ai = 0, diff --git a/drivers/net/mlx5/mlx5_rxtx.c b/drivers/net/mlx5/mlx5_rxtx.c index a4e15c519..a7ed8d8e4 100644 --- a/drivers/net/mlx5/mlx5_rxtx.c +++ b/drivers/net/mlx5/mlx5_rxtx.c @@ -2108,7 +2108,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) volatile struct mlx5_cqe *cqe = &(*rxq->cqes)[rxq->cq_ci & cq_mask]; unsigned int i = 0; uint16_t rq_ci = rxq->rq_ci; - uint16_t strd_idx = rxq->strd_ci; + uint16_t consumed_strd = rxq->consumed_strd; struct mlx5_mprq_buf *buf = (*rxq->mprq_bufs)[rq_ci & wq_mask]; while (i < pkts_n) { @@ -2116,13 +2116,14 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) void *addr; int ret; unsigned int len; - uint16_t consumed_strd; + uint16_t strd_cnt; + uint16_t strd_idx; uint32_t offset; uint32_t byte_cnt; volatile struct mlx5_mini_cqe8 *mcqe = NULL; - uint32_t rss_hash_res; + uint32_t rss_hash_res = 0; - if (strd_idx == strd_n) { + if (consumed_strd == strd_n) { /* Replace WQE only if the buffer is still in use. */ if (rte_atomic16_read(&buf->refcnt) > 1) { mprq_buf_replace(rxq, rq_ci & wq_mask); @@ -2142,7 +2143,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) rxq->mprq_repl = rep; } /* Advance to the next WQE. */ - strd_idx = 0; + consumed_strd = 0; ++rq_ci; buf = (*rxq->mprq_bufs)[rq_ci & wq_mask]; } @@ -2156,14 +2157,21 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) continue; } byte_cnt = ret; - consumed_strd = (byte_cnt & MLX5_MPRQ_STRIDE_NUM_MASK) >> - MLX5_MPRQ_STRIDE_NUM_SHIFT; - assert(consumed_strd); - /* Calculate offset before adding up stride index. */ - offset = strd_idx * strd_sz + strd_shift; - strd_idx += consumed_strd; + strd_cnt = (byte_cnt & MLX5_MPRQ_STRIDE_NUM_MASK) >> + MLX5_MPRQ_STRIDE_NUM_SHIFT; + assert(strd_cnt); + consumed_strd += strd_cnt; if (byte_cnt & MLX5_MPRQ_FILLER_MASK) continue; + if (mcqe == NULL) { + rss_hash_res = rte_be_to_cpu_32(cqe->rx_hash_res); + strd_idx = rte_be_to_cpu_16(cqe->wqe_counter); + } else { + /* mini-CQE for MPRQ doesn't have hash result. */ + strd_idx = rte_be_to_cpu_16(mcqe->stride_idx); + } + assert(strd_idx < strd_n); + assert(!((rte_be_to_cpu_16(cqe->wqe_id) ^ rq_ci) & wq_mask)); /* * Currently configured to receive a packet per a stride. But if * MTU is adjusted through kernel interface, device could @@ -2171,7 +2179,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) * case, the packet should be dropped because it is bigger than * the max_rx_pkt_len. */ - if (unlikely(consumed_strd > 1)) { + if (unlikely(strd_cnt > 1)) { ++rxq->stats.idropped; continue; } @@ -2184,6 +2192,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) assert((int)len >= (rxq->crc_present << 2)); if (rxq->crc_present) len -= ETHER_CRC_LEN; + offset = strd_idx * strd_sz + strd_shift; addr = RTE_PTR_ADD(mlx5_mprq_buf_addr(buf), offset); /* Initialize the offload flag. */ pkt->ol_flags = 0; @@ -2206,7 +2215,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) } else { rte_iova_t buf_iova; struct rte_mbuf_ext_shared_info *shinfo; - uint16_t buf_len = consumed_strd * strd_sz; + uint16_t buf_len = strd_cnt * strd_sz; /* Increment the refcnt of the whole chunk. */ rte_atomic16_add_return(&buf->refcnt, 1); @@ -2242,10 +2251,6 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) continue; } } - /* If compressed, take hash result from mini-CQE. */ - rss_hash_res = rte_be_to_cpu_32(mcqe == NULL ? - cqe->rx_hash_res : - mcqe->rx_hash_result); rxq_cq_to_mbuf(rxq, pkt, cqe, rss_hash_res); PKT_LEN(pkt) = len; DATA_LEN(pkt) = len; @@ -2259,7 +2264,7 @@ mlx5_rx_burst_mprq(void *dpdk_rxq, struct rte_mbuf **pkts, uint16_t pkts_n) ++i; } /* Update the consumer indexes. */ - rxq->strd_ci = strd_idx; + rxq->consumed_strd = consumed_strd; rte_cio_wmb(); *rxq->cq_db = rte_cpu_to_be_32(rxq->cq_ci); if (rq_ci != rxq->rq_ci) { diff --git a/drivers/net/mlx5/mlx5_rxtx.h b/drivers/net/mlx5/mlx5_rxtx.h index 04a432adf..0007be08b 100644 --- a/drivers/net/mlx5/mlx5_rxtx.h +++ b/drivers/net/mlx5/mlx5_rxtx.h @@ -93,7 +93,7 @@ struct mlx5_rxq_data { volatile uint32_t *cq_db; uint16_t port_id; uint16_t rq_ci; - uint16_t strd_ci; /* Stride index in a WQE for Multi-Packet RQ. */ + uint16_t consumed_strd; /* Number of consumed strides in WQE. */ uint16_t rq_pi; uint16_t cq_ci; struct mlx5_mr_ctrl mr_ctrl; /* MR control descriptor. */