From patchwork Sun Aug 27 06:47:09 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shahaf Shuler X-Patchwork-Id: 28027 X-Patchwork-Delegate: ferruh.yigit@amd.com Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [IPv6:::1]) by dpdk.org (Postfix) with ESMTP id E2AD87D66; Sun, 27 Aug 2017 08:47:22 +0200 (CEST) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0062.outbound.protection.outlook.com [104.47.2.62]) by dpdk.org (Postfix) with ESMTP id 50E347CC2 for ; Sun, 27 Aug 2017 08:47:18 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=gFYpGds9kt9JLGdUm6/TMRQF6NYsEmE73vQTd83erFI=; b=bHk3XASENru3Yz9ugr1rChNlX2eOEpn4pi9DZ2KGKlkzkJFwqhObgYMHjimUnIhWYIEasnOUPXRelVS0e6ez8W7lF15514Jph1TPfe1XhJIuGRNmB7QU2C5R/573f8LGaz82JVMZzfO7/QSRuYrkxp90HngMVhVCZHW/H/D/9H8= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; Received: from mellanox.com (82.166.227.17) by AM4PR05MB3137.eurprd05.prod.outlook.com (2603:10a6:205:3::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.1.1385.9; Sun, 27 Aug 2017 06:47:15 +0000 From: Shahaf Shuler To: nelio.laranjeiro@6wind.com, adrien.mazarguil@6wind.com Cc: dev@dpdk.org, Yongseok Koh , Alexander Solganik , Sagi Grimberg Date: Sun, 27 Aug 2017 09:47:09 +0300 Message-Id: <5fce44a8af5723337ef793b089f77e36cd6f3fc6.1503816096.git.shahafs@mellanox.com> X-Mailer: git-send-email 2.12.0 In-Reply-To: References: <1503301622-14220-1-git-send-email-sagi@grimberg.me> MIME-Version: 1.0 X-Originating-IP: [82.166.227.17] X-ClientProxiedBy: AM5PR0502CA0023.eurprd05.prod.outlook.com (2603:10a6:203:91::33) To AM4PR05MB3137.eurprd05.prod.outlook.com (2603:10a6:205:3::14) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 923fd70b-e1f5-4528-4ca6-08d4ed1774b6 X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(48565401081)(300000503095)(300135400095)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:AM4PR05MB3137; X-Microsoft-Exchange-Diagnostics: 1; AM4PR05MB3137; 3:qUg7hVaOz040f2VzmgwSQvdN8zKiwZVJ2b8xsUkUIcg/rFISvyXrvZeJ4nU792wa53aZwis78w6CQ2daKQhKNmGtz7NDBm48vnow1MiXjzevUz4UkBucumqyDqY4+47IDQbgBoFq9YezZhCccAvu0fem9sFfgGX7AmpKfREVgR3MA/peG2ueVRwhK57MfVZttk3OqxVAFdfu0EHIT6ZIr8yyt6LIERKqCtgbvQ/izLniSYyd9PDxSdk44DnwJBcg; 25:KvFiLNB/BPQfznwRnL+Gdtk8BktP5vNtftqZsICq4pW3fiV9vU+kusx5MLZO4yJXWim63JlSvgH1gGZT0Kg6DztzJLEEJTZEvPAkxaswpUG8HHnS9mudoCKox15ziDSRfGZ2E9IDtSLLwPZXEeJmfheF0ADRIbsoAUc9e/Fx0WBlX8pIgEzCa6yzl/gDS0zJn2MyKxY7mwHq4sq7gjgXK/d6VqDoExtxFbPCVpOS920Q2SOdv2tILQSEj80IKHHxdNYT2D0kuiQx7tEKDzu6739nxB4urT4jTnyKccA1MWy38jP/rzR9ZKrLp8ps0ADepjoor4UZS4dwwInpsCMsfw==; 31:IXt4LNyUrLvdLFpTUP9L0aH7F2rtWlxB0X5JcEDKyY4RGdR47+AM2/t6bRHonnVgOBTjGvcD5l6LvMPvBuQOdvl2zuhsHWMVha7vrxmktU6Ky/m97kv4GIZgiUSN31K690V/ICkAqoMwxs8/a4b+lHQkKKe43go0roVM76LM4wRX9NFZF+FPKxwkMvXun9EqxX+P2J3WzfS61mdni/kJQDJclh0yDF8Ufz+3nhbqloc= X-MS-TrafficTypeDiagnostic: AM4PR05MB3137: X-LD-Processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; AM4PR05MB3137; 20:fyNj4bcfiXfbZSDb4YQnEkBPzJUZeRT+j7ryf1LfQyScsssFAxbyMFSPNni2zJjfNezc54hLae2XFiIj4nwpFyWkHV8zIdL6lbGV8lms2rm58jwzDZw0W0BmUBYpNWwuDGOLPx0K8gV+Fpt5jwGmv33E6SVgwjS31BNfqRqbRMoT+xHVU/BaIhV2S47CE0W3xhnKhhqboWzP0rW5mwCV4B5kejxHaRa8wyl4aY0d+kIytouk2Wd3rM0XNAgzekMeJ3rDh0eJCfvGaJly5ljZkmByOnOeBAkIRydtmR09D/Fy4p8YBzmj2aUCK6DDlz74brxQ5a2Fsexz+16ksCm+7CujzX64B8YwTFUsZPk4Kd6Fy6WH9wZjJbZ/eNe5vqkCAXZOKCvj1NOwsXxMlp6zTiPn3hVY1geMCveSoTXmr+ex+nCuEhDhqoWtLOmDJUEHRUQTqb+SEtjzwC3Y8cZ7Z35H01V/TkXbjNO5msobURvFy83dYk64G5c7+hIKwKFJ; 4:0W1dajslOonAfH3yhC8977KaUgUVDRu7yVCrnYTwyjpCYaRDFFPYRmpgefEUVRTcUx8v636TqGQ8g6rNK6oyDP0syTOFD7de0stZ6rU+I5qZeDQTMEeuEw3S9AeRUCugb/WqhnZ6/NCficwwj0Sq6tu9bwDjT3dUApb73zbJBtOTkzngswbPobfObzSfFNZqYlFkF17kXOIlUxWoI1vxRuHZXXGRs1IeB/LPrz0mTnKiYAroGmFNH8sDmIproI1n X-Exchange-Antispam-Report-Test: UriScan:; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(100000703101)(100105400095)(10201501046)(93006095)(93001095)(3002001)(6055026)(6041248)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(20161123562025)(20161123555025)(20161123560025)(20161123558100)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:AM4PR05MB3137; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:AM4PR05MB3137; X-Forefront-PRVS: 0412A98A59 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(7370300001)(4630300001)(6009001)(39860400002)(189002)(199003)(33646002)(53936002)(21086003)(68736007)(25786009)(5003940100001)(189998001)(105586002)(97736004)(101416001)(33026002)(6116002)(54906002)(4326008)(3846002)(55016002)(478600001)(106356001)(110136004)(36756003)(48376002)(305945005)(50466002)(2906002)(6666003)(76176999)(2950100002)(50986999)(42186005)(8676002)(69596002)(50226002)(81166006)(5660300001)(47776003)(7350300001)(66066001)(86362001)(7736002)(118296001)(81156014); DIR:OUT; SFP:1101; SCL:1; SRVR:AM4PR05MB3137; H:mellanox.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; AM4PR05MB3137; 23:0Y3piFVwTnBWMp6rwvzIFQ16g700NskvQWE0+MvzQ?= qxqUSj00unrOpp1LhEf2XwyUZTnHoOMhybR18cScBcrSPK+UrTZXcMhe0v30eeoN+tII3zjiU3VRY6RB+rLlLo+u4qJ5NMlXN4qCsJbdQh0NFl+lD9WPPpyHcuYmIZUf4Iljo44JnbMUAsCGq87kvf131eADUcrpdz0W5Q59qxNtFYBlSEUB71rOnbUkoDjRn7QZBT8GjA8tiUo82zN3oR2g1WEwqt+0FRl2lT5VVk4nEvjhcINhqBzN1jersPEa3+NaaG7fHDQJDatB+vtF3dzO1jqZxZYKZiNf/U1J/92grJEcZDWSckq99AFmkmH8IoUwETU8SZETAiegO+UTOwUWZH3pGH2FXYARQEXKCQ5VP/Up4zw49JXeCKM14xZGn+gB7mlYu/6pPaOyYIqpt0+MIT0SFLWnnVFV7qzo+ih+KVw8SnzPUGb3TEFYLKOLNasCkYQ85ulPv2BHSk+7P2JpFcRvPapWQwwOSQNz2TjVaOsjj7Sf0MB26fV0wRXZoIrZLUgQ+cxUP8RKIUeFlHUev8jIz750O4R8TTMUQc8IL60hObwqWBcdS//iKqcAYN8o+cxZzSn8/JzFNhWbXXs27HdxW56GWA31i/gU1nzFDRxBBtOi1+zmes5fj+Bo01yYP9rjFeeAB8hUmLn76t38TC8AKKYFdnx7seGeRlw2AswU8reftPuTpriXsvc6fsIvYejh3vjxuCu38crWuxnvfpjQdEHt3e0PAogHW2kLPIKt8/d5SnyW4F3gwd2KQJyfHhT894CrSiAvojURCO/r21RdFRRYXo2GpcDM5jyxSQxFpTgJj9Xv29b9Kr2b1aVl9XpGcqv15OSDMt64nnXiA3NUbh+x1kgjE9nb8OPJ1CHuOFuBntHhIzdXhmhvzhoHGzMhmJfOtPXZAv1SXS/iK7BNtZFqvu7KljBTootaU2ZYAPVd34MQdsHzdNQli9nutczR3cG80YXA++VqT3MlvR+Epu1EggIZYCbLzDiIVxTuHSXx8bd7XFvvSWm+R1xvcpC5M8zExs+5j0a1/+CUuVjFRYUtvR6tYoXAsz2LumjwnzNh1EErOsLSR2VQ+sPROPQPDuWd7/UXEk2yKWEt6WXw9r3E8J03DEYME74QA== X-Microsoft-Exchange-Diagnostics: 1; AM4PR05MB3137; 6:6NoqGMwln9Hrhl+5eCs4oeVYZJoUYFWI8yv4S3TEyRr/5GlUv5kYxkvYH3Z09eVuQz2Ba0Jt/7q4Ara9SkhohmHHw1cL5erLSIC3ewB4bX/ds373c4ZbwEFRgTFd5wtG2cixubemffG+tnem1RMaF8wS3bczEilPT1Pane+ENmkkbOJojEhjLKdC+tXXbGi/yyx9uDKc9aU/LwpE2ewaVApT1rtiGqAh+oJFuh8rG9RqVv7jQOPSSjMUce0KGOO9kFIBzwXdUr1Z1e9p2JgBp33Zk184zzqYa8qGl7bqtWeXzFci+YqHL5XwC48myaT6rJb56aNMo3YDYtgOE7ovhQ==; 5:ppQLjUWwDWMNuCTwsIHbssVr3sZcJmvlbPnnhlAB8DojCrVkYkx9cdsMGZz97DQi1Q+nHd+E+Ri2W1tRusdJ7v6ejuGCoJ34OO2/1b8tzidnIazYsMf2Cho07/4pL3b6CQOHoN/nCSwo92A/2d3Aow==; 24:cUC1qGzbYiBI8xlNeExjqiHGiLVRk8kNH6+WmnnibYK60b6TF5VQ7Ll7SLjYtSl3AKTmT26UndMiziTV93SZcgZ62SdIybKlhA/Lb4UNulI=; 7:5eu+wh2kKCXOWwMCn0TfReToRZLl1L3BGtjiIbm/8MgG3fFbBWmRa3TlVqAy5pCct649Vga7bPH8rCyD2vxUp0EgZnhjAtseYShMTlq84WxCYsmhdRuNomzAar373TpxkpMVgByARgxb1V18bo9DKtJhzDPAO7CsKCc28M0Tpub+GRGamc3mSQiZn/R2Fr8/mddYrs2fyRp1v+KY0pHOI/t1aXAJXOnW5caxAZiH7FU= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Aug 2017 06:47:15.8123 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR05MB3137 Subject: [dpdk-dev] [PATCH v2 2/2] net/mlx5: don't map doorbell register to write combining X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" By default, Verbs maps the doorbell register to write combining. Working with write combining is useful for drivers which use blue flame for the doorbell write. Since mlx5 PMD uses only doorbells and write combining mapping requires an extra memory barrier to flush the doorbell after its write, setting the mapping to un-cached by default. Such change is expected to reduce the max and average round trip latency. Signed-off-by: Shahaf Shuler Signed-off-by: Yongseok Koh Signed-off-by: Alexander Solganik Signed-off-by: Sagi Grimberg Acked-by: Nelio Laranjeiro --- drivers/net/mlx5/mlx5.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index bd66a7c77..50f4ba70a 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -884,6 +884,8 @@ rte_mlx5_pmd_init(void) * using this PMD, which is not supported in forked processes. */ setenv("RDMAV_HUGEPAGES_SAFE", "1", 1); + /* Don't map UAR to WC if BlueFlame is not used.*/ + setenv("MLX5_SHUT_UP_BF", "1", 1); ibv_fork_init(); rte_pci_register(&mlx5_driver); }