From patchwork Wed May 3 12:20:21 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shahaf Shuler X-Patchwork-Id: 24074 Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [IPv6:::1]) by dpdk.org (Postfix) with ESMTP id D4FD05A6A; Wed, 3 May 2017 14:20:30 +0200 (CEST) Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0045.outbound.protection.outlook.com [104.47.0.45]) by dpdk.org (Postfix) with ESMTP id AD0F4567F; Wed, 3 May 2017 14:20:29 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=EJsWpVVu9r+FnwAiRjq1bWH0n5s3cu6+uq3eEDFkoL4=; b=RaXCWv0qQbjwIEyXwZfWTEFFutHexv8mOS6oorsKXcYBLdOvi93xEN1EPC5UbP2IsckYe2g929y7lqv5fDVcNnI66U/fpou2Qt3dvM9TgvK3fEtSB4EtIUVZ/Yj4wMpLMpGwbQiJ8r6BpmfLKNUqutPZ1Px75kZd+fPrOSv+sC8= Authentication-Results: intel.com; dkim=none (message not signed) header.d=none; intel.com; dmarc=none action=none header.from=mellanox.com; Received: from mellanox.com (82.166.227.17) by VI1PR05MB1519.eurprd05.prod.outlook.com (10.164.85.149) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1075.11; Wed, 3 May 2017 12:20:26 +0000 From: Shahaf Shuler To: CC: , , Date: Wed, 3 May 2017 15:20:21 +0300 Message-ID: <20170503122021.136264-1-shahafs@mellanox.com> X-Mailer: git-send-email 2.12.0 MIME-Version: 1.0 X-Originating-IP: [82.166.227.17] X-ClientProxiedBy: VI1P18901CA0024.EURP189.PROD.OUTLOOK.COM (10.173.66.162) To VI1PR05MB1519.eurprd05.prod.outlook.com (10.164.85.149) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8471d121-33f2-4091-eb0c-08d4921ec7f6 X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(48565401081)(201703131423075)(201703031133081); SRVR:VI1PR05MB1519; X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1519; 3:v/9016EvaE5qc0Ou3UFjwEICj1zLU/I0ARomrsJBEz0Di+7Oaf7uckd0bWxmojo92ibbHi06Kl+yvbNf+4CLAy4t5OlUAcKL3lx/q9VNOgBijZ2TH7moxHp1OHU9fdngMFh3YS4mnqa3JfFtq//HDLKHNgaITKhrhegScOZOVjNd5RPR8rs5cdHGeekVI6/QN9psXMbnxSamwTisMsgDDcT6vzi3mcezt3cIccLtpvNzFihhfmw8FVIr20Bw9dSx8nOvZ4/mGrggUevQu3Au3prX1iIXHb8lNSVkrAAp0GGsG8MtPLnnwaQPH4sxHxfTJpRhf9CylylajW3MI0yAlITQrBYgxmWNHXBE+H072QI=; 25:33p2Om5ht+T653sGudC5+jOEJ+ZAicH/jBS4dgKHAmED7Xx4So3TN5+40HWlFDjGaX2Pt1PL7E5UJRDu1W+Mbs29uA/3uFZMsC8OR9iUTJeXhDk5OCqrm4/HT3jCikYufd7da/ks+DdU1yH/a/7LKTca3CocmQ0qiUQ5xNKQO8yLWTQffAx6SRrv0cwNVg2xWx84dpg3p/9d8ub37OwiznZTfq5Ze6gLQxGfPhgKgPCBf1IdF8acF6WmHdCBTxzMaWANZJl18dvvLvJS3VatoCZ+Zst6FLjYYlnsq7r3l2He0sPdIKMGg74IjMpWZzkhahf6smtmmrDxvJJMt7K4NoOsepGqt2f8pKYVpfBaNFJo/aAvYwaqAce+NCyBBfLq50xYWXm4wUgyr+MQjks4kpdgEYdKZMo7Tu6nrdUFBtE+brCKjddNHXzNq0+rL/eNR7U2zQTIaH0bJUzxxj5UB9A6wCzoG4sVRHlm7gQRqZw= X-LD-Processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1519; 31:r8589hioMTYdMCR2L9uPt6vK/JB3FoKvlCGEVz3rD5lK4a1n6b4SVlPmJRolglAL4KlaIsve7haAYW27xr2MChktsnWD53fmIhdcTSBxYUDxPYQSOO4QeLJjyzkApNZ0Eyyo6L0Yxwp+CJsNmE+bZ8Tu+mmstthUfDobKYVlJGPWDGiDrnDEgumcNkCoPBlW8VR2iPu0p2qTHu8g+/s0EgHfH/QAd+U+dJ7ChUa4THo=; 20:YkTZ1IzbGxog4g7Mr9dsmTk3e5DOC5ZKyz+Qm/hCibUDJNshsTHtUm8o77zSLcnY6ZB1QahzaxGb1yEfi0xxH+TWxI6n3B4k2a3cQUbomGmQtwEUMUmaw2twhncFUp6I5TZ6EIYTty2Roef7QhAdSDLVz7nCnKr/FwCTkdppWl2laIurLpsbti5F5tAJ3UTKqI2Kk2hhUg7zx3cqIjbn2qhMryTzceSVZzUtKzeCIijqpHDKq73BPU2VofF6i/gGu2tfkT3qeCVTLMqMvCiOngKKaJQmXYiVaDTT0xFAL0tWPuMjoGvG0vl37xfHS5ACPIVHKjG6Mixpm4G+2+kaFl5qgaz2DCEekXObYwqV4ka2E7xqPqAy6Z1kcDJ9tNKBQyw59TtD5h8oaDn2QTXx8i6KGBxDipWchsf54GGl9kuSCWl40hd2ysSEmb8ezcpupUxK/YuVy8v0TBI4xLylSV/SelDWS9/m1l2/x4q5F8daaB3FNe8PVOva4HM4zjj7 X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(8121501046)(5005006)(93006095)(93001095)(3002001)(10201501046)(6055026)(6041248)(20161123560025)(20161123558100)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123555025)(20161123564025)(20161123562025)(6072148); SRVR:VI1PR05MB1519; BCL:0; PCL:0; RULEID:; SRVR:VI1PR05MB1519; X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1519; 4:uQL+jVwvb0MNHgynXGrNDBM3VeJ33R8uAWGORCs7p/XgyQzqoPn8Rm9QbsZmzWMWr8lrQyQqqbJgzs9gwvLhJ5nzkyyzp6PEaeXaDKpbJ946Wn+7dLNmsXimVF2eyPJHXT72HyYvvCzyASgFt1Cc4eeL9Qog7Kj6UWPMGPQVCByGVLwi0SB0iwVSJa1nbuUR/ImwYnA524Haf87tJRefEIVmDk/IqO+5w7yN1gN29piq6KbNZ9cIKQVfF0LLLu4XM2PM+ZRn8/Bfkuw+Ds/P+YzEbJhHC15AXrlWfnmbDKlNNBbwDi4KOY1ux/fMlqe6y5cvOVLNKqk7egZqjqzt6RvT/6tjLOdjWyiPms5LIGO8AogDu2J2nEdSPsHcGSj8wv4SsBC4UQKoHi0qDuRRmnIHVCCZSyKNCTAJvInDTYTXx+5vMPgfXuqWskUvG+6kbr0tQn/vJ0MOsFg3p5YPMStVm2uYr4FgDpZGkt/JvbJthorLqeO6rr+K/44BDH3T3yiTE8YfFJP+TjDegyXkPfGVWg8yESVgWn6bmLzxPe+zi9yGovv3x2UPYTAPcEgY8Ay9AEkT6JDaIAIIHwqG2mSHHtaAZco8PZaG6A2Ic8tJeHg3kJyIc2kLAUNcAxLRxQAAB6PqVaY8sWGfZH0R1IPFGVIF+eNtu0g/tUh1hE58PW+oypMqSGWxe4JONfhP82/s9dKfl/rr1ZKFb7rwTxprWC8PDFRQZFb3RjlqvJ3gX0IYqkrwKdCSkBW56d+3hqhOn3XS+hNImtsJkpaFvafXKjz6Y9aJE9j5r2X9h1GTIBcoDQlg2urbb6tMRPr9 X-Forefront-PRVS: 029651C7A1 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(39450400003)(39840400002)(39860400002)(39850400002)(39400400002)(1076002)(5003940100001)(6116002)(54906002)(5660300001)(3846002)(36756003)(38730400002)(50226002)(33646002)(53936002)(478600001)(42186005)(110136004)(86362001)(81166006)(47776003)(50986999)(8676002)(2906002)(6916009)(66066001)(6666003)(48376002)(4326008)(2351001)(305945005)(189998001)(33026002)(25786009)(50466002)(55016002)(7736002); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB1519; H:mellanox.com; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; VI1PR05MB1519; 23:uF/rZYJbw/kzXT31XPVivcFNH2e8ebFNtmjT74jzf?= 2WZQp1MMUkOiBJN1E8Cw6PerAi6ebsjNawBn5cwJDOBwc7IuKHdK7aE5fFWM4SGAcp6jcjwy0QlPhhi9WIsGKmpe+b1Fau62j2yDPoje64xfTLIxNnZXAHIdZRZrDczBJP8h5948BkxnceSlQtVXZ8hZVS6OFnINmtWQCeJC2ZGt1ThL4PLsRxJKt6WiJIb0jWw1v70nnqsGQeWGVHzgLc6eUvaYD9M5KCm9H5y+bhVEr7L9y1y5cduD3tkIb5b5WTS7hbg+66PtU9cc8r2rJ+mNDTH9jLR+ALvP9pJRwnxoyK1eYRojElRQJc0b5tJxG1So2KoQ4tEbSrfPIur+nVaP7fhSBSS3rZkZKnR6eaBcu9nkmSUF8kMHj8uK//vVJVM+hKz/IcGpl44DesCRarS3IZ/pzzEI7MBu2WJroJsdPOdTKJHJN3t8LKJF3Qz5hf3+s2iSLAjtcP5+Ndwt0YqqtjgG+o2ZwIcAyGBnclVUSQUUyqJARIWE5kzqIEvMK4A6gwsYbi3GbkgbcDWx/AzVwMUp6cpoNvgG10m3LgXF90DxvMBgOcjNdEpWIp3nL/HOSkaMWszYHqhZ/nwI6pPBcttJNO7anldetlqxW86PlxL3V1fDvHi1Lh6OzCGwxUvcFIjtlVwQyjq3OfEddh5DxGDhQsLM3jgQEiarEFfoBczUJzi2RDdSvllHTBYnmT+hmHDjo5SPQRCMLZ0IYqNNuEvEq20ija9LzSTVbpK2tSnEI7sIE+yvAo/hIPHqKWncoyM5CuPo4HLyHa56IAbbRq5nWZWux+z9AG8Vtj/IYVHY4/b4AkTOqdST1GcO8uEwcfgRPXLpeajeXLB3Hi9127R9JZmBb6BcxcJJGnlg5y17TvuNn+8fRwfLHoVij7fK5YSNrVzsNnA0SgFECEX8h3WUCgb+RhFax4BY+jHttS7p/+MJhRfbhbPnLumi7sxOw+NyyvEEf3LMFxQOHmO4IOXV9H7nMH1qBuxgMToyQ== X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1519; 6:iYawMmp3cpXY6wQARiQHC7PARTf1bZyauV12SrWRxSegi/4uHoIbQGXHMsGF8iIQUqaJqFoQKvKmnqUvjokiIGAqppHyFB1eoCaqYcRan7SPepn2MKsufpwe8HASepnxqo/CdR8bv0EKUaWG1A2sV8UD+sPpQO39auoK0XPV9fRGBaqFAJEqZixITjHOumzRskOdY6Zd8YuaqElCUnFJE9qUtkB/njAJ8DvyF50KRxDNEKhEe+cc1z89LTgBqPxJ38RGrWvupKl+qplKsQN8QiO3a7DkHg4BBncGEnyzhBL89PE8LqPpOdZiCFTojSctzN947nNIWNtpFLBuR8+WcLxXPiX644rebWK1VlPfPpqRuyEDmwTF/PoVo66rN2zNomrKn5ZqjPiJ7Rvg5XqMR3AG/1GR326zvWLLE9sMZHeTePilQqT9OKS4dI4TAqYnvtkavPgvWVRF2JFspLZOYjzSm5DRqnGJ3Aa/Pk7jEUY5veBM5A8sdRA2iSfvo6B5tvJM52/ADXS8W72TElZkJCJ7/YDKGDmHq3P1CeiNFTQ=; 5:erLY2dU9kOAc027LvzjIZxfbTPG0tMX64AtFLAO/gmA+RrAIUySf8KmqjZQk/6FaT7rI8/hy+rOZZ3hL8m05v6aln/SEdU/6iPBF0c8A/5fzi19xUoVfh/K2p8u35JHiFpkQEShekjVisn3f1T4j7g==; 24:pcBludoXJm8kTop8uR+25jeWXk1NXjjtxJWbXKfV3BWPFG7F9Rx5rxqfIs/qUyWjJvWRgkyDyEa+3W+pKq2VcFjpjuCn+hvE7jANRgAG9RM= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1519; 7:o6aA/gTIqFeg+Zq5aoza5Eo2bF5rf2uaJJwiOf6j2Wez416/MOo5FdXYlKqFrhKxcladxNDYSrKrch4JrYhq8MSWRHTr58qMqe3Ftig3CWybdQfh0yPSD3NqtpTG5jKfZeZI5UtKXZOw3hNwXyS/rsy1Zwg4gl5geRBhO2GYc9TIeHyxw1hj70DOI0XZZjq0K9aLOo/0ho5puOT6evrq79TyatvkPN92tVOZGejyXix7FolBRJPtSAISteIPJC/p2d6fPqPTd1T0fvOCrqPefE+NYO/YTMCQztDy8ajqBfiVWlRxDaXzYPz++Hk29Dfrpw0lvumxEE/Fg0b58yGUMw== X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 May 2017 12:20:26.0573 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB1519 Subject: [dpdk-dev] [PATCH] app/testpmd: support non contiguous socket ids X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" The test assumes the socket ids are contiguous. This is not necessarily the case on all servers and may cause mempool creation to fail. Fixing it be detecting the list of valid socket ids and use it for the mempool creation. Fixes: 7acf894d07d1 ("app/testpmd: detect numa socket count") CC: stable@dpdk.org Signed-off-by: Shahaf Shuler --- app/test-pmd/parameters.c | 38 ++++++++++++++++++++++++++++---------- app/test-pmd/testpmd.c | 38 +++++++++++++++++++++++++++++--------- app/test-pmd/testpmd.h | 4 +++- 3 files changed, 60 insertions(+), 20 deletions(-) diff --git a/app/test-pmd/parameters.c b/app/test-pmd/parameters.c index 787e1434c..4822a8a8a 100644 --- a/app/test-pmd/parameters.c +++ b/app/test-pmd/parameters.c @@ -410,9 +410,14 @@ parse_portnuma_config(const char *q_arg) return -1; } socket_id = (uint8_t)int_fld[FLD_SOCKET]; - if(socket_id >= max_socket) { - printf("Invalid socket id, range is [0, %d]\n", - max_socket - 1); + if (new_socket_id(socket_id)) { + unsigned int i = 0; + + printf("Invalid socket id, options are: "); + for (i = 0; i < num_sockets; i++) { + printf("%u%s", socket_ids[i], + (i == num_sockets - 1) ? "\n" : ","); + } return -1; } port_numa[port_id] = socket_id; @@ -470,9 +475,14 @@ parse_ringnuma_config(const char *q_arg) return -1; } socket_id = (uint8_t)int_fld[FLD_SOCKET]; - if (socket_id >= max_socket) { - printf("Invalid socket id, range is [0, %d]\n", - max_socket - 1); + if (new_socket_id(socket_id)) { + unsigned int i = 0; + + printf("Invalid socket id, options are: "); + for (i = 0; i < num_sockets; i++) { + printf("%u%s", socket_ids[i], + (i == num_sockets - 1) ? "\n" : ","); + } return -1; } ring_flag = (uint8_t)int_fld[FLD_FLAG]; @@ -700,12 +710,20 @@ launch_args_parse(int argc, char** argv) "invalid ring-numa configuration\n"); if (!strcmp(lgopts[opt_idx].name, "socket-num")) { n = atoi(optarg); - if((uint8_t)n < max_socket) + if (!new_socket_id((uint8_t)n)) { socket_num = (uint8_t)n; - else + } else { + unsigned int i = 0; + + printf("socket id options are: "); + for (i = 0; i < num_sockets; i++) { + printf("%u%s", socket_ids[i], + (i == num_sockets - 1) ? + "\n" : ","); + } rte_exit(EXIT_FAILURE, - "The socket number should be < %d\n", - max_socket); + "Invalid socket id"); + } } if (!strcmp(lgopts[opt_idx].name, "mbuf-size")) { n = atoi(optarg); diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c index dfe64427d..a556a8aff 100644 --- a/app/test-pmd/testpmd.c +++ b/app/test-pmd/testpmd.c @@ -354,7 +354,8 @@ struct queue_stats_mappings *rx_queue_stats_mappings = rx_queue_stats_mappings_a uint16_t nb_tx_queue_stats_mappings = 0; uint16_t nb_rx_queue_stats_mappings = 0; -unsigned max_socket = 0; +unsigned int num_sockets = 0; +unsigned int socket_ids[RTE_MAX_NUMA_NODES]; #ifdef RTE_LIBRTE_BITRATE /* Bitrate statistics */ @@ -377,6 +378,22 @@ static void eth_event_callback(uint8_t port_id, static int all_ports_started(void); /* + * Helper function to check if socket is allready discovered. + * If yes, return positive value. If not, return zero. + */ +int +new_socket_id(unsigned int socket_id) +{ + unsigned int i; + + for (i = 0; i < num_sockets; i++) { + if (socket_ids[i] == socket_id) + return 0; + } + return 1; +} + +/* * Setup default configuration. */ static void @@ -388,12 +405,14 @@ set_default_fwd_lcores_config(void) nb_lc = 0; for (i = 0; i < RTE_MAX_LCORE; i++) { - sock_num = rte_lcore_to_socket_id(i) + 1; - if (sock_num > max_socket) { - if (sock_num > RTE_MAX_NUMA_NODES) - rte_exit(EXIT_FAILURE, "Total sockets greater than %u\n", RTE_MAX_NUMA_NODES); - max_socket = sock_num; + sock_num = rte_lcore_to_socket_id(i); + if (sock_num > RTE_MAX_NUMA_NODES) { + rte_exit(EXIT_FAILURE, + "Total sockets greater than %u\n", + RTE_MAX_NUMA_NODES); } + if (new_socket_id(sock_num)) + socket_ids[num_sockets++] = sock_num; if (!rte_lcore_is_enabled(i)) continue; if (i == rte_get_master_lcore()) @@ -506,7 +525,7 @@ check_socket_id(const unsigned int socket_id) { static int warning_once = 0; - if (socket_id >= max_socket) { + if (new_socket_id(socket_id)) { if (!warning_once && numa_support) printf("Warning: NUMA should be configured manually by" " using --port-numa-config and" @@ -591,8 +610,9 @@ init_config(void) if (numa_support) { uint8_t i; - for (i = 0; i < max_socket; i++) - mbuf_pool_create(mbuf_data_size, nb_mbuf_per_pool, i); + for (i = 0; i < num_sockets; i++) + mbuf_pool_create(mbuf_data_size, nb_mbuf_per_pool, + socket_ids[i]); } else { if (socket_num == UMA_NO_CONFIG) mbuf_pool_create(mbuf_data_size, nb_mbuf_per_pool, 0); diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h index 8b3d903ef..8186b6bfd 100644 --- a/app/test-pmd/testpmd.h +++ b/app/test-pmd/testpmd.h @@ -341,7 +341,8 @@ extern lcoreid_t nb_lcores; /**< Number of logical cores probed at init time. */ extern lcoreid_t nb_cfg_lcores; /**< Number of configured logical cores. */ extern lcoreid_t nb_fwd_lcores; /**< Number of forwarding logical cores. */ extern unsigned int fwd_lcores_cpuids[RTE_MAX_LCORE]; -extern unsigned max_socket; +extern unsigned int num_sockets; +extern unsigned int socket_ids[RTE_MAX_NUMA_NODES]; /* * Configuration of Ethernet ports: @@ -636,6 +637,7 @@ enum print_warning { DISABLED_WARN }; int port_id_is_invalid(portid_t port_id, enum print_warning warning); +int new_socket_id(unsigned int socket_id); /* * Work-around of a compilation error with ICC on invocations of the