Patch Detail
get:
Show a patch.
patch:
Update a patch.
put:
Update a patch.
GET /api/patches/106173/?format=api
http://patches.dpdk.org/api/patches/106173/?format=api", "web_url": "http://patches.dpdk.org/project/dpdk/patch/20220121103122.2926856-13-ronan.randles@intel.com/", "project": { "id": 1, "url": "http://patches.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20220121103122.2926856-13-ronan.randles@intel.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20220121103122.2926856-13-ronan.randles@intel.com", "date": "2022-01-21T10:31:19", "name": "[v2,12/15] examples/generator: line rate limiting", "commit_ref": null, "pull_url": null, "state": "not-applicable", "archived": true, "hash": "a8e526df2d62d4869ad9ed8983a9be86d57193a8", "submitter": { "id": 2439, "url": "http://patches.dpdk.org/api/people/2439/?format=api", "name": "Ronan Randles", "email": "ronan.randles@intel.com" }, "delegate": { "id": 1, "url": "http://patches.dpdk.org/api/users/1/?format=api", "username": "tmonjalo", "first_name": "Thomas", "last_name": "Monjalon", "email": "thomas@monjalon.net" }, "mbox": "http://patches.dpdk.org/project/dpdk/patch/20220121103122.2926856-13-ronan.randles@intel.com/mbox/", "series": [ { "id": 21295, "url": "http://patches.dpdk.org/api/series/21295/?format=api", "web_url": "http://patches.dpdk.org/project/dpdk/list/?series=21295", "date": "2022-01-21T10:31:07", "name": "add packet generator library and example app", "version": 2, "mbox": "http://patches.dpdk.org/series/21295/mbox/" } ], "comments": "http://patches.dpdk.org/api/patches/106173/comments/", "check": "success", "checks": "http://patches.dpdk.org/api/patches/106173/checks/", "tags": {}, "related": [], "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id CB91CA034E;\n\tFri, 21 Jan 2022 11:32:46 +0100 (CET)", "from [217.70.189.124] (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id B859F4278B;\n\tFri, 21 Jan 2022 11:31:47 +0100 (CET)", "from mga01.intel.com (mga01.intel.com [192.55.52.88])\n by mails.dpdk.org (Postfix) with ESMTP id 7514C4276D\n for <dev@dpdk.org>; Fri, 21 Jan 2022 11:31:45 +0100 (CET)", "from orsmga008.jf.intel.com ([10.7.209.65])\n by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;\n 21 Jan 2022 02:31:44 -0800", "from silpixa00401120.ir.intel.com ([10.55.128.255])\n by orsmga008.jf.intel.com with ESMTP; 21 Jan 2022 02:31:43 -0800" ], "DKIM-Signature": "v=1; a=rsa-sha256; c=relaxed/simple;\n d=intel.com; i=@intel.com; q=dns/txt; s=Intel;\n t=1642761105; x=1674297105;\n h=from:to:cc:subject:date:message-id:in-reply-to:\n references:mime-version:content-transfer-encoding;\n bh=hbr2QB5kWiIwic2mWUsqcJy2y20Exh2SVWo0bnRLpa4=;\n b=THRX3bNt9iAEfx7g35dqGt/fCAlmwU8oT8XamLXgyW9MVqAvXW6iLaye\n CpYRDkIxCRPLy7k0B9erHgpgRNhD0c3Z+Z12FubmbDviDezcvoQixjOp/\n 7nHTCHlOC+Up9atFKFOaA3Jp+ppdDb/UM3XAdEaQfEK8YvRS579eqMWLt\n YtTUEe/CxYwu74q0MfcHzCoeUvRVzggsRTp6NxqwjCNcdGPNDeLB5edZw\n 1Otzc52idttxmv1p1CHE65NIBFEt6M1/YKMTIDzyNBbl4zXXOQloDYNw9\n hVXv902UJuqMMWNFovWkECw1idhC/5oX7gaWlAizEpQDw0B+RMcgnh+Zv Q==;", "X-IronPort-AV": [ "E=McAfee;i=\"6200,9189,10233\"; a=\"270045140\"", "E=Sophos;i=\"5.88,304,1635231600\"; d=\"scan'208\";a=\"270045140\"", "E=Sophos;i=\"5.88,304,1635231600\"; d=\"scan'208\";a=\"533222785\"" ], "X-ExtLoop1": "1", "From": "Ronan Randles <ronan.randles@intel.com>", "To": "dev@dpdk.org", "Cc": "Ronan Randles <ronan.randles@intel.com>", "Subject": "[PATCH v2 12/15] examples/generator: line rate limiting", "Date": "Fri, 21 Jan 2022 10:31:19 +0000", "Message-Id": "<20220121103122.2926856-13-ronan.randles@intel.com>", "X-Mailer": "git-send-email 2.25.1", "In-Reply-To": "<20220121103122.2926856-1-ronan.randles@intel.com>", "References": "<20211214141242.3383831-1-ronan.randles@intel.com>\n <20220121103122.2926856-1-ronan.randles@intel.com>", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org" }, "content": "This commit introduces line rate limiting using a token passing method.\nThe target traffic rate default is currently hard coded, this can be set\nusing telemetry.\n\nSigned-off-by: Ronan Randles <ronan.randles@intel.com>\n---\n examples/generator/main.c | 79 +++++++++++++++++++++++++--------------\n 1 file changed, 51 insertions(+), 28 deletions(-)", "diff": "diff --git a/examples/generator/main.c b/examples/generator/main.c\nindex 0834a094a4..16292f06db 100644\n--- a/examples/generator/main.c\n+++ b/examples/generator/main.c\n@@ -40,6 +40,7 @@ struct rte_gen *gen;\n struct gen_args {\n \t/* Inputs */\n \tstruct rte_gen *gen;\n+\tuint64_t target_tx_pps;\n \n \t/* Outputs */\n \tuint64_t tx_total_packets;\n@@ -195,7 +196,6 @@ gen_wait_for_links_up(void)\n \t\trte_delay_us_block(100);\n \t}\n }\n-\n /* The lcore main. This is the main thread that does the work, reading from\n * an input port and writing to an output port.\n */\n@@ -217,43 +217,63 @@ lcore_producer(void *arg)\n \t\t\t\t\t\"not be optimal.\\n\", port);\n \n \tuint64_t tsc_hz = rte_get_tsc_hz();\n+\tfloat tsc_hz_f = (float)tsc_hz;\n \tuint64_t last_tsc_reading = 0;\n \tuint64_t last_tx_total = 0;\n \tuint16_t nb_tx = 0;\n+\tfloat tokens = 0;\n \n \t/* Wait for links to come up before generating packets */\n \tgen_wait_for_links_up();\n \tif (!done)\n \t\tprintf(\"Generating packets...\\n\");\n \n+\tuint64_t token_last_add_tsc = rte_rdtsc();\n+\n \t/* Run until the application is quit or killed. */\n \twhile (!done) {\n-\n \t\tstruct rte_mbuf *bufs[BURST_SIZE];\n-\t\t/* Receive packets from gen and then tx them over port */\n-\n-\t\tRTE_ETH_FOREACH_DEV(port) {\n-\t\t\tint nb_generated = rte_gen_rx_burst(gen, bufs,\n-\t\t\t\t\t\t\tBURST_SIZE);\n-\n-\t\t\tuint64_t start_tsc = rte_rdtsc();\n-\t\t\tif (start_tsc > last_tsc_reading + tsc_hz) {\n-\t\t\t\targs->measured_tx_pps = args->tx_total_packets -\n-\t\t\t\t\t\t\t\tlast_tx_total;\n-\t\t\t\tlast_tx_total = args->tx_total_packets;\n-\t\t\t\tlast_tsc_reading = start_tsc;\n+\t\t/* Track time since last token add and calculate number\n+\t\t * of tokens to give per second to implement line rate limiting\n+\t\t */\n+\t\tuint64_t now = rte_rdtsc();\n+\t\tuint64_t tsc_delta = now - token_last_add_tsc;\n+\t\tfloat token_scalar = (float)tsc_delta / tsc_hz_f;\n+\t\tfloat add_tokens = args->target_tx_pps * token_scalar;\n+\t\t/* If there are tokens to be added and we haven't exceeded\n+\t\t * the target rate then we add tokens\n+\t\t */\n+\t\tif (add_tokens > 1.f) {\n+\t\t\tif (tokens < args->target_tx_pps) {\n+\t\t\t\ttokens += add_tokens;\n+\t\t\t\ttoken_last_add_tsc = now;\n \t\t\t}\n-\t\t\tnb_tx = rte_eth_tx_burst(port, 0, bufs, nb_generated);\n-\t\t\targs->tx_total_packets += nb_tx;\n-\n-\t\t\tuint64_t tx_failed = nb_generated - nb_tx;\n-\t\t\tif (nb_tx != nb_generated) {\n-\t\t\t\trte_pktmbuf_free_bulk(&bufs[nb_tx], tx_failed);\n-\t\t\t\targs->tx_failed += tx_failed;\n+\t\t}\n+\t\t/* Receive packets from gen and then tx them over port */\n+\t\tif (tokens >= BURST_SIZE) {\n+\t\t\tRTE_ETH_FOREACH_DEV(port) {\n+\t\t\t\tint nb_generated = rte_gen_rx_burst(gen, bufs,\n+\t\t\t\t\t\t\t\tBURST_SIZE);\n+\n+\t\t\t\tuint64_t start_tsc = rte_rdtsc();\n+\t\t\t\tif (start_tsc > last_tsc_reading + tsc_hz) {\n+\t\t\t\t\targs->measured_tx_pps =\n+\t\t\t\t\targs->tx_total_packets - last_tx_total;\n+\t\t\t\t\tlast_tx_total = args->tx_total_packets;\n+\t\t\t\t\tlast_tsc_reading = start_tsc;\n+\t\t\t\t}\n+\t\t\t\tnb_tx = rte_eth_tx_burst(port, 0, bufs,\n+\t\t\t\t\t\t\t\tnb_generated);\n+\t\t\t\targs->tx_total_packets += nb_tx;\n+\t\t\t\ttokens -= nb_tx;\n+\n+\t\t\t\tuint64_t tx_failed = nb_generated - nb_tx;\n+\t\t\t\tif (nb_tx != nb_generated) {\n+\t\t\t\t\trte_pktmbuf_free_bulk(&bufs[nb_tx],\n+\t\t\t\t\t\t\t\ttx_failed);\n+\t\t\t\t\targs->tx_failed += tx_failed;\n+\t\t\t\t}\n \t\t\t}\n-\t\t\tif (unlikely(nb_tx == 0))\n-\t\t\t\tcontinue;\n-\n \t\t}\n \t}\n \treturn 0;\n@@ -296,7 +316,6 @@ lcore_consumer(void *arg)\n \t\t\t\t\t\t\tBURST_SIZE);\n \t\t\tif (unlikely(nb_rx == 0))\n \t\t\t\tcontinue;\n-\n \t\t\targs->rx_total_packets += nb_rx;\n \n \t\t\tint nb_sent = rte_gen_tx_burst(gen, bufs,\n@@ -320,12 +339,14 @@ static int\n tele_gen_mpps(const char *cmd, const char *params, struct rte_tel_data *d)\n {\n \tRTE_SET_USED(cmd);\n-\tRTE_SET_USED(params);\n \n \tstruct gen_args *args = telemetry_userdata.prod;\n+\tif (params) {\n+\t\targs->target_tx_pps = atoi(params) * 1000000;\n+\t\tprintf(\"Packet rate set: %li\\n\", args->target_tx_pps);\n+\t}\n \trte_tel_data_start_dict(d);\n-\trte_tel_data_add_dict_int(d, \"pps\",\n-\t\t\t\t\t(args->measured_tx_pps));\n+\trte_tel_data_add_dict_int(d, \"pps\", args->target_tx_pps);\n \treturn 0;\n }\n \n@@ -412,6 +433,8 @@ main(int argc, char *argv[])\n \t\tif (lcore_count == 0) {\n \t\t\ttelemetry_userdata.prod =\n \t\t\t\t\t\t&core_launch_args[lcore_count];\n+\t\t\t/* Default traffic rate */\n+\t\t\ttelemetry_userdata.prod->target_tx_pps = 20000000;\n \t\t\trte_eal_remote_launch(lcore_producer,\n \t\t\t\t\t telemetry_userdata.prod,\n \t\t\t\t\t lcore_id);\n", "prefixes": [ "v2", "12/15" ] }{ "id": 106173, "url": "