From patchwork Mon Jun 19 17:18:09 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: ilia.kurakin@intel.com X-Patchwork-Id: 25441 Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [IPv6:::1]) by dpdk.org (Postfix) with ESMTP id 8D9A1968; Mon, 19 Jun 2017 19:19:13 +0200 (CEST) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 5991F271 for ; Mon, 19 Jun 2017 19:19:10 +0200 (CEST) Received: from orsmga004.jf.intel.com ([10.7.209.38]) by orsmga105.jf.intel.com with ESMTP; 19 Jun 2017 10:19:05 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.39,362,1493708400"; d="scan'208";a="99465772" Received: from nntvtune144.inn.intel.com ([10.125.21.144]) by orsmga004.jf.intel.com with ESMTP; 19 Jun 2017 10:19:03 -0700 From: ilia.kurakin@intel.com To: dev@dpdk.org Cc: Ilia Kurakin Date: Mon, 19 Jun 2017 20:18:09 +0300 Message-Id: <1497892689-27494-1-git-send-email-ilia.kurakin@intel.com> X-Mailer: git-send-email 2.7.4 Subject: [dpdk-dev] [PATCH] ether: add support for vtune task tracing X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" From: Ilia Kurakin The patch adds tracing of loop iterations that yielded no packets in a DPDK application. It is using ITT task API: https://software.intel.com/en-us/node/544206 We suppose the flow of using this tracing would assume the user has ITT lib and header on his machine and re-build DPDK with additional make parameters: make EXTRA_CFLAGS=-I EXTRA_LDLIBS="-L -littnotify" Signed-off-by: Ilia Kurakin --- config/common_base | 1 + lib/librte_ether/Makefile | 1 + lib/librte_ether/rte_eth_itt.h | 69 ++++++++++++++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 7 +++++ lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 5 files changed, 104 insertions(+) create mode 100644 lib/librte_ether/rte_eth_itt.h diff --git a/config/common_base b/config/common_base index f6aafd1..60d8b63 100644 --- a/config/common_base +++ b/config/common_base @@ -135,6 +135,7 @@ CONFIG_RTE_MAX_QUEUES_PER_PORT=1024 CONFIG_RTE_LIBRTE_IEEE1588=n CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y +CONFIG_RTE_ETHDEV_TRACE_WASTED_RX_ITERATIONS=n # # Turn off Tx preparation stage diff --git a/lib/librte_ether/Makefile b/lib/librte_ether/Makefile index 93fdde1..c10153a 100644 --- a/lib/librte_ether/Makefile +++ b/lib/librte_ether/Makefile @@ -56,5 +56,6 @@ SYMLINK-y-include += rte_eth_ctrl.h SYMLINK-y-include += rte_dev_info.h SYMLINK-y-include += rte_flow.h SYMLINK-y-include += rte_flow_driver.h +SYMLINK-${CONFIG_RTE_ETHDEV_TRACE_WASTED_RX_ITERATIONS}-include += rte_eth_itt.h include $(RTE_SDK)/mk/rte.lib.mk diff --git a/lib/librte_ether/rte_eth_itt.h b/lib/librte_ether/rte_eth_itt.h new file mode 100644 index 0000000..e7984fb --- /dev/null +++ b/lib/librte_ether/rte_eth_itt.h @@ -0,0 +1,69 @@ +#ifndef _RTE_ETH_ITT_H_ +#define _RTE_ETH_ITT_H_ + +#include +#include + +#define ITT_MAX_NAME_LEN (100) + +/** + * Auxiliary ITT structure belonging to port and using to: + * - track queue state to determine whether it is wasting loop iterations + * - begin or end ITT task using task domain and name + */ +struct rte_eth_itt_aux_data { + /** + * ITT domains for each queue. + */ + __itt_domain *wasted_iteration_itt_domains[RTE_MAX_QUEUES_PER_PORT]; + /** + * ITT task names for each queue. + */ + __itt_string_handle *wasted_iteration_itt_handles[RTE_MAX_QUEUES_PER_PORT]; + /** + * Flags indicating the queues state. Possible values: + * 1 - queue is wasting iterations, 0 - otherwise. + */ + uint8_t queue_is_wasting_iterations[RTE_MAX_QUEUES_PER_PORT]; +}; + +/** + * The pool of *rte_eth_itt_aux_data* structures. + */ +struct rte_eth_itt_aux_data itt_aux_data[RTE_MAX_ETHPORTS]; + +/** + * Initialization of rte_eth_itt_aux_data for a given port. + * This function must be invoked when ethernet device is being configured. + * Result will be stored in the global array *itt_aux_data*. + * + * @param port_id + * The port identifier of the Ethernet device. + * @param port_name + * The name of the Ethernet device. + * @param queue_num + * The number of queues on specified port. + */ +static inline void +rte_eth_init_itt(uint8_t port_id, char *port_name, uint8_t queue_num) { + uint16_t q_id; + for (q_id = 0; q_id < queue_num; ++q_id) { + char domain_name[ITT_MAX_NAME_LEN]; + snprintf(domain_name, sizeof(domain_name), + "RXBurst.WastedIterations.Port_%s.Queue_%d", + port_name, q_id); + itt_aux_data[port_id].wasted_iteration_itt_domains[q_id] + = __itt_domain_create(domain_name); + + char task_name[ITT_MAX_NAME_LEN]; + snprintf(task_name, sizeof(task_name), + "port id: %d; queue id: %d", + port_id, q_id); + itt_aux_data[port_id].wasted_iteration_itt_handles[q_id] + = __itt_string_handle_create(task_name); + + itt_aux_data[port_id].queue_is_wasting_iterations[q_id] = 0; + } +} + +#endif diff --git a/lib/librte_ether/rte_ethdev.c b/lib/librte_ether/rte_ethdev.c index 81a45c0..9e5ac01 100644 --- a/lib/librte_ether/rte_ethdev.c +++ b/lib/librte_ether/rte_ethdev.c @@ -818,6 +818,13 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q, return diag; } +#ifdef RTE_ETHDEV_TRACE_WASTED_RX_ITERATIONS + /** + * See rte_eth_itt.h to find comments on code below. + */ + rte_eth_init_itt(port_id, dev->data->name, nb_rx_q); +#endif + return 0; } diff --git a/lib/librte_ether/rte_ethdev.h b/lib/librte_ether/rte_ethdev.h index f6e6c74..4ba90d2 100644 --- a/lib/librte_ether/rte_ethdev.h +++ b/lib/librte_ether/rte_ethdev.h @@ -186,6 +186,10 @@ extern "C" { #include "rte_eth_ctrl.h" #include "rte_dev_info.h" +#ifdef RTE_ETHDEV_TRACE_WASTED_RX_ITERATIONS +#include "rte_eth_itt.h" +#endif + struct rte_mbuf; /** @@ -2710,6 +2714,28 @@ rte_eth_rx_burst(uint8_t port_id, uint16_t queue_id, int16_t nb_rx = (*dev->rx_pkt_burst)(dev->data->rx_queues[queue_id], rx_pkts, nb_pkts); +#ifdef RTE_ETHDEV_TRACE_WASTED_RX_ITERATIONS + /** + * See rte_eth_itt.h to find comments on code below. + */ + if (unlikely(nb_rx == 0)) { + if (!itt_aux_data[port_id].queue_is_wasting_iterations[queue_id]) { + __itt_task_begin( + itt_aux_data[port_id].wasted_iteration_itt_domains[queue_id], + __itt_null, __itt_null, + itt_aux_data[port_id].wasted_iteration_itt_handles[queue_id]); + itt_aux_data[port_id].queue_is_wasting_iterations[queue_id] = 1; + } + } + else { + if (unlikely(itt_aux_data[port_id].queue_is_wasting_iterations[queue_id])) { + __itt_task_end( + itt_aux_data[port_id].wasted_iteration_itt_domains[queue_id]); + itt_aux_data[port_id].queue_is_wasting_iterations[queue_id] = 0; + } + } +#endif + #ifdef RTE_ETHDEV_RXTX_CALLBACKS struct rte_eth_rxtx_callback *cb = dev->post_rx_burst_cbs[queue_id];