t5fw_cfg_uwire.txt revision 267757
1252661Snp# Chelsio T5 Factory Default configuration file. 2252661Snp# 3267757Snp# Copyright (C) 2010-2014 Chelsio Communications. All rights reserved. 4252661Snp# 5252661Snp# DO NOT MODIFY THIS FILE UNDER ANY CIRCUMSTANCES. MODIFICATION OF 6252661Snp# THIS FILE WILL RESULT IN A NON-FUNCTIONAL T4 ADAPTER AND MAY RESULT 7252661Snp# IN PHYSICAL DAMAGE TO T4 ADAPTERS. 8252661Snp 9252661Snp# This file provides the default, power-on configuration for 4-port T4-based 10252661Snp# adapters shipped from the factory. These defaults are designed to address 11252661Snp# the needs of the vast majority of T4 customers. The basic idea is to have 12252661Snp# a default configuration which allows a customer to plug a T4 adapter in and 13252661Snp# have it work regardless of OS, driver or application except in the most 14252661Snp# unusual and/or demanding customer applications. 15252661Snp# 16252661Snp# Many of the T4 resources which are described by this configuration are 17252661Snp# finite. This requires balancing the configuration/operation needs of 18252661Snp# device drivers across OSes and a large number of customer application. 19252661Snp# 20252661Snp# Some of the more important resources to allocate and their constaints are: 21252661Snp# 1. Virtual Interfaces: 128. 22252661Snp# 2. Ingress Queues with Free Lists: 1024. PCI-E SR-IOV Virtual Functions 23252661Snp# must use a power of 2 Ingress Queues. 24252661Snp# 3. Egress Queues: 128K. PCI-E SR-IOV Virtual Functions must use a 25252661Snp# power of 2 Egress Queues. 26252661Snp# 4. MSI-X Vectors: 1088. A complication here is that the PCI-E SR-IOV 27252661Snp# Virtual Functions based off of a Physical Function all get the 28252661Snp# same umber of MSI-X Vectors as the base Physical Function. 29252661Snp# Additionally, regardless of whether Virtual Functions are enabled or 30252661Snp# not, their MSI-X "needs" are counted by the PCI-E implementation. 31252661Snp# And finally, all Physical Funcations capable of supporting Virtual 32252661Snp# Functions (PF0-3) must have the same number of configured TotalVFs in 33252661Snp# their SR-IOV Capabilities. 34252661Snp# 5. Multi-Port Support (MPS) TCAM: 336 entries to support MAC destination 35252661Snp# address matching on Ingress Packets. 36252661Snp# 37252661Snp# Some of the important OS/Driver resource needs are: 38252661Snp# 6. Some OS Drivers will manage all resources through a single Physical 39252661Snp# Function (currently PF0 but it could be any Physical Function). Thus, 40252661Snp# this "Unified PF" will need to have enough resources allocated to it 41252661Snp# to allow for this. And because of the MSI-X resource allocation 42252661Snp# constraints mentioned above, this probably means we'll either have to 43252661Snp# severely limit the TotalVFs if we continue to use PF0 as the Unified PF 44252661Snp# or we'll need to move the Unified PF into the PF4-7 range since those 45252661Snp# Physical Functions don't have any Virtual Functions associated with 46252661Snp# them. 47252661Snp# 7. Some OS Drivers will manage different ports and functions (NIC, 48252661Snp# storage, etc.) on different Physical Functions. For example, NIC 49252661Snp# functions for ports 0-3 on PF0-3, FCoE on PF4, iSCSI on PF5, etc. 50252661Snp# 51252661Snp# Some of the customer application needs which need to be accommodated: 52252661Snp# 8. Some customers will want to support large CPU count systems with 53252661Snp# good scaling. Thus, we'll need to accommodate a number of 54252661Snp# Ingress Queues and MSI-X Vectors to allow up to some number of CPUs 55252661Snp# to be involved per port and per application function. For example, 56252661Snp# in the case where all ports and application functions will be 57252661Snp# managed via a single Unified PF and we want to accommodate scaling up 58252661Snp# to 8 CPUs, we would want: 59252661Snp# 60252661Snp# 4 ports * 61252661Snp# 3 application functions (NIC, FCoE, iSCSI) per port * 62252661Snp# 8 Ingress Queue/MSI-X Vectors per application function 63252661Snp# 64252661Snp# for a total of 96 Ingress Queues and MSI-X Vectors on the Unified PF. 65252661Snp# (Plus a few for Firmware Event Queues, etc.) 66252661Snp# 67252661Snp# 9. Some customers will want to use T4's PCI-E SR-IOV Capability to allow 68252661Snp# Virtual Machines to directly access T4 functionality via SR-IOV 69252661Snp# Virtual Functions and "PCI Device Passthrough" -- this is especially 70252661Snp# true for the NIC application functionality. (Note that there is 71252661Snp# currently no ability to use the TOE, FCoE, iSCSI, etc. via Virtual 72252661Snp# Functions so this is in fact solely limited to NIC.) 73252661Snp# 74252661Snp 75252661Snp 76252661Snp# Global configuration settings. 77252661Snp# 78252661Snp[global] 79252661Snp rss_glb_config_mode = basicvirtual 80252661Snp rss_glb_config_options = tnlmapen,hashtoeplitz,tnlalllkp 81252661Snp 82252661Snp # PL_TIMEOUT register 83252661Snp pl_timeout_value = 200 # the timeout value in units of us 84252661Snp 85252661Snp # The following Scatter Gather Engine (SGE) settings assume a 4KB Host 86252661Snp # Page Size and a 64B L1 Cache Line Size. It programs the 87252661Snp # EgrStatusPageSize and IngPadBoundary to 64B and the PktShift to 2. 88252661Snp # If a Master PF Driver finds itself on a machine with different 89252661Snp # parameters, then the Master PF Driver is responsible for initializing 90252661Snp # these parameters to appropriate values. 91252661Snp # 92252661Snp # Notes: 93252661Snp # 1. The Free List Buffer Sizes below are raw and the firmware will 94252661Snp # round them up to the Ingress Padding Boundary. 95252661Snp # 2. The SGE Timer Values below are expressed below in microseconds. 96252661Snp # The firmware will convert these values to Core Clock Ticks when 97252661Snp # it processes the configuration parameters. 98252661Snp # 99252661Snp reg[0x1008] = 0x40810/0x21c70 # SGE_CONTROL 100252661Snp reg[0x100c] = 0x22222222 # SGE_HOST_PAGE_SIZE 101252661Snp reg[0x10a0] = 0x01040810 # SGE_INGRESS_RX_THRESHOLD 102252661Snp reg[0x1044] = 4096 # SGE_FL_BUFFER_SIZE0 103252661Snp reg[0x1048] = 65536 # SGE_FL_BUFFER_SIZE1 104252661Snp reg[0x104c] = 1536 # SGE_FL_BUFFER_SIZE2 105252661Snp reg[0x1050] = 9024 # SGE_FL_BUFFER_SIZE3 106252661Snp reg[0x1054] = 9216 # SGE_FL_BUFFER_SIZE4 107252661Snp reg[0x1058] = 2048 # SGE_FL_BUFFER_SIZE5 108252661Snp reg[0x105c] = 128 # SGE_FL_BUFFER_SIZE6 109252661Snp reg[0x1060] = 8192 # SGE_FL_BUFFER_SIZE7 110252661Snp reg[0x1064] = 16384 # SGE_FL_BUFFER_SIZE8 111252661Snp reg[0x10a4] = 0xa000a000/0xf000f000 # SGE_DBFIFO_STATUS 112252661Snp reg[0x10a8] = 0x402000/0x402000 # SGE_DOORBELL_CONTROL 113252661Snp 114252661Snp # SGE_THROTTLE_CONTROL 115252661Snp bar2throttlecount = 500 # bar2throttlecount in us 116252661Snp 117252661Snp sge_timer_value = 5, 10, 20, 50, 100, 200 # SGE_TIMER_VALUE* in usecs 118252661Snp 119252661Snp 120252661Snp reg[0x1124] = 0x00000400/0x00000400 # SGE_CONTROL2, enable VFIFO; if 121252661Snp # SGE_VFIFO_SIZE is not set, then 122252661Snp # firmware will set it up in function 123252661Snp # of number of egress queues used 124252661Snp 125252661Snp reg[0x1130] = 0x00d5ffeb # SGE_DBP_FETCH_THRESHOLD, fetch 126252661Snp # threshold set to queue depth 127252661Snp # minus 128-entries for FL and HP 128252661Snp # queues, and 0xfff for LP which 129252661Snp # prompts the firmware to set it up 130252661Snp # in function of egress queues 131252661Snp # used 132252661Snp 133252661Snp reg[0x113c] = 0x0002ffc0 # SGE_VFIFO_SIZE, set to 0x2ffc0 which 134252661Snp # prompts the firmware to set it up in 135252661Snp # function of number of egress queues 136252661Snp # used 137252661Snp 138256459Snp # enable TP_OUT_CONFIG.IPIDSPLITMODE 139256459Snp reg[0x7d04] = 0x00010000/0x00010000 140256459Snp 141252661Snp reg[0x7dc0] = 0x062f8849 # TP_SHIFT_CNT 142252661Snp 143256459Snp # TP_VLAN_PRI_MAP to select filter tuples and enable ServerSram 144256459Snp # filter control: compact, fcoemask 145256459Snp # server sram : srvrsram 146256459Snp # filter tuples : fragmentation, mpshittype, macmatch, ethertype, 147256459Snp # protocol, tos, vlan, vnic_id, port, fcoe 148256459Snp # valid filterModes are described the Terminator 5 Data Book 149252661Snp filterMode = srvrsram, fragmentation, mpshittype, protocol, vlan, port, fcoe 150256459Snp 151256459Snp # filter tuples enforced in LE active region (equal to or subset of filterMode) 152252661Snp filterMask = protocol, fcoe 153252661Snp 154252661Snp # Percentage of dynamic memory (in either the EDRAM or external MEM) 155252661Snp # to use for TP RX payload 156252661Snp tp_pmrx = 30 157252661Snp 158252661Snp # TP RX payload page size 159252661Snp tp_pmrx_pagesize = 64K 160252661Snp 161252661Snp # TP number of RX channels 162252661Snp tp_nrxch = 0 # 0 (auto) = 1 163252661Snp 164252661Snp # Percentage of dynamic memory (in either the EDRAM or external MEM) 165252661Snp # to use for TP TX payload 166252661Snp tp_pmtx = 50 167252661Snp 168252661Snp # TP TX payload page size 169252661Snp tp_pmtx_pagesize = 64K 170252661Snp 171252661Snp # TP number of TX channels 172252661Snp tp_ntxch = 0 # 0 (auto) = equal number of ports 173252661Snp 174256459Snp # TP OFLD MTUs 175256459Snp tp_mtus = 88, 256, 512, 576, 808, 1024, 1280, 1488, 1500, 2002, 2048, 4096, 4352, 8192, 9000, 9600 176256459Snp 177252661Snp # TP_GLOBAL_CONFIG 178252661Snp reg[0x7d08] = 0x00000800/0x00000800 # set IssFromCplEnable 179252661Snp 180267757Snp # TP_PC_CONFIG 181267757Snp reg[0x7d48] = 0x00000000/0x00000400 # clear EnableFLMError 182267757Snp 183256459Snp # TP_PARA_REG0 184256459Snp reg[0x7d60] = 0x06000000/0x07000000 # set InitCWND to 6 185256459Snp 186252661Snp # LE_DB_CONFIG 187252661Snp reg[0x19c04] = 0x00400000/0x00400000 # LE Server SRAM Enable 188252661Snp 189256459Snp # MC configuration 190256459Snp mc_mode_brc[0] = 1 # mc0 - 1: enable BRC, 0: enable RBC 191256459Snp mc_mode_brc[1] = 1 # mc1 - 1: enable BRC, 0: enable RBC 192256459Snp 193252661Snp# Some "definitions" to make the rest of this a bit more readable. We support 194252661Snp# 4 ports, 3 functions (NIC, FCoE and iSCSI), scaling up to 8 "CPU Queue Sets" 195252661Snp# per function per port ... 196252661Snp# 197252661Snp# NMSIX = 1088 # available MSI-X Vectors 198252661Snp# NVI = 128 # available Virtual Interfaces 199252661Snp# NMPSTCAM = 336 # MPS TCAM entries 200252661Snp# 201252661Snp# NPORTS = 4 # ports 202252661Snp# NCPUS = 8 # CPUs we want to support scalably 203252661Snp# NFUNCS = 3 # functions per port (NIC, FCoE, iSCSI) 204252661Snp 205252661Snp# Breakdown of Virtual Interface/Queue/Interrupt resources for the "Unified 206252661Snp# PF" which many OS Drivers will use to manage most or all functions. 207252661Snp# 208252661Snp# Each Ingress Queue can use one MSI-X interrupt but some Ingress Queues can 209252661Snp# use Forwarded Interrupt Ingress Queues. For these latter, an Ingress Queue 210252661Snp# would be created and the Queue ID of a Forwarded Interrupt Ingress Queue 211252661Snp# will be specified as the "Ingress Queue Asynchronous Destination Index." 212252661Snp# Thus, the number of MSI-X Vectors assigned to the Unified PF will be less 213252661Snp# than or equal to the number of Ingress Queues ... 214252661Snp# 215252661Snp# NVI_NIC = 4 # NIC access to NPORTS 216252661Snp# NFLIQ_NIC = 32 # NIC Ingress Queues with Free Lists 217252661Snp# NETHCTRL_NIC = 32 # NIC Ethernet Control/TX Queues 218252661Snp# NEQ_NIC = 64 # NIC Egress Queues (FL, ETHCTRL/TX) 219252661Snp# NMPSTCAM_NIC = 16 # NIC MPS TCAM Entries (NPORTS*4) 220252661Snp# NMSIX_NIC = 32 # NIC MSI-X Interrupt Vectors (FLIQ) 221252661Snp# 222252661Snp# NVI_OFLD = 0 # Offload uses NIC function to access ports 223252661Snp# NFLIQ_OFLD = 16 # Offload Ingress Queues with Free Lists 224252661Snp# NETHCTRL_OFLD = 0 # Offload Ethernet Control/TX Queues 225252661Snp# NEQ_OFLD = 16 # Offload Egress Queues (FL) 226252661Snp# NMPSTCAM_OFLD = 0 # Offload MPS TCAM Entries (uses NIC's) 227252661Snp# NMSIX_OFLD = 16 # Offload MSI-X Interrupt Vectors (FLIQ) 228252661Snp# 229252661Snp# NVI_RDMA = 0 # RDMA uses NIC function to access ports 230252661Snp# NFLIQ_RDMA = 4 # RDMA Ingress Queues with Free Lists 231252661Snp# NETHCTRL_RDMA = 0 # RDMA Ethernet Control/TX Queues 232252661Snp# NEQ_RDMA = 4 # RDMA Egress Queues (FL) 233252661Snp# NMPSTCAM_RDMA = 0 # RDMA MPS TCAM Entries (uses NIC's) 234252661Snp# NMSIX_RDMA = 4 # RDMA MSI-X Interrupt Vectors (FLIQ) 235252661Snp# 236252661Snp# NEQ_WD = 128 # Wire Direct TX Queues and FLs 237252661Snp# NETHCTRL_WD = 64 # Wire Direct TX Queues 238252661Snp# NFLIQ_WD = 64 ` # Wire Direct Ingress Queues with Free Lists 239252661Snp# 240252661Snp# NVI_ISCSI = 4 # ISCSI access to NPORTS 241252661Snp# NFLIQ_ISCSI = 4 # ISCSI Ingress Queues with Free Lists 242252661Snp# NETHCTRL_ISCSI = 0 # ISCSI Ethernet Control/TX Queues 243252661Snp# NEQ_ISCSI = 4 # ISCSI Egress Queues (FL) 244252661Snp# NMPSTCAM_ISCSI = 4 # ISCSI MPS TCAM Entries (NPORTS) 245252661Snp# NMSIX_ISCSI = 4 # ISCSI MSI-X Interrupt Vectors (FLIQ) 246252661Snp# 247252661Snp# NVI_FCOE = 4 # FCOE access to NPORTS 248252661Snp# NFLIQ_FCOE = 34 # FCOE Ingress Queues with Free Lists 249252661Snp# NETHCTRL_FCOE = 32 # FCOE Ethernet Control/TX Queues 250252661Snp# NEQ_FCOE = 66 # FCOE Egress Queues (FL) 251252661Snp# NMPSTCAM_FCOE = 32 # FCOE MPS TCAM Entries (NPORTS) 252252661Snp# NMSIX_FCOE = 34 # FCOE MSI-X Interrupt Vectors (FLIQ) 253252661Snp 254252661Snp# Two extra Ingress Queues per function for Firmware Events and Forwarded 255252661Snp# Interrupts, and two extra interrupts per function for Firmware Events (or a 256252661Snp# Forwarded Interrupt Queue) and General Interrupts per function. 257252661Snp# 258252661Snp# NFLIQ_EXTRA = 6 # "extra" Ingress Queues 2*NFUNCS (Firmware and 259252661Snp# # Forwarded Interrupts 260252661Snp# NMSIX_EXTRA = 6 # extra interrupts 2*NFUNCS (Firmware and 261252661Snp# # General Interrupts 262252661Snp 263252661Snp# Microsoft HyperV resources. The HyperV Virtual Ingress Queues will have 264252661Snp# their interrupts forwarded to another set of Forwarded Interrupt Queues. 265252661Snp# 266252661Snp# NVI_HYPERV = 16 # VMs we want to support 267252661Snp# NVIIQ_HYPERV = 2 # Virtual Ingress Queues with Free Lists per VM 268252661Snp# NFLIQ_HYPERV = 40 # VIQs + NCPUS Forwarded Interrupt Queues 269252661Snp# NEQ_HYPERV = 32 # VIQs Free Lists 270252661Snp# NMPSTCAM_HYPERV = 16 # MPS TCAM Entries (NVI_HYPERV) 271252661Snp# NMSIX_HYPERV = 8 # NCPUS Forwarded Interrupt Queues 272252661Snp 273252661Snp# Adding all of the above Unified PF resource needs together: (NIC + OFLD + 274252661Snp# RDMA + ISCSI + FCOE + EXTRA + HYPERV) 275252661Snp# 276252661Snp# NVI_UNIFIED = 28 277252661Snp# NFLIQ_UNIFIED = 106 278252661Snp# NETHCTRL_UNIFIED = 32 279252661Snp# NEQ_UNIFIED = 124 280252661Snp# NMPSTCAM_UNIFIED = 40 281252661Snp# 282252661Snp# The sum of all the MSI-X resources above is 74 MSI-X Vectors but we'll round 283252661Snp# that up to 128 to make sure the Unified PF doesn't run out of resources. 284252661Snp# 285252661Snp# NMSIX_UNIFIED = 128 286252661Snp# 287252661Snp# The Storage PFs could need up to NPORTS*NCPUS + NMSIX_EXTRA MSI-X Vectors 288252661Snp# which is 34 but they're probably safe with 32. 289252661Snp# 290252661Snp# NMSIX_STORAGE = 32 291252661Snp 292252661Snp# Note: The UnifiedPF is PF4 which doesn't have any Virtual Functions 293252661Snp# associated with it. Thus, the MSI-X Vector allocations we give to the 294252661Snp# UnifiedPF aren't inherited by any Virtual Functions. As a result we can 295252661Snp# provision many more Virtual Functions than we can if the UnifiedPF were 296252661Snp# one of PF0-3. 297252661Snp# 298252661Snp 299252661Snp# All of the below PCI-E parameters are actually stored in various *_init.txt 300252661Snp# files. We include them below essentially as comments. 301252661Snp# 302252661Snp# For PF0-3 we assign 8 vectors each for NIC Ingress Queues of the associated 303252661Snp# ports 0-3. 304252661Snp# 305252661Snp# For PF4, the Unified PF, we give it an MSI-X Table Size as outlined above. 306252661Snp# 307252661Snp# For PF5-6 we assign enough MSI-X Vectors to support FCoE and iSCSI 308252661Snp# storage applications across all four possible ports. 309252661Snp# 310252661Snp# Additionally, since the UnifiedPF isn't one of the per-port Physical 311252661Snp# Functions, we give the UnifiedPF and the PF0-3 Physical Functions 312252661Snp# different PCI Device IDs which will allow Unified and Per-Port Drivers 313252661Snp# to directly select the type of Physical Function to which they wish to be 314252661Snp# attached. 315252661Snp# 316252661Snp# Note that the actual values used for the PCI-E Intelectual Property will be 317252661Snp# 1 less than those below since that's the way it "counts" things. For 318252661Snp# readability, we use the number we actually mean ... 319252661Snp# 320252661Snp# PF0_INT = 8 # NCPUS 321252661Snp# PF1_INT = 8 # NCPUS 322252661Snp# PF2_INT = 8 # NCPUS 323252661Snp# PF3_INT = 8 # NCPUS 324252661Snp# PF0_3_INT = 32 # PF0_INT + PF1_INT + PF2_INT + PF3_INT 325252661Snp# 326252661Snp# PF4_INT = 128 # NMSIX_UNIFIED 327252661Snp# PF5_INT = 32 # NMSIX_STORAGE 328252661Snp# PF6_INT = 32 # NMSIX_STORAGE 329252661Snp# PF7_INT = 0 # Nothing Assigned 330252661Snp# PF4_7_INT = 192 # PF4_INT + PF5_INT + PF6_INT + PF7_INT 331252661Snp# 332252661Snp# PF0_7_INT = 224 # PF0_3_INT + PF4_7_INT 333252661Snp# 334252661Snp# With the above we can get 17 VFs/PF0-3 (limited by 336 MPS TCAM entries) 335252661Snp# but we'll lower that to 16 to make our total 64 and a nice power of 2 ... 336252661Snp# 337252661Snp# NVF = 16 338252661Snp 339252661Snp# For those OSes which manage different ports on different PFs, we need 340252661Snp# only enough resources to support a single port's NIC application functions 341252661Snp# on PF0-3. The below assumes that we're only doing NIC with NCPUS "Queue 342252661Snp# Sets" for ports 0-3. The FCoE and iSCSI functions for such OSes will be 343252661Snp# managed on the "storage PFs" (see below). 344252661Snp# 345252661Snp[function "0"] 346252661Snp nvf = 16 # NVF on this function 347252661Snp wx_caps = all # write/execute permissions for all commands 348252661Snp r_caps = all # read permissions for all commands 349252661Snp nvi = 1 # 1 port 350252661Snp niqflint = 8 # NCPUS "Queue Sets" 351252661Snp nethctrl = 8 # NCPUS "Queue Sets" 352252661Snp neq = 16 # niqflint + nethctrl Egress Queues 353252661Snp nexactf = 8 # number of exact MPSTCAM MAC filters 354252661Snp cmask = all # access to all channels 355252661Snp pmask = 0x1 # access to only one port 356252661Snp 357252661Snp[function "1"] 358252661Snp nvf = 16 # NVF on this function 359252661Snp wx_caps = all # write/execute permissions for all commands 360252661Snp r_caps = all # read permissions for all commands 361252661Snp nvi = 1 # 1 port 362252661Snp niqflint = 8 # NCPUS "Queue Sets" 363252661Snp nethctrl = 8 # NCPUS "Queue Sets" 364252661Snp neq = 16 # niqflint + nethctrl Egress Queues 365252661Snp nexactf = 8 # number of exact MPSTCAM MAC filters 366252661Snp cmask = all # access to all channels 367252661Snp pmask = 0x2 # access to only one port 368252661Snp 369252661Snp[function "2"] 370252661Snp nvf = 16 # NVF on this function 371252661Snp wx_caps = all # write/execute permissions for all commands 372252661Snp r_caps = all # read permissions for all commands 373252661Snp nvi = 1 # 1 port 374252661Snp niqflint = 8 # NCPUS "Queue Sets" 375252661Snp nethctrl = 8 # NCPUS "Queue Sets" 376252661Snp neq = 16 # niqflint + nethctrl Egress Queues 377252661Snp nexactf = 8 # number of exact MPSTCAM MAC filters 378252661Snp cmask = all # access to all channels 379252661Snp pmask = 0x4 # access to only one port 380252661Snp 381252661Snp[function "3"] 382252661Snp nvf = 16 # NVF on this function 383252661Snp wx_caps = all # write/execute permissions for all commands 384252661Snp r_caps = all # read permissions for all commands 385252661Snp nvi = 1 # 1 port 386252661Snp niqflint = 8 # NCPUS "Queue Sets" 387252661Snp nethctrl = 8 # NCPUS "Queue Sets" 388252661Snp neq = 16 # niqflint + nethctrl Egress Queues 389252661Snp nexactf = 8 # number of exact MPSTCAM MAC filters 390252661Snp cmask = all # access to all channels 391252661Snp pmask = 0x8 # access to only one port 392252661Snp 393252661Snp# Some OS Drivers manage all application functions for all ports via PF4. 394252661Snp# Thus we need to provide a large number of resources here. For Egress 395252661Snp# Queues we need to account for both TX Queues as well as Free List Queues 396252661Snp# (because the host is responsible for producing Free List Buffers for the 397252661Snp# hardware to consume). 398252661Snp# 399252661Snp[function "4"] 400252661Snp wx_caps = all # write/execute permissions for all commands 401252661Snp r_caps = all # read permissions for all commands 402252661Snp nvi = 28 # NVI_UNIFIED 403252661Snp niqflint = 170 # NFLIQ_UNIFIED + NLFIQ_WD 404252661Snp nethctrl = 100 # NETHCTRL_UNIFIED + NETHCTRL_WD 405252661Snp neq = 256 # NEQ_UNIFIED + NEQ_WD 406252661Snp nexactf = 40 # NMPSTCAM_UNIFIED 407252661Snp cmask = all # access to all channels 408252661Snp pmask = all # access to all four ports ... 409252661Snp nethofld = 1024 # number of user mode ethernet flow contexts 410252661Snp nroute = 32 # number of routing region entries 411252661Snp nclip = 32 # number of clip region entries 412252661Snp nfilter = 496 # number of filter region entries 413252661Snp nserver = 496 # number of server region entries 414252661Snp nhash = 12288 # number of hash region entries 415252661Snp protocol = nic_vm, ofld, rddp, rdmac, iscsi_initiator_pdu, iscsi_target_pdu 416252661Snp tp_l2t = 3072 417252661Snp tp_ddp = 2 418252661Snp tp_ddp_iscsi = 2 419252661Snp tp_stag = 2 420252661Snp tp_pbl = 5 421252661Snp tp_rq = 7 422252661Snp 423252661Snp# We have FCoE and iSCSI storage functions on PF5 and PF6 each of which may 424252661Snp# need to have Virtual Interfaces on each of the four ports with up to NCPUS 425252661Snp# "Queue Sets" each. 426252661Snp# 427252661Snp[function "5"] 428252661Snp wx_caps = all # write/execute permissions for all commands 429252661Snp r_caps = all # read permissions for all commands 430252661Snp nvi = 4 # NPORTS 431252661Snp niqflint = 34 # NPORTS*NCPUS + NMSIX_EXTRA 432252661Snp nethctrl = 32 # NPORTS*NCPUS 433252661Snp neq = 64 # NPORTS*NCPUS * 2 (FL, ETHCTRL/TX) 434252661Snp nexactf = 4 # NPORTS 435252661Snp cmask = all # access to all channels 436252661Snp pmask = all # access to all four ports ... 437252661Snp nserver = 16 438252661Snp nhash = 2048 439267757Snp tp_l2t = 1020 440252661Snp protocol = iscsi_initiator_fofld 441252661Snp tp_ddp_iscsi = 2 442252661Snp iscsi_ntask = 2048 443252661Snp iscsi_nsess = 2048 444252661Snp iscsi_nconn_per_session = 1 445252661Snp iscsi_ninitiator_instance = 64 446252661Snp 447252661Snp[function "6"] 448252661Snp wx_caps = all # write/execute permissions for all commands 449252661Snp r_caps = all # read permissions for all commands 450252661Snp nvi = 4 # NPORTS 451252661Snp niqflint = 34 # NPORTS*NCPUS + NMSIX_EXTRA 452252661Snp nethctrl = 32 # NPORTS*NCPUS 453252661Snp neq = 66 # NPORTS*NCPUS * 2 (FL, ETHCTRL/TX) + 2 (EXTRA) 454252661Snp nexactf = 32 # NPORTS + adding 28 exact entries for FCoE 455252661Snp # which is OK since < MIN(SUM PF0..3, PF4) 456252661Snp # and we never load PF0..3 and PF4 concurrently 457252661Snp cmask = all # access to all channels 458252661Snp pmask = all # access to all four ports ... 459252661Snp nhash = 2048 460267757Snp tp_l2t = 4 461252661Snp protocol = fcoe_initiator 462252661Snp tp_ddp = 2 463252661Snp fcoe_nfcf = 16 464252661Snp fcoe_nvnp = 32 465252661Snp fcoe_nssn = 1024 466252661Snp 467252661Snp# The following function, 1023, is not an actual PCIE function but is used to 468252661Snp# configure and reserve firmware internal resources that come from the global 469252661Snp# resource pool. 470252661Snp# 471252661Snp[function "1023"] 472252661Snp wx_caps = all # write/execute permissions for all commands 473252661Snp r_caps = all # read permissions for all commands 474252661Snp nvi = 4 # NVI_UNIFIED 475252661Snp cmask = all # access to all channels 476252661Snp pmask = all # access to all four ports ... 477252661Snp nexactf = 8 # NPORTS + DCBX + 478252661Snp nfilter = 16 # number of filter region entries 479252661Snp 480252661Snp# For Virtual functions, we only allow NIC functionality and we only allow 481252661Snp# access to one port (1 << PF). Note that because of limitations in the 482252661Snp# Scatter Gather Engine (SGE) hardware which checks writes to VF KDOORBELL 483252661Snp# and GTS registers, the number of Ingress and Egress Queues must be a power 484252661Snp# of 2. 485252661Snp# 486252661Snp[function "0/*"] # NVF 487252661Snp wx_caps = 0x82 # DMAQ | VF 488252661Snp r_caps = 0x86 # DMAQ | VF | PORT 489252661Snp nvi = 1 # 1 port 490252661Snp niqflint = 4 # 2 "Queue Sets" + NXIQ 491252661Snp nethctrl = 2 # 2 "Queue Sets" 492252661Snp neq = 4 # 2 "Queue Sets" * 2 493252661Snp nexactf = 4 494252661Snp cmask = all # access to all channels 495252661Snp pmask = 0x1 # access to only one port ... 496252661Snp 497252661Snp[function "1/*"] # NVF 498252661Snp wx_caps = 0x82 # DMAQ | VF 499252661Snp r_caps = 0x86 # DMAQ | VF | PORT 500252661Snp nvi = 1 # 1 port 501252661Snp niqflint = 4 # 2 "Queue Sets" + NXIQ 502252661Snp nethctrl = 2 # 2 "Queue Sets" 503252661Snp neq = 4 # 2 "Queue Sets" * 2 504252661Snp nexactf = 4 505252661Snp cmask = all # access to all channels 506252661Snp pmask = 0x2 # access to only one port ... 507252661Snp 508252661Snp[function "2/*"] # NVF 509252661Snp wx_caps = 0x82 # DMAQ | VF 510252661Snp r_caps = 0x86 # DMAQ | VF | PORT 511252661Snp nvi = 1 # 1 port 512252661Snp niqflint = 4 # 2 "Queue Sets" + NXIQ 513252661Snp nethctrl = 2 # 2 "Queue Sets" 514252661Snp neq = 4 # 2 "Queue Sets" * 2 515252661Snp nexactf = 4 516252661Snp cmask = all # access to all channels 517252661Snp pmask = 0x4 # access to only one port ... 518252661Snp 519252661Snp[function "3/*"] # NVF 520252661Snp wx_caps = 0x82 # DMAQ | VF 521252661Snp r_caps = 0x86 # DMAQ | VF | PORT 522252661Snp nvi = 1 # 1 port 523252661Snp niqflint = 4 # 2 "Queue Sets" + NXIQ 524252661Snp nethctrl = 2 # 2 "Queue Sets" 525252661Snp neq = 4 # 2 "Queue Sets" * 2 526252661Snp nexactf = 4 527252661Snp cmask = all # access to all channels 528252661Snp pmask = 0x8 # access to only one port ... 529252661Snp 530252661Snp# MPS features a 196608 bytes ingress buffer that is used for ingress buffering 531252661Snp# for packets from the wire as well as the loopback path of the L2 switch. The 532252661Snp# folling params control how the buffer memory is distributed and the L2 flow 533252661Snp# control settings: 534252661Snp# 535252661Snp# bg_mem: %-age of mem to use for port/buffer group 536252661Snp# lpbk_mem: %-age of port/bg mem to use for loopback 537252661Snp# hwm: high watermark; bytes available when starting to send pause 538252661Snp# frames (in units of 0.1 MTU) 539252661Snp# lwm: low watermark; bytes remaining when sending 'unpause' frame 540252661Snp# (in inuits of 0.1 MTU) 541252661Snp# dwm: minimum delta between high and low watermark (in units of 100 542252661Snp# Bytes) 543252661Snp# 544252661Snp[port "0"] 545252661Snp dcb = ppp, dcbx # configure for DCB PPP and enable DCBX offload 546252661Snp bg_mem = 25 547252661Snp lpbk_mem = 25 548252661Snp hwm = 30 549252661Snp lwm = 15 550252661Snp dwm = 30 551267757Snp dcb_app_tlv[0] = 0x8906, ethertype, 3 552267757Snp dcb_app_tlv[1] = 0x8914, ethertype, 3 553267757Snp dcb_app_tlv[2] = 3260, socketnum, 5 554252661Snp 555252661Snp[port "1"] 556252661Snp dcb = ppp, dcbx 557252661Snp bg_mem = 25 558252661Snp lpbk_mem = 25 559252661Snp hwm = 30 560252661Snp lwm = 15 561252661Snp dwm = 30 562267757Snp dcb_app_tlv[0] = 0x8906, ethertype, 3 563267757Snp dcb_app_tlv[1] = 0x8914, ethertype, 3 564267757Snp dcb_app_tlv[2] = 3260, socketnum, 5 565252661Snp 566252661Snp[port "2"] 567252661Snp dcb = ppp, dcbx 568252661Snp bg_mem = 25 569252661Snp lpbk_mem = 25 570252661Snp hwm = 30 571252661Snp lwm = 15 572252661Snp dwm = 30 573267757Snp dcb_app_tlv[0] = 0x8906, ethertype, 3 574267757Snp dcb_app_tlv[1] = 0x8914, ethertype, 3 575267757Snp dcb_app_tlv[2] = 3260, socketnum, 5 576252661Snp 577252661Snp[port "3"] 578252661Snp dcb = ppp, dcbx 579252661Snp bg_mem = 25 580252661Snp lpbk_mem = 25 581252661Snp hwm = 30 582252661Snp lwm = 15 583252661Snp dwm = 30 584267757Snp dcb_app_tlv[0] = 0x8906, ethertype, 3 585267757Snp dcb_app_tlv[1] = 0x8914, ethertype, 3 586267757Snp dcb_app_tlv[2] = 3260, socketnum, 5 587252661Snp 588252661Snp[fini] 589267757Snp version = 0x14250016 590267757Snp checksum = 0x5d740273 591252661Snp 592252661Snp# Total resources used by above allocations: 593252661Snp# Virtual Interfaces: 104 594252661Snp# Ingress Queues/w Free Lists and Interrupts: 526 595252661Snp# Egress Queues: 702 596252661Snp# MPS TCAM Entries: 336 597252661Snp# MSI-X Vectors: 736 598252661Snp# Virtual Functions: 64 599252661Snp# 600252661Snp# $FreeBSD: head/sys/dev/cxgbe/firmware/t5fw_cfg_uwire.txt 267757 2014-06-22 23:40:20Z np $ 601252661Snp# 602