################################################################ # Mellanox Technologies Inc # Mellanox Ethernet Microsoft Windows 64-bit Driver Release # June 19th, 2014 # # RELEASE Version 04.60.00 ################################################################ Hardware Compatibility ====================== This release of software supports the following hardware: - Mellanox ConnectX-3 Dual Port 10 GbE KR Blade Mezzanine Ethernet Card - Mellanox ConnectX-3 Dual Port 40 GbE QSFP+ Ethernet Adapter - Mellanox ConnectX-3 Dual Port 10 GbE DA/SFP+ Ethernet Adapter Software Compatibility ====================== This release of software supports the following operating systems: - Microsoft Windows Server 2008 R2 w/SP1 - Microsoft Windows Server 2012 - Microsoft Windows Server 2012 R2 Release Contents ================== - Mellanox WinOF 4.60 for Microsoft Windows Server 2008 R2 w/SP1 - Mellanox WinOF 4.60 for Microsoft Windows Server 2012 - Mellanox WinOF 4.60 for Microsoft Windows Server 2012 R2 * Third-party trademarks and copyrights are the property of their respective owners. Feature Summary =============== - 2nd Dell release of Mellanox Ethernet Drivers supporting Mellanox ConnectX-3 Adapters on Dell PowerEdge Servers. Performance - Added support to IPv6-to-all nd_*_* tests ND - Added the ability to rearm a CQ in the kernel - Added the ability to handle LID changes - Changed connection timeout behavior. Added the STATUS_CONNECTION_REFUSED return value upon connection timeout. Ethenet - Added DSCP support over IPv4 - Added traffic profile - Changed the report link speed zero in case of disconnected network adapter - LBFO: Enabled creation of more than one team with different MAC addresses in Windows Server 2008 R2 WMI/CIM - Added ControlledBy association to IBPort Fixes =============== Generic - Random parsing failures of string registry entries - Compilation failure of "Hello_world" in the SDK - The return value of ib_query_ca() if failed to allocate resources for operation Performance - CPU utilization report in nd_*_* tests - Correct bandwidth peak results in ibv_send_bw with UD QP - Sync problems of bidirectional mode in ibv_read_bw/ibv_write_bw RoCE - RoCE mode parsing ND - Missing completions when working with Completion Queue with single entry Ethernet Ethernet - Modified the CQ size to prevent CQ overrun - LBFO: Fixed port channel teaming with CISCO switch and Fabric Extenders traffic loose in Windows Server 2008 R2 - Issue related to packets sent with corrupted VLAN header when they were meant to be untagged - Unexpected behavior upon QP asynchronous event - Stability issues - Performance improvements WMI/CIM - ConformsToProfiles association for SoftwareIdentity and DriverIdentity - Execution of all tests which were running when executing Diagnostic tests on one instance - Failure occurred when running MLNX_Card - Printing of diagnostics log - Issue preventing from get-event to show information after disabling the PCI device Important Notes =============== - After the installer completes, the system must be rebooted to complete the device driver installation - Wake on LAN is only supported with Mellanox ConnectX-3 Dual Port 10 GbE KR Blade Mezzanine Ethernet Card ********************************************************************* Currently known issues and limitations with Mellanox Ethernet drivers and devices ********************************************************************* 1. No current support for SR-IOV in Windows operating systems 2. No current support for Brocade M8428-k IO Module for Dell PowerEdge M1000e chassis 3. No current support for Dell PowerConnect M8024-k IO Module for Dell PowerEdge M1000e chassis 4. DCBX support does not include support for Willing Mode. Mellanox Known General Issues with WinOF 4.60 - Pinning all the physical memory (used by RDMA operations, such as register memory, pin user memory) on the machine, on Operating Systems prior to Windows Server 2012, may cause the machine to hang. Suggested work around: Avoid pining the whole machine memory in those Operating Systems. - When the tracer tool traces many events, it may consume a large amount of memory (up to several GB ram). Suggested work around: Reduce the verbose level. - When trying to use the following WMI classes and operations, an error or empty messages will be displayed: - MLNX_Card - MLNX_FirmwareIdentity - MLNX_FirmwareInstallationServic - MLNX_Realizes - Running Ntttcp without the “-a X” flag (X >1) in a NIC configured with 10GbE, may cause low bandwidth in TCP single stream. Suggested work around: Run Ntttcp with “-a 8” for best performance - When working with the default NDv1 and NDv2 providers, the following error message might be displayed: 0xC0000120 NT_STATUS_CANCELLED This error does not affect any functionality and can be safely ignored. - Changing the default ND providers may cause random errors, such as: 0xC0000238 (NT_STATUS_ADDRESS_ALREADY_ASSOCIATED) on Connect() or with 0xC0000236 (NT_STATUS_CONNECTION_REFUSED) on Accept(). These errors can be safely ignored. - The UI displays the network interface’s state incorrectly even after disabling and re-enabling the "disconnected" network interfaces. Suggested work around: To see the correct state and link speed, perform one of the following: - Run Get-netadapter Powershell cmdlet - Right click on that interface from "Network Connections" and click on status - Upon bad Cable Recoverable the driver will print in the event log “Unsupported cable message” and upon unsupported cable the message be “Bad Cable”. Mellanox Known Ethernet Issues with WinOF 4.60 - Disabling the "Priority & VLAN tag" in the UI which VLANID is configured, may result in sending packets with the configured VLANID. Suggested work around: Remove the VLANID before disabling the "Priority & VLAN tag". - When working with LBFO, the teamed interface disappears after machine reboot. The issue applies to Windows Server 2012 R2 Suggest work around: Delete the existing teamed interface and create a new one. - WakeOnMagicPacket registry key is not added to the registry although WoL is supported by the driver and by the NIC. - When the ports of the device are configured as Ethernet only, ibstat/vstat may display wrong information. - High multicast drop rate on multicast storming. Suggested work around: Use "Multicast traffic" tuning option under the performance tab. For further information, please refer to section “Tunable Performance Parameters” in the User Manual. - Driver installation requires deletion of the mlx4_bus.sys file in Windows Server 2008 R and WLH OSs when using the PXE package. Suggested work around: Delete the mlx4_bus.sys file and reboot the machine to install the driver - When there is a stress in TCP connection establishments, some of those connections may fail. Suggested work around: Increase the Ring queue sizes: - ReceiveBuffers - controls the receive ring size - TransmitBuffers - controls the transmit ring size - The DCB component specifies a default traffic classification that is applied to all egress packets that do not match other classification conditions. In this case, the network adapter assigns the IEEE 802.1p priority level that is associated with the default classification to these egress packets. The default traffic classification has the following attributes: - It has a traffic classification condition of type NDIS_QOS_CONDITION_DEFAULT. - It is the first traffic classification defined in the array of NDIS_QOS_CLASSIFICATION_ELEMENT structures. Mellanox Known QoS Issues with WinOF 4.60 - Running Quality of Service (QoS) commands without the parameter "-PolicyStore ActiveStore” may cause machines to load without Quality of Service policy. Suggested work around: Store the QoS policy in the ActiveStore Mellanox Known RoCE Issues with WinOF 4.60 - RoCE traffic cannot be routed. It works in the same subnet only - RoCE does not support: Multicast traffic, VLAN, Layer 3 feature - Using different versions of RoCE in your cluster is not supported. Suggested work around: Use the same RoCE version in all the cluster in the Ethernet ports Mellanox Known Performance Issues with WinOF 4.60 - When using WinOF 4.40 or later, low throughput will be seen on 40GbE adapters when QoS is enabled. Suggested work around: Disable QoS when it is not in use. Open a PowerShell prompt. Run: Disable-NetAdapter-Qos -name where is, for example, "Ethernet 1" - Perf_tuning is supported only when one of the two NUMA nodes are in use. - Execution of nd_write_lat over mlx4ndv1 or mlx4ndv2 may never end. Suggested work around: Press CTRL-C and kill the test. - Running performance benchmarks for a short period of time (< 1 sec) may provide bad latency in IPoIB and Ethernet. Suggested work around: Set “Rx Interrupt Moderation Profile” and “Tx Interrupt Moderation Profile”, to “Low Latency” to avoid bad latency. Note: This may increase CPU utilization. ################################################################ # Mellanox Technologies Inc # Mellanox Ethernet Microsoft Windows 64-bit Driver Release # September 20th, 2013 # # RELEASE Version 04.40.00 ################################################################ Software Compatibility ====================== This release of software supports the following hardware: - Mellanox ConnectX-3 Dual Port 10 GbE KR Blade Mezzanine Ethernet Card - Mellanox ConnectX-3 Dual Port 40 GbE QSFP+ Ethernet Adapter - Mellanox ConnectX-3 Dual Port 10 GbE DA/SFP+ Ethernet Adapter This release of software supports the following operating systems: - Microsoft Windows Server 2008 SP2 x64 - Microsoft Windows Server 2008 R2 w/SP1 - Microsoft Windows Small Business Server 2011 Standard edition - Microsoft Windows Server 2012 Release Contents ================== - Mellanox WinOF 4.3 for Microsoft Windows Server 2008 SP2 x64 - Mellanox WinOF 4.40 for Microsoft Windows Server 2008 R2 w/SP1 - Mellanox WinOF 4.40 for Microsoft Windows Small Business Server 2011 Standard edition - Mellanox WinOF 4.40 for Microsoft Windows Server 2012 * Third-party trademarks and copyrights are the property of their respective owners. Feature Summary =============== - Initial Dell release of Mellanox Ethernet Drivers supporting Mellanox ConnectX-3 Adapters on Dell PowerEdge Servers. Fixes =============== - Initial Release Important Notes =============== - After the installer completes, the system must be rebooted to complete the device driver installation - Wake on LAN is only supported with Mellanox ConnectX-3 Dual Port 10 GbE KR Blade Mezzanine Ethernet Card ********************************************************************* Currently known issues and limitations with Mellanox Ethernet drivers and devices ********************************************************************* 1. Disabling network device corresponding to port 1 of the Mellanox adapter may not cause the physical link to drop. No network traffic will actually be transmitted on that link. 2. No current support for SR-IOV in Windows operating systems 3. No current support for Brocade M8428-k IO Module for Dell PowerEdge M1000e chassis 4. No current support for Dell PowerConnect M8024-k IO Module for Dell PowerEdge M1000e chassis Mellanox Known General Issues with WinOF 4.40 - Pinning all the physical memory (used by RDMA operations, such as register memory, pin user memory) on the machine, on Operating Systems prior to Windows Server 2012, may cause the machine to hang. Avoid pining the whole machine memory in those Operating Systems. - When the tracer tool traces many events, it may consume a large amount of memory (up to several GB ram). Reduce the verbose level. Mellanox Known Ethernet Issues with WinOF 4.40 - Disabling the "Priority & VLAN tag" in the UI which VLANID is configured, may result in sending packets with the configured VLANID. Remove the VLANID before disabling the "Priority & VLAN tag". - WakeOnMagicPacket registry key is not added to the registry although WoL is supported by the driver and by the NIC. - When the ports of the device are configured as Ethernet only, ibstat/vstat may display wrong information. - High multicast drop rate on multicast storming. Use "Multicast traffic" tuning option under the performance tab. For further information, please refer to section “Tunable Performance Parameters” in the User Manual. - Driver installation requires deletion of the mlx4_bus.sys file in Windows Server 2008 R and WLH OSs when using the PXE package. Delete the mlx4_bus.sys file and reboot the machine to install the driver Mellanox Known RoCE Issues with WinOF 4.40 - RoCE traffic cannot go through the router. It works in the same subnet only - RoCE does not support: Multicast traffic, VLAN, Layer 3 feature - ND tests nd_write_bw/lat, nd_read_bw/lat are not functional in Windows 2008 R2. When running them, they fail and the following message is displayed: "NDOpenAdapter failed" Mellanox Known Performance Issues with WinOF 4.40 - When using WinOF 4.40 or later, low throughput will be seen on 40GbE adapters when QoS is enabled. Disable QoS when it is not in use. Open a PowerShell prompt. Run: Disable-NetAdapter-Qos -name where is, for example, "Ethernet 1" - Perf_tuning is supported only when one of the two NUMA nodes are in use.