• December 02, 2020, 02:24:05 PM
Welcome, Guest. Please login or register. Registration is free.
Did you miss your activation email?

Author Topic: 10Gbe link between IBM virtual fabric and VSP7k  (Read 2581 times)

0 Members and 1 Guest are viewing this topic.

Offline kristjanhinn

  • Jr. Member
  • **
  • Posts: 25
    • http://ee.linkedin.com/pub/kristjan-hinn/5b/b55/a17
10Gbe link between IBM virtual fabric and VSP7k
« on: July 09, 2014, 08:03:35 AM »
Hello,

I have two IBM virtual fabric 10Gb switch module for bladecenter connected to VSP7k IST (topology shown below). Everything seems to be working fine but im seeing input errors on bladecenter switches on port EXT1 and i dont like it. Seems like VSP7k is talking something bladecenter switch that bladecenter switch does not understand. I cant use wireshark because i only have ESXi servers with 10Gbe cards. And rack server does not have any errors. ESXi is running version 5.1 and network card driver is updated to latest VMware supported version. Also blade fw have updated to latest HS23 firmwares.
IBM switch has IBM original SFP+ multimode module and VSP7k has original Avaya SFP+ multimode module. Autoneg is disabled on both sides. Jumbo frames are enabled on esxi hosts.
Btw both blade switches port EXT1 have almost the same amount of Errors.

Anyone have any idea how can i debug this further?

I sketched my topology

All links are 10Gbe!
EXT1 interface is having Errors but not vsp7k 1/20. Also EXT2 is error free

Viewing EXT1 from bladecenter switch


Viewing 1/20 from VSP7k


Any help appreciated
Kristjan
« Last Edit: July 09, 2014, 08:08:25 AM by kristjanhinn »


Offline Dominik

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1564
    • Networkautobahn
Re: 10Gbe link between IBM virtual fabric and VSP7k
« Reply #1 on: July 09, 2014, 07:22:04 PM »
Looks like it is an internal problem inside the IBM virtual Fabric module.

Do you have tried to move the server blade to an other slot in your bladecenter.

Itīs always the networks fault!
networkautobahn.com

Offline kristjanhinn

  • Jr. Member
  • **
  • Posts: 25
    • http://ee.linkedin.com/pub/kristjan-hinn/5b/b55/a17
Re: 10Gbe link between IBM virtual fabric and VSP7k
« Reply #2 on: July 10, 2014, 01:31:51 AM »
No i have not tryed to move blades. But the problem is on external link between vsp7k and ibm switch not on internal ports.

May it be because im using jumbo frames on esxi hosts?

i found something like this from cli

Receive length out-of-range packet counter.
HW: MAC_GRxFLR : 197291

what this could mean?
« Last Edit: July 10, 2014, 03:39:17 AM by kristjanhinn »

Offline Dominik

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1564
    • Networkautobahn
Re: 10Gbe link between IBM virtual fabric and VSP7k
« Reply #3 on: July 10, 2014, 04:48:59 AM »
The VSP7k has jumbo frames enabled by dafault.
Does your IBM virtual fabric modul support junbo frames and do you have the feature enabled ?
Itīs always the networks fault!
networkautobahn.com

Offline kristjanhinn

  • Jr. Member
  • **
  • Posts: 25
    • http://ee.linkedin.com/pub/kristjan-hinn/5b/b55/a17
Re: 10Gbe link between IBM virtual fabric and VSP7k
« Reply #4 on: July 10, 2014, 04:52:48 AM »
IBM switch manual says

The Virtual Fabric 10Gb Switch Module (VFSM) supports jumbo frames with a Maximum
Transmission Unit (MTU) of 9,216 bytes. Within each frame, 18 bytes are reserved for the Ethernet
header and CRC trailer. The remaining space in the frame (up to 9,198 bytes) comprise the packet,
which includes the payload of up to 9,000 bytes and any additional overhead, such as 802.1q or
VLAN tags. Jumbo frame support is automatic: it is enabled by default, requires no manual
configuration, and cannot be manually disabled.


I have configured Jumbo Frame 9000 bytes on ESXi hosts.
« Last Edit: July 10, 2014, 04:57:03 AM by kristjanhinn »