|
Replies:
4
-
Last Post:
Nov 8, 2009 2:44 AM
by: nwsmith
|
|
|
Posts:
10
From:
US
Registered:
11/4/09
|
|
|
|
fcoe port state offline and Current Speed: not established
Posted:
Nov 4, 2009 4:59 PM
To: Communities » storage » discuss
|
|
Hi,
I have configured one fcoe init port on intel ixgbe0 int on open solaris and after looking fcoe port status, i found the port state is offline and speed is not established. This open solaris box n/w interface is connected to a cisco nexus 5020 switch. On the cisco side, the interface shows up and speed is at 10G. I am not able to debug why the n/w interface is showing fcoe port state offline and speed not established. Any help/pointer is appreciated.
I have another n/w interface for management bge0
bash-3.2# fcinfo hba-port -e
HBA Port WWN: 2000001b211a5210
Port Mode: Initiator
Port ID: 0
OS Device Name: /dev/cfg/c3
Manufacturer: Sun Microsystems, Inc.
Model: FCoE Virtual FC HBA
Firmware Version: N/A
FCode/BIOS Version: N/A
Serial Number: N/A
Driver Name: SunFC FCoEI v20090729-1.00
Driver Version: 20090729-1.00
Type: unknown
State: offline
Supported Speeds: 1Gb 10Gb
Current Speed: not established
Node WWN: 1000001b211a5210
bash-3.2#
following are some logs from /var/adm/messages
Nov 4 13:01:01 unknown ip: [ID 462840 kern.error] ixgbe0: DL_BIND_REQ failed: DL_SYSERR (errno 16)
Nov 4 13:01:08 unknown last message repeated 2 times
Nov 4 13:02:23 unknown ip: [ID 462840 kern.error] ixgbe0: DL_BIND_REQ failed: DL_SYSERR (errno 16)
Nov 4 13:02:50 unknown last message repeated 2 times
Nov 4 13:02:52 unknown mac: [ID 486395 kern.info] NOTICE: ixgbe0 link down
Nov 4 13:02:52 unknown fcoei: [ID 235263 kern.notice] NOTICE: 2000001b211a5210 Link down
Nov 4 16:27:12 unknown bnx: [ID 328528 kern.info] NOTICE: bnx0: Copper link is up (1000Mbps, Full Duplex, Tx & Rx Flow Control ON)
Nov 4 16:33:09 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
Nov 4 16:43:09 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
Nov 4 16:48:09 unknown last message repeated 1 time
Nov 4 16:49:34 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
from the log message, i see it says,
bnx0 interface is up. I am not sure from where this message is coming ? Do i have this interface plugged in ? (i dont know...!)
bash-3.2# ifconfig 0a
ifconfig: status: SIOCGLIFFLAGS: 0a: no such interface
bash-3.2# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
bge0: flags=1004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4> mtu 1500 index 2
inet 10.13.107.166 netmask fffffe00 broadcast 10.13.107.255
ether 0:10:18:4:97:63
ixgbe0: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4> mtu 2500 index 4
inet 0.0.0.0 netmask 0
ether 0:1b:21:1a:52:10
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252 index 1
inet6 ::1/128
bash-3.2#
|
|
|
Posts:
50
From:
CN
Registered:
12/2/07
|
|
|
|
Re: [storage-discuss] fcoe port state offline and Current Speed:
not established
Posted:
Nov 5, 2009 6:57 PM
in response to: nkdas
|
|
What is the system software version of your NX5020 switch?
Niranjan Das wrote:
> Hi,
> I have configured one fcoe init port on intel ixgbe0 int on open solaris and after looking fcoe port status, i found the port state is offline and speed is not established. This open solaris box n/w interface is connected to a cisco nexus 5020 switch. On the cisco side, the interface shows up and speed is at 10G. I am not able to debug why the n/w interface is showing fcoe port state offline and speed not established. Any help/pointer is appreciated.
>
> I have another n/w interface for management bge0
>
> bash-3.2# fcinfo hba-port -e
> HBA Port WWN: 2000001b211a5210
> Port Mode: Initiator
> Port ID: 0
> OS Device Name: /dev/cfg/c3
> Manufacturer: Sun Microsystems, Inc.
> Model: FCoE Virtual FC HBA
> Firmware Version: N/A
> FCode/BIOS Version: N/A
> Serial Number: N/A
> Driver Name: SunFC FCoEI v20090729-1.00
> Driver Version: 20090729-1.00
> Type: unknown
> State: offline
> Supported Speeds: 1Gb 10Gb
> Current Speed: not established
> Node WWN: 1000001b211a5210
> bash-3.2#
>
>
> following are some logs from /var/adm/messages
>
> Nov 4 13:01:01 unknown ip: [ID 462840 kern.error] ixgbe0: DL_BIND_REQ failed: DL_SYSERR (errno 16)
> Nov 4 13:01:08 unknown last message repeated 2 times
> Nov 4 13:02:23 unknown ip: [ID 462840 kern.error] ixgbe0: DL_BIND_REQ failed: DL_SYSERR (errno 16)
> Nov 4 13:02:50 unknown last message repeated 2 times
> Nov 4 13:02:52 unknown mac: [ID 486395 kern.info] NOTICE: ixgbe0 link down
> Nov 4 13:02:52 unknown fcoei: [ID 235263 kern.notice] NOTICE: 2000001b211a5210 Link down
> Nov 4 16:27:12 unknown bnx: [ID 328528 kern.info] NOTICE: bnx0: Copper link is up (1000Mbps, Full Duplex, Tx & Rx Flow Control ON)
> Nov 4 16:33:09 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
> Nov 4 16:43:09 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
> Nov 4 16:48:09 unknown last message repeated 1 time
> Nov 4 16:49:34 unknown gnome-session[919]: [ID 702911 daemon.warning] WARNING: Could not connect to ConsoleKit: Could not get owner of name 'org.freedesktop.ConsoleKit': no such name
>
> from the log message, i see it says,
> bnx0 interface is up. I am not sure from where this message is coming ? Do i have this interface plugged in ? (i dont know...!)
>
> bash-3.2# ifconfig 0a
> ifconfig: status: SIOCGLIFFLAGS: 0a: no such interface
> bash-3.2# ifconfig -a
> lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
> inet 127.0.0.1 netmask ff000000
> bge0: flags=1004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4> mtu 1500 index 2
> inet 10.13.107.166 netmask fffffe00 broadcast 10.13.107.255
> ether 0:10:18:4:97:63
> ixgbe0: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4> mtu 2500 index 4
> inet 0.0.0.0 netmask 0
> ether 0:1b:21:1a:52:10
> lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252 index 1
> inet6 ::1/128
> bash-3.2#
>
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
|
|
|
|
|
Posts:
10
From:
US
Registered:
11/4/09
|
|
|
|
Re: [storage-discuss] fcoe port state offline and Current Speed: not established
Posted:
Nov 6, 2009 4:21 PM
in response to: zhongw
To: Communities » storage » discuss
|
|
The whole issue seems a bit more interesting now. As per previous post, where it was mentioned that FIP was not supported on OSol yet and that could cause the port state remained offline and speed not established when connected to a cisco Nuova switch 5020. I have disconnected the cable from cisco switch and tried to configure the port afresh without any wire connected to it.
This time too after creating fcoe port, the port state remains offline and speed not established. Is this a correct behaviour or some thing worng with the configs ?
3.2# tail -f /var/adm/messages
Nov 6 14:46:26 unknown genunix: [ID 408114 kern.info] /fcoe/fcoei@9,0 (fcoei1) online
Nov 6 14:46:27 unknown fcsm: [ID 517869 kern.info] NOTICE: fcsm(1): attached to path /fcoe/fcoei@9,0/fp@0,0
Nov 6 14:46:27 unknown genunix: [ID 936769 kern.info] fp1 is /fcoe/fcoei@9,0/fp@0,0
Nov 6 14:46:27 unknown genunix: [ID 408114 kern.info] /fcoe/fcoei@9,0/fp@0,0 (fp1) online
Nov 6 14:48:04 unknown genunix: [ID 936769 kern.info] fcoet0 is /fcoe/fcoet@a,0
Nov 6 14:48:04 unknown genunix: [ID 408114 kern.info] /fcoe/fcoet@a,0 (fcoet0) online
Nov 6 14:48:45 unknown ip: [ID 479224 kern.error] ixgbe1: DL_BIND_REQ failed: DL_SYSERR (errno 16)
Nov 6 14:48:45 unknown ip: [ID 272061 kern.error] ixgbe1: DL_UNBIND_REQ failed: DL_OUTSTATE
Nov 6 14:49:02 unknown ip: [ID 495608 kern.error] ixgbe2: DL_BIND_REQ failed: DL_SYSERR (errno 16)
Nov 6 14:49:02 unknown ip: [ID 403133 kern.error] ixgbe2: DL_UNBIND_REQ failed: DL_OUTSTATE
bash-3.2# fcinfo hba-port -e
HBA Port WWN: 2000001b21434c00
Port Mode: Initiator
Port ID: 0
OS Device Name: /dev/cfg/c4
Manufacturer: Sun Microsystems, Inc.
Model: FCoE Virtual FC HBA
Firmware Version: N/A
FCode/BIOS Version: N/A
Serial Number: N/A
Driver Name: SunFC FCoEI v20090729-1.00
Driver Version: 20090729-1.00
Type: unknown
State: offline
Supported Speeds: 1Gb 10Gb
Current Speed: not established
Node WWN: 1000001b21434c00
HBA Port WWN: 2000001b21434c01
Port Mode: Target
Port ID: 0
OS Device Name: Not Applicable
Manufacturer: Sun Microsystems, Inc.
Model: FCoE Virtual FC HBA
Firmware Version: N/A
FCode/BIOS Version: N/A
Serial Number: N/A
Driver Name: COMSTAR FCoET
Driver Version: v20090729-1.01
Type: unknown
State: offline
Supported Speeds: 1Gb 10Gb
Current Speed: not established
Node WWN: 1000001b21434c01
bash-3.2#
bash-3.2#
bash-3.2# fcinfo hba-port -e
HBA Port WWN: 2000001b21434c00
Port Mode: Initiator
Port ID: 0
OS Device Name: /dev/cfg/c4
Manufacturer: Sun Microsystems, Inc.
Model: FCoE Virtual FC HBA
Firmware Version: N/A
FCode/BIOS Version: N/A
Serial Number: N/A
Driver Name: SunFC FCoEI v20090729-1.00
Driver Version: 20090729-1.00
Type: unknown
State: offline
Supported Speeds: 1Gb 10Gb
Current Speed: not established
Node WWN: 1000001b21434c00
HBA Port WWN: 2000001b21434c01
Port Mode: Target
Port ID: 0
OS Device Name: Not Applicable
Manufacturer: Sun Microsystems, Inc.
Model: FCoE Virtual FC HBA
Firmware Version: N/A
FCode/BIOS Version: N/A
Serial Number: N/A
Driver Name: COMSTAR FCoET
Driver Version: v20090729-1.01
Type: unknown
State: offline
Supported Speeds: 1Gb 10Gb
Current Speed: not established
Node WWN: 1000001b21434c01
bash-3.2#
bash-3.2#
Another problem is, when the driver is plumbed creating fcoe port fails with the following messgae
bash-3.2# fcadm create-fcoe-port ixgbe2
Error: Failed to open the specified MAC link
bash-3.2#
bash-3.2# fcadm create-fcoe-port ixgbe2
Error: Failed to open the specified MAC link
bash-3.2#
Only when the driver is unplumbed the fcoe port create goes through. Is that correct behaviour ?
Any suggestion/comment is appreciated.
Thanks
Niranjan
|
|
|
|
|
Posts:
50
From:
CN
Registered:
12/2/07
|
|
|
|
Re: [storage-discuss] fcoe port state offline and Current Speed:
not established
Posted:
Nov 6, 2009 5:48 PM
in response to: nkdas
|
|
Niranjan Das wrote:
> The whole issue seems a bit more interesting now. As per previous post, where it was mentioned that FIP was not supported on OSol yet and that could cause the port state remained offline and speed not established when connected to a cisco Nuova switch 5020. I have disconnected the cable from cisco switch and tried to configure the port afresh without any wire connected to it.
>
> This time too after creating fcoe port, the port state remains offline and speed not established. Is this a correct behaviour or some thing worng with the configs ?
>
This is expected behavior. Without a physical link for the NIC, FCoE
ports will stay in the offline state, with port id "0", port type
"unknown" and speed "not established".
In a fabric topology, only after a successful FLOGI, will the port state
change to "online" with a valid port id assigned by the fabric, port
type "N_Port" and speed of 1G or 10G according to the physical link rate.
> 3.2# tail -f /var/adm/messages
> Nov 6 14:46:26 unknown genunix: [ID 408114 kern.info] /fcoe/fcoei@9,0 (fcoei1) online
> Nov 6 14:46:27 unknown fcsm: [ID 517869 kern.info] NOTICE: fcsm(1): attached to path /fcoe/fcoei@9,0/fp@0,0
> Nov 6 14:46:27 unknown genunix: [ID 936769 kern.info] fp1 is /fcoe/fcoei@9,0/fp@0,0
> Nov 6 14:46:27 unknown genunix: [ID 408114 kern.info] /fcoe/fcoei@9,0/fp@0,0 (fp1) online
> Nov 6 14:48:04 unknown genunix: [ID 936769 kern.info] fcoet0 is /fcoe/fcoet@a,0
> Nov 6 14:48:04 unknown genunix: [ID 408114 kern.info] /fcoe/fcoet@a,0 (fcoet0) online
> Nov 6 14:48:45 unknown ip: [ID 479224 kern.error] ixgbe1: DL_BIND_REQ failed: DL_SYSERR (errno 16)
> Nov 6 14:48:45 unknown ip: [ID 272061 kern.error] ixgbe1: DL_UNBIND_REQ failed: DL_OUTSTATE
> Nov 6 14:49:02 unknown ip: [ID 495608 kern.error] ixgbe2: DL_BIND_REQ failed: DL_SYSERR (errno 16)
> Nov 6 14:49:02 unknown ip: [ID 403133 kern.error] ixgbe2: DL_UNBIND_REQ failed: DL_OUTSTATE
>
> bash-3.2# fcinfo hba-port -e
> HBA Port WWN: 2000001b21434c00
> Port Mode: Initiator
> Port ID: 0
> OS Device Name: /dev/cfg/c4
> Manufacturer: Sun Microsystems, Inc.
> Model: FCoE Virtual FC HBA
> Firmware Version: N/A
> FCode/BIOS Version: N/A
> Serial Number: N/A
> Driver Name: SunFC FCoEI v20090729-1.00
> Driver Version: 20090729-1.00
> Type: unknown
> State: offline
> Supported Speeds: 1Gb 10Gb
> Current Speed: not established
> Node WWN: 1000001b21434c00
> HBA Port WWN: 2000001b21434c01
> Port Mode: Target
> Port ID: 0
> OS Device Name: Not Applicable
> Manufacturer: Sun Microsystems, Inc.
> Model: FCoE Virtual FC HBA
> Firmware Version: N/A
> FCode/BIOS Version: N/A
> Serial Number: N/A
> Driver Name: COMSTAR FCoET
> Driver Version: v20090729-1.01
> Type: unknown
> State: offline
> Supported Speeds: 1Gb 10Gb
> Current Speed: not established
> Node WWN: 1000001b21434c01
> bash-3.2#
> bash-3.2#
> bash-3.2# fcinfo hba-port -e
> HBA Port WWN: 2000001b21434c00
> Port Mode: Initiator
> Port ID: 0
> OS Device Name: /dev/cfg/c4
> Manufacturer: Sun Microsystems, Inc.
> Model: FCoE Virtual FC HBA
> Firmware Version: N/A
> FCode/BIOS Version: N/A
> Serial Number: N/A
> Driver Name: SunFC FCoEI v20090729-1.00
> Driver Version: 20090729-1.00
> Type: unknown
> State: offline
> Supported Speeds: 1Gb 10Gb
> Current Speed: not established
> Node WWN: 1000001b21434c00
> HBA Port WWN: 2000001b21434c01
> Port Mode: Target
> Port ID: 0
> OS Device Name: Not Applicable
> Manufacturer: Sun Microsystems, Inc.
> Model: FCoE Virtual FC HBA
> Firmware Version: N/A
> FCode/BIOS Version: N/A
> Serial Number: N/A
> Driver Name: COMSTAR FCoET
> Driver Version: v20090729-1.01
> Type: unknown
> State: offline
> Supported Speeds: 1Gb 10Gb
> Current Speed: not established
> Node WWN: 1000001b21434c01
> bash-3.2#
> bash-3.2#
>
>
> Another problem is, when the driver is plumbed creating fcoe port fails with the following messgae
> bash-3.2# fcadm create-fcoe-port ixgbe2
> Error: Failed to open the specified MAC link
> bash-3.2#
> bash-3.2# fcadm create-fcoe-port ixgbe2
> Error: Failed to open the specified MAC link
> bash-3.2#
>
> Only when the driver is unplumbed the fcoe port create goes through. Is that correct behaviour ?
>
Yes, that is. For now Solaris FCoE ports use the network interfaces
exclusively.
Regards,
Zhong
> Any suggestion/comment is appreciated.
>
> Thanks
> Niranjan
>
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
|
|
|
|
|
Posts:
426
From:
GB
Registered:
3/21/06
|
|
|
|
Re: [storage-discuss] fcoe port state offline and Current Speed: not established
Posted:
Nov 8, 2009 2:44 AM
in response to: nkdas
To: Communities » storage » discuss
|
|
I've just noticed that the 'ixgbe' driver has been updated.
Most of the changes seem to me to be related to link negotiation.
6873301 ixgbe shared code update (version 3.1.9)
http://bugs.opensolaris.org/view_bug.do?bug_id=6873301
http://hg.genunix.org/onnv-gate.hg/rev/fa3b21f3b03c
Update will be in snv_128.
So I guess this could maybe make a different in your scenario...
Regards
Nigel Smith
|
|
|
|
|
