18 Replies Latest reply: Feb 23, 2014 9:03 AM by MYNETAPP_ RSS

FAS3250 interconnect error

klemen.bregar
Currently Being Moderated

Hi!

 

We try to set up a FAS3250 cluster (7mode).

 

- System is two chassis configuration.

- Both filers have cluster licenses

- Every filer has partner-sysid (printenv partner-sysid)

- We use ports c0a and c0b for connection between filers (c0a -> c0a and c0b -> c0b)

- Each filer can see others filer disks (sysconfig-r output)

- cluster is enabled

 

The problem is that we have interconnect error. Cables are connected and there is no connection, we also try other cables and there is still no connection between filers.

 

Here are errors:

netappDEMO01*> cf status

netappDEMO02 is up, takeover disabled because of reason (interconnect error)

netappDEMO01 has disabled takeover by netappDEMO02 (interconnect error)

RDMA Interconnect is down (Link 0 down, Link 1 down).

netappDEMO01*>

 

netappDEMO01*> cf monitor

  current time: 22Feb2013 10:06:25

  UP 20:26:04, partner 'netappDEMO02', cluster monitor enabled

  RDMA Interconnect is down (Link 0 down, Link 1 down), takeover capability off-line (interconnect error)

  takeover by partner off-line (interconnect error)

  partner update TAKEOVER_DISABLED (22Feb2013 10:06:22)

 

        netappDEMO01*> ic status

        Link 0: down

        Link 1: down

        IC RDMA connection : down


                slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                Device Type:        CT-FE-3

                Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                Serial Number:      jb04050693

                c0a MAC Address:    00:a0:98:38:02:fe (auto-unknown-enabling)

                c0b MAC Address:    00:a0:98:38:02:ff (auto-unknown-enabling)

 

 

netappDEMO01*> ic config show

Interconnect Type: iWARP

  Local System ID: 20145XXXXXX

Partner System ID: 20145XXXXX

c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.1.126 netmask 0xffffff00 broadcast 192.168.1.255

        ether 00:a0:98:38Fri Feb:03:fe (auto-unknown-enabling) flowcontrol full

c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.2.177 netmask 0xffffff00 broadcast 192.168.2.255

        ether 00:a0:98:38:03:ff (auto-unknown-enabling) flowcontro 22 10:l full

 

 

In syslogs we get this errror: Failover is licensed but takeover of partner is disabled due to reason : interconnect error.

 

The question is how to enable or repair this connection between two filers? They are aware of each other but there is no link between them.

 

Does anybody know what is the problem here?

 

Thank you!

 

With regards,

Klemen

  • Re: FAS3250 interconnect error
    aborzenkov
    Currently Being Moderated

    Is it new installation or it worked before?

    • Re: FAS3250 interconnect error
      klemen.bregar
      Currently Being Moderated

      New system. It was shipped as clustered ontap.

      Also, we have done "set-defaults".

       

      Klemen

      • Re: FAS3250 interconnect error
        klemen.bregar
        Currently Being Moderated

        i have also try this, result is the same...

         

        netappDEMO01*> ic link off 0

        Fri FebFri Feb 22 10 22 10::37:50 CET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be o37:50 Cn dedicated management subnets.

        ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.1netappDEMO01*> 68.8.200' configured Fri Feb 22 10:37:50 Con dataET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

        port e0a. Management IP addresses must be on dedicated management subnets.

        Fri Feb 22 10:37:50 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

         

         

        netappDEMO01*>

        netappDEMO01*> ic link off 1

        netappDEMO01*> Fri FebFri Feb 22 10:37:56 CET [neta 22 10:ppDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

        37:56 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

         

         

        netappDEMO01*> ic link on 1

        netappDEMO01*> Fri FebFri Feb 22 10:38:31 CET [ne 22 10:tappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated ma38:31 Cnagement subnets.

        ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated management subnets.

        ic link on 0

        netappDEMO01*> ic link on 0

        interface 0 is already up

        netappDEMO01*>

        netappDEMO01*>

        netappDEMO01*> Fri FebFri Feb 22 10:38:39 CET [netappDEMO01:netif.linkInfo:info 22 10:]: Ethernet c0b: Link configured down.

        38:39 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

         

         

        netappDEMO01*> Fri FebFri Feb 22 10:38:42 CET [netapp 22 10:DEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

        38:42 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

         

         

        netappDEMO01*>

        netappDEMO01*> ic status

                Link 0: down

                Link 1: down

                IC RDMA connection : down

        netappDEMO01*>

        • Re: FAS3250 interconnect error
          martin.fisher
          Currently Being Moderated

          Hi - First thing i would check is the IP addresses used for you interfaces. The console is display these error messages:

          netappDEMO01*> Fri FebFri Feb 22 10:38:31 CET [ne 22 10:tappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated ma38:31 Cnagement subnets.

          ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated management subnets.

          ic link on 0

           

          it appears as though you have IP Address set on the management interface (e0M) which is in the same subnet as one set physical interface e0a. This will cause problems as the appliance wont no where to route your IC traffic, or your IC traffic is routing out of your e0a interface!. The management nic's e0m, need there own subnet. ie 192.168.8.x and other interfaces or interface groups need a separate one, ie 192.168.9.x

      • Re: FAS3250 interconnect error
        aborzenkov
        Currently Being Moderated

        Have you verified that correct ports are connected? No kidding, mistakes happen.

         

        Have you verified you used the correct cables? How they are marked?

         

        I would cf disable, removing CF license, reboot, verify systems came up as standalone and then re-enabling

        • Re: FAS3250 interconnect error
          klemen.bregar
          Currently Being Moderated

          hi!

           

          i have checked: c0a --> c0a and c0b --> c0b (still no lights)

           

          i have done all as you said, result is the same:

           

          netappDEMO01> cf status

          netappDEMO02 is up, takeover disabled because of reason (interconnect error)

          netappDEMO01 has disabled takeover by netappDEMO02 (interconnect error)

          RDMA Interconnect is down (Link 0 down, Link 1 down).

          netappDEMO01>

          netappDEMO01> cf monitor

            current time: 22Feb2013 15:29:09

            UP 00:03:08, partner 'netappDEMO02', cluster monitor enabled

            RDMA Interconnect is down (Link 0 down, Link 1 down), takeover capability off-line (interconnect error)

            takeover by partner off-line (interconnect error)

            partner update TAKEOVER_DISABLED (22Feb2013 15:29:09)

          netappDEMO01>

           

          netappDEMO01> ic status

           

          netappDEMO01*> ic status

                  Link 0: down

                  Link 1: down

                  IC RDMA con

           

           

          with regards,

          Klemen

          • Re: FAS3250 interconnect error
            martin.fisher
            Currently Being Moderated

            what is output of the ifconfig -a command if you can post it please?

            • Re: FAS3250 interconnect error
              klemen.bregar
              Currently Being Moderated

              hi!

               

              i have removed e0a port on both systems. The same problem.

               

              output:

               

              netappDEMO02> ifconfig -a

              e0a: flags=0x2f0c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

                      ether 00:a0:98:38:02:fc (auto-1000t-fd-up) flowcontrol full

              e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

                      ether 00:a0:98:38:02:fd (auto-unknown-down) flowcontrol full

              e1a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:83:2c (auto-unknown-down) flowcontrol full

              e1b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:83:2d (auto-unknown-down) flowcontrol full

              e2a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:7b:3c (auto-unknown-down) flowcontrol full

              e2b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:7b:3d (auto-unknown-down) flowcontrol full

              c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.1.70 netmask 0xffffff00 broadcast 192.168.1.255

                      ether 00:a0:98:38:02:fe (auto-unknown-enabling) flowcontrol full

              c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.2.158 netmask 0xffffff00 broadcast 192.168.2.255

                      ether 00:a0:98:38:02:ff (auto-unknown-enabling) flowcontrol full

              e0M: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500

                      inet 192.168.8.203 netmask 0xffffff00 broadcast 192.168.8.255 noddns

                      partner inet 192.168.8.201 (not in use)

                      ether 00:a0:98:38:03:00 (auto-100tx-fd-up) flowcontrol full

              e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE

                      inet 192.168.1.176 netmask 0xfffffc00 broadcast 192.168.3.255 noddns

                      ether 00:a0:98:38:03:01 (auto-100tx-fd-up) flowcontrol full

              lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160

                      inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1

                      ether 00:00:00:00:00:00 (RNIC Provider)

              losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188

                      inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1

              netappDEMO02>

               

               

              netappDEMO01*> ifconfig -a

              e0a: flags=0x2f0c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

                      ether 00:a0:98:38:03:fc (auto-1000t-fd-up) flowcontrol full

              e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

                      ether 00:a0:98:38:03:fd (auto-unknown-down) flowcontrol full

              e1a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2e:37:08 (auto-unknown-down) flowcontrol full

              e1b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2e:37:09 (auto-unknown-down) flowcontrol full

              e2a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:82:f0 (auto-unknown-down) flowcontrol full

              e2b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

                      ether 90:e2:ba:2f:82:f1 (auto-unknown-down) flowcontrol full

              c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.1.230 netmask 0xffffff00 broadcast 192.168.1.255

                      ether 00:a0:98:38:03:fe (auto-unknown-enabling) flowcontrol full

              c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.2.9 netmask 0xffffff00 broadcast 192.168.2.255

                      ether 00:a0:98:38:03:ff (auto-unknown-enabling) flowcontrol full

              e0M: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500

                      inet 192.168.8.201 netmask 0xffffff00 broadcast 192.168.8.255 noddns

                      partner inet 192.168.8.203 (not in use)

                      ether 00:a0:98:38:04:00 (auto-100tx-fd-up) flowcontrol full

              e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE

                      inet 192.168.1.167 netmask 0xfffffc00 broadcast 192.168.3.255 noddns

                      ether 00:a0:98:38:04:01 (auto-100tx-fd-up) flowcontrol full

              lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160

                      inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1

                      ether 00:00:00:00:00:00 (RNIC Provider)

              losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188

                      inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1

              netappDEMO01*>

               

               

              netappDEMO01*> ic config show

              Interconnect Type: iWARP

                Local System ID: 2014xxxxxx

              Partner System ID: 2014xxxxx

              c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.1.230 netmask 0xffffff00 broadcast 192.168.1.255

                      ether 00:a0:98:38:03:fe (auto-unknown-down) flowcontrol full

              c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

                      inet 192.168.2.9 netmask 0xffffff00 broadcast 192.168.2.255

                      ether 00:a0:98:38:03:ff (auto-unknown-down) flowcontrol full

              netappDEMO01*>

               

               

              Klemen

              • Re: FAS3250 interconnect error
                dlira
                Currently Being Moderated

                You can send the output of the following command

                sysconfig -a 0

                • Re: FAS3250 interconnect error
                  klemen.bregar
                  Currently Being Moderated

                  Hi!

                   

                  Here is output:

                   

                  netappDEMO02> sysconfig -a 0

                          slot 0: System Board 2.3 GHz (System Board XVI B1)

                                  Model Name:         FAS3250

                                  Part Number:        111-01062

                                  Revision:           B1

                                  Serial Number:      xxxxxxxxx

                                  BIOS version:       5.2.0

                                  Loader version:     3.4

                                  Processors:         8

                                  Processor ID:       0x1067a

                                  Microcode Version:  0xa0b

                                  Processor type:     Intel(R) Xeon(R) CPU           L5410  @ 2.33GHz

                                  Memory Size:        20480 MB

                                  Memory Attributes:  Bank Interleaving

                                                      Hoisting

                                                      Rank Interleaving

                                                      Chipkill ECC

                                  NVMEM Size:         2000 MB of Main Memory Used

                                  CMOS RAM Status:    OK

                          Service Processor           Status: Online

                                  Firmware Version:   1.3.1

                                  Mgmt MAC Address:   00:A0:98:38:03:02

                                  Ethernet Link:      up, 100Mb, full duplex, auto-neg complete

                                  Using DHCP:         yes

                          IPv4 configuration:

                                  IP Address:         192.168.8.111

                                  Netmask:            255.255.255.0

                                  Gateway:            192.168.8.1

                          IPv6 configuration:         Disabled

                          IOXM                        Status: present

                                  Power:              Good

                                  Agent version:      N/A

                                  Serial Number:      9409837074

                                  Part Number:        111-00647

                                  Version:            C0

                          slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                                  Device Type:        CT-FE-3

                                  Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                                  Serial Number:      jb04050693

                                  c0a MAC Address:    00:a0:98:38:02:fe (auto-unknown-enabling)

                                  c0b MAC Address:    00:a0:98:38:02:ff (auto-unknown-enabling)

                                          memory mapped I/O base 0xde801000, size 0x1000

                                          memory mapped I/O base 0xde000000, size 0x800000

                                          memory mapped I/O base 0xde800000, size 0x1000

                          slot 0: Internal BGE 10/100 Ethernet Controller

                                  e0M MAC Address:    00:a0:98:38:03:00 (auto-100tx-fd-up)

                                  e0P MAC Address:    00:a0:98:38:03:01 (auto-100tx-fd-up)

                                  Device Type:        BCM5721

                                          memory mapped I/O base 0xdfa00000, size 0x10000

                                          memory mapped I/O base 0xdfb00000, size 0x10000

                          slot 0: Dual 10/100/1000 Ethernet Controller G20

                                  e0a MAC Address:    00:a0:98:38:02:fc (auto-1000t-fd-up)

                                  e0b MAC Address:    00:a0:98:38:02:fd (auto-unknown-down)

                                  Device Type:        Rev 6

                                          memory mapped I/O base 0x00000000df920000, size 0x20000

                                          memory mapped I/O base 0x00000000df900000, size 0x20000

                                          I/O base 0x0000000000003000, size 0x20

                                          memory mapped I/O base 0x00000000df960000, size 0x20000

                                          memory mapped I/O base 0x00000000df940000, size 0x20000

                                          I/O base 0x0000000000003020, size 0x20

                          slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)

                                  Firmware rev:       01.11.00.00

                                  Base WWN:           5:00a098:0012a5f:88

                                  Phy State:          [0] Enabled, 3.0 Gb/s

                                                      [1] Enabled, 3.0 Gb/s

                                                      [2] Enabled, 3.0 Gb/s

                                                      [3] Enabled, 3.0 Gb/s

                                  QSFP Vendor:        Molex Inc.

                                  QSFP Part Number:   112-00178+A0

                                  QSFP Type:          Passive Copper 5m ID:00

                                  QSFP Serial Number: 223021420

                                  00.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYVYKVN)

                                  00.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWSN)

                                  00.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN5N)

                                  00.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTM0N)

                                  00.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTU7N)

                                  00.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTPVN)

                                  00.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU04N)

                                  00.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWYN)

                                  00.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU3WN)

                                  00.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTRYN)

                                  00.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4KN)

                                  00.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHDVN)

                                  00.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTHXN)

                                  00.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN7N)

                                  00.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTNYN)

                                  00.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4RN)

                                  00.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTJPN)

                                  00.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU03N)

                                  00.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHGDN)

                                  00.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPG9YN)

                                  00.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPLKBN)

                                  00.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYNKL2N)

                                  00.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYRBX1N)

                                  00.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPZ4KN)

                                  01.0 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900225)

                                  01.1 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900047)

                                  01.2 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900231)

                                  01.3 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900233)

                                  01.4 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900232)

                                  01.5 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900229)

                                  01.6 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J8357BHL)

                                  01.7 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83491VL)

                                  01.8 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83577WL)

                                  01.9 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83492UL)

                                  01.10: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82S8EYL)

                                  01.11: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82GUKHL)

                                  14.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60YVN)

                                  14.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXVN)

                                  14.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5KL5N)

                                  14.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXUN)

                                  14.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MKGN)

                                  14.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H1GN)

                                  14.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HY4N)

                                  14.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H50N)

                                  14.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6112N)

                                  14.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60J0N)

                                  14.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6A5PN)

                                  14.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60G2N)

                                  14.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MMMN)

                                  14.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MHAN)

                                  14.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5TSVN)

                                  14.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GYVN)

                                  14.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GXJN)

                                  14.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV607YN)

                                  14.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY17N)

                                  14.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY0SN)

                                  14.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV2D09N)

                                  14.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6093N)

                                  14.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HSSN)

                                  14.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60R7N)

                                  Shelf   0: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                                  Shelf   1: IOM3  Firmware rev. IOM3 A: 0151 IOM3 B: 0151

                                  Shelf  14: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                          slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)

                                  Firmware rev:       01.11.00.00

                                  Base WWN:           5:00a098:0012a5f:8c

                                  Phy State:          [4] Disabled

                                                      [5] Disabled

                                                      [6] Disabled

                                                      [7] Disabled

                                  QSFP Vendor:        not available

                                  QSFP Part Number:   not available

                                  QSFP Type:          not available

                                  QSFP Serial Number: not available

                                          memory mapped I/O base 0xdf830000, size 0x10000

                                          memory mapped I/O base 0xdf820000, size 0x10000

                                          memory mapped I/O base 0x00000000df810000, size 0x10000

                                          memory mapped I/O base 0x00000000df800000, size 0x10000

                          slot 0: FC Host Adapter 0c (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                                  Firmware rev:      5.4.100

                                  Host Loop Id:      0

                                  FC Node Name:      5:00a:098001:2a5f80

                                  FC Port Name:      5:00a:098001:2a5f80

                                  SFF Vendor:

                                  SFF Part Number:

                                  SFF Serial Number:

                                  SFF Capabilities:

                                  Link Data Rate:    N/A

                                          I/O base 0x0000000000002000, size 0x100

                                          memory mapped I/O base 0xdf700000, size 0x4000

                          slot 0: FC Host Adapter 0d (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                                  Firmware rev:      5.4.100

                                  Host Loop Id:      0

                                  FC Node Name:      5:00a:098101:2a5f80

                                  FC Port Name:      5:00a:098101:2a5f80

                                  SFF Vendor:

                                  SFF Part Number:

                                  SFF Serial Number:

                                  SFF Capabilities:

                                  Link Data Rate:    N/A

                                          I/O base 0x0000000000002400, size 0x100

                                          memory mapped I/O base 0xdf704000, size 0x4000

                          slot 0: Intel ICH USB EHCI Adapter u0a (0xdfc01400)

                                  boot0   Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (4BF0022700206173)

                                          memory-mapped I/O base 0xdfc01400, size 0x400

                  netappDEMO02>

                   

                  netappDEMO01*> sysconfig -a 0

                          slot 0: System Board 2.3 GHz (System Board XVI B1)

                                  Model Name:         FAS3250

                                  Part Number:        111-01062

                                  Revision:           B1

                                  Serial Number:      xxxxxxxxxxx

                                  BIOS version:       5.2.0

                                  Loader version:     3.4

                                  Processors:         8

                                  Processor ID:       0x1067a

                                  Microcode Version:  0xa0b

                                  Processor type:     Intel(R) Xeon(R) CPU           L5410  @ 2.33GHz

                                  Memory Size:        20480 MB

                                  Memory Attributes:  Bank Interleaving

                                                      Hoisting

                                                      Rank Interleaving

                                                      Chipkill ECC

                                  NVMEM Size:         2000 MB of Main Memory Used

                                  CMOS RAM Status:    OK

                          Service Processor           Status: Online

                                  Firmware Version:   1.3.1

                                  Mgmt MAC Address:   00:A0:98:38:04:02

                                  Ethernet Link:      up, 100Mb, full duplex, auto-neg complete

                                  Using DHCP:         yes

                          IPv4 configuration:

                                  IP Address:         192.168.8.113

                                  Netmask:            255.255.255.0

                                  Gateway:            192.168.8.1

                          IPv6 configuration:         Disabled

                          IOXM                        Status: present

                                  Power:              Good

                                  Agent version:      N/A

                                  Serial Number:      9409840928

                                  Part Number:        111-00647

                                  Version:            C0

                          slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                                  Device Type:        CT-FE-3

                                  Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                                  Serial Number:      jb04050693

                                  c0a MAC Address:    00:a0:98:38:03:fe (auto-unknown-down)

                                  c0b MAC Address:    00:a0:98:38:03:ff (auto-unknown-down)

                                          memory mapped I/O base 0xde801000, size 0x1000

                                          memory mapped I/O base 0xde000000, size 0x800000

                                          memory mapped I/O base 0xde800000, size 0x1000

                          slot 0: Internal BGE 10/100 Ethernet Controller

                                  e0M MAC Address:    00:a0:98:38:04:00 (auto-100tx-fd-up)

                                  e0P MAC Address:    00:a0:98:38:04:01 (auto-100tx-fd-up)

                                  Device Type:        BCM5721

                                          memory mapped I/O base 0xdfa00000, size 0x10000

                                          memory mapped I/O base 0xdfb00000, size 0x10000

                          slot 0: Dual 10/100/1000 Ethernet Controller G20

                                  e0a MAC Address:    00:a0:98:38:03:fc (auto-1000t-fd-up)

                                  e0b MAC Address:    00:a0:98:38:03:fd (auto-unknown-down)

                                  Device Type:        Rev 6

                                          memory mapped I/O base 0x00000000df920000, size 0x20000

                                          memory mapped I/O base 0x00000000df900000, size 0x20000

                                          I/O base 0x0000000000003000, size 0x20

                                          memory mapped I/O base 0x00000000df960000, size 0x20000

                                          memory mapped I/O base 0x00000000df940000, size 0x20000

                                          I/O base 0x0000000000003020, size 0x20

                          slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)

                                  Firmware rev:       01.11.00.00

                                  Base WWN:           5:00a098:0012a61:88

                                  Phy State:          [0] Enabled, 3.0 Gb/s

                                                      [1] Enabled, 3.0 Gb/s

                                                      [2] Enabled, 3.0 Gb/s

                                                      [3] Enabled, 3.0 Gb/s

                                  QSFP Vendor:        Molex Inc.

                                  QSFP Part Number:   112-00178+A0

                                  QSFP Type:          Passive Copper 5m ID:01

                                  QSFP Serial Number: 223021461

                                  00.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYVYKVN)

                                  00.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWSN)

                                  00.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN5N)

                                  00.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTM0N)

                                  00.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTU7N)

                                  00.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTPVN)

                                  00.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU04N)

                                  00.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWYN)

                                  00.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU3WN)

                                  00.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTRYN)

                                  00.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4KN)

                                  00.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHDVN)

                                  00.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTHXN)

                                  00.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN7N)

                                  00.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTNYN)

                                  00.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4RN)

                                  00.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTJPN)

                                  00.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU03N)

                                  00.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHGDN)

                                  00.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPG9YN)

                                  00.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPLKBN)

                                  00.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYNKL2N)

                                  00.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYRBX1N)

                                  00.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPZ4KN)

                                  01.0 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900225)

                                  01.1 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900047)

                                  01.2 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900231)

                                  01.3 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900233)

                                  01.4 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900232)

                                  01.5 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900229)

                                  01.6 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J8357BHL)

                                  01.7 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83491VL)

                                  01.8 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83577WL)

                                  01.9 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83492UL)

                                  01.10: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82S8EYL)

                                  01.11: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82GUKHL)

                                  14.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60YVN)

                                  14.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXVN)

                                  14.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5KL5N)

                                  14.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXUN)

                                  14.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MKGN)

                                  14.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H1GN)

                                  14.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HY4N)

                                  14.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H50N)

                                  14.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6112N)

                                  14.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60J0N)

                                  14.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6A5PN)

                                  14.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60G2N)

                                  14.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MMMN)

                                  14.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MHAN)

                                  14.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5TSVN)

                                  14.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GYVN)

                                  14.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GXJN)

                                  14.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV607YN)

                                  14.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY17N)

                                  14.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY0SN)

                                  14.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV2D09N)

                                  14.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6093N)

                                  14.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HSSN)

                                  14.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60R7N)

                                  Shelf   0: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                                  Shelf   1: IOM3  Firmware rev. IOM3 A: 0151 IOM3 B: 0151

                                  Shelf  14: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                          slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)

                                  Firmware rev:       01.11.00.00

                                  Base WWN:           5:00a098:0012a61:8c

                                  Phy State:          [4] Disabled

                                                      [5] Disabled

                                                      [6] Disabled

                                                      [7] Disabled

                                  QSFP Vendor:        not available

                                  QSFP Part Number:   not available

                                  QSFP Type:          not available

                                  QSFP Serial Number: not available

                                          memory mapped I/O base 0xdf830000, size 0x10000

                                          memory mapped I/O base 0xdf820000, size 0x10000

                                          memory mapped I/O base 0x00000000df810000, size 0x10000

                                          memory mapped I/O base 0x00000000df800000, size 0x10000

                          slot 0: FC Host Adapter 0c (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                                  Firmware rev:      5.4.100

                                  Host Loop Id:      0

                                  FC Node Name:      5:00a:098001:2a6180

                                  FC Port Name:      5:00a:098001:2a6180

                                  SFF Vendor:

                                  SFF Part Number:

                                  SFF Serial Number:

                                  SFF Capabilities:

                                  Link Data Rate:    N/A

                                          I/O base 0x0000000000002000, size 0x100

                                          memory mapped I/O base 0xdf700000, size 0x4000

                          slot 0: FC Host Adapter 0d (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                                  Firmware rev:      5.4.100

                                  Host Loop Id:      0

                                  FC Node Name:      5:00a:098101:2a6180

                                  FC Port Name:      5:00a:098101:2a6180

                                  SFP Vendor:        AVAGO

                                  SFP Part Number:   AFBR-57R6APZ-NA1

                                  SFP Serial Number: B812320H06

                                  SFP Capabilities:  1, 2 or 4 Gbit

                                  Link Data Rate:    N/A

                                          I/O base 0x0000000000002400, size 0x100

                                          memory mapped I/O base 0xdf704000, size 0x4000

                          slot 0: Intel ICH USB EHCI Adapter u0a (0xdfc01400)

                                  boot0   Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (4BF0022700206091)

                                          memory-mapped I/O base 0xdfc01400, size 0x400

                  netappDEMO01*>

  • Re: FAS3250 interconnect error
    scottgelb
    Currently Being Moderated

    Do you have a case open?  c0n ports not coming up sounds like a bad cable or port problem.

  • Re: FAS3250 interconnect error
    PHUONGPH2
    Currently Being Moderated

    Dear all, i have FAS3210, i run: "cf status", it show "disabled", someone can tell me if i run "cf enabled" it required reboot or not the system. My FAS3210 already have cluster license.

    Thanks.

  • Re: FAS3250 interconnect error
    MYNETAPP_
    Currently Being Moderated

    just had the same issue, resolved by a friend .

    but this was for cluster mode, the below is how we solved it, maybye you can find something in it for you.

     

    storage failover show -instance

    1 node is non-ha mode

     

    storage failover modify -node {nodename} -mode ha

    reboot

More Like This

  • Retrieving data ...