NetApp System Console Log Analysis
NetApp System Console Log Analysis
admin@[Link]'s password:
SP netappctrl1>
SP netappctrl1>
SP netappctrl1> system console
Type Ctrl-D to exit.
Waiting for giveback...(Press Ctrl-C to abort wait)May 05 19:53:16 [localhost:se
[Link]:CRITICAL]: DS2246 (S/N 6000012546) shelf 11 on channel 4a ACP
Processor error for SAS shelf ACP processor 1: critical status ; Alternate Contr
ol Path hardware failed This module is on the rear side of the shelf, at the at
the top left, on shelf module A.
Waiting for giveback...(Press Ctrl-C to abort wait)
Waiting for giveback...(Press Ctrl-C to abort wait)
Waiting for giveback...(Press Ctrl-C to abort wait)
Waiting for giveback...(Press Ctrl-C to abort wait)
Waiting for giveback...(Press Ctrl-C to abort wait)May 05 20:02:17 [localhost:ne
[Link]:info]: Ethernet c0a: Link up.
May 05 20:02:23 [localhost:[Link]:info]: Ethernet c0b: Link up.
May 05 20:02:29 [localhost:[Link]:info]: High-availability intercon
nect status: Starting heartbeat to [Link]
May 05 20:02:29 [localhost:[Link]:info]: High-availability intercon
nect status: Starting heartbeat to [Link]
Continuing boot...
May 05 20:04:40 [localhost:[Link]:info]: No sparecore disk was
found for host 0.
May 05 20:04:40 [localhost:[Link]:info]: Replayed 0 checksum
blocks.
May 05 20:04:40 [localhost:[Link]:info]: Replayed 0 stripes.
Thu May 5 20:04:41 UTC 2016
May 05 20:04:42 [localhost:[Link]:info]: Launching failover monitor
May 05 20:04:42 [localhost:[Link]:info]: Failover monitor: partner 'netap
pctrl2'
May 05 20:04:42 [localhost:[Link]:notice]: Failover monitor: node wa
s previously taken over, nvram may be discarded
add net 127.0.0.0May 05 20:04:43 [localhost:[Link]:debug]: Command line in
put: the command is 'route'. The full command line is 'route add net [Link] 1
[Link] 1'.
: gateway [Link]
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume vol0. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume CON_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume CON_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume TOB_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume TOB_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume ACC_WAT_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume ACC_WAT_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume CIG_SMP_TRN_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [localhost:[Link]:info]: Language not set on v
olume CIG_SMP_TRN_LOG. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [localhost: rc:notice]: The system was down for 4209 sec
ondsMay 05 20:04:44 [netappctrl1:[Link]:info]: Language not se
t on volume DUN_JEW_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume DUN_JEW_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume DVD_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume DVD_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume test. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume snapinfo. Using language config "C". Use vol lang to set language.
Data ONTAP is switching to NearStore mode.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume masterdb. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume model. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume msdb. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume tempdb. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume SystemDB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume SystemLog. Using language config "C". Use vol lang to set language.
add net default: gateway [Link]
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume Sql190_snapinfo. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume Sql195_snapinfo. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_0. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume FRZ_DB. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume FRZ_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_1. Using language config "C". Use vol lang to set language
.
option lun.bug_catcher: Invalid value off.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CIG_SMP_TRN_DB_0. Using language config "C". Use vol lang to set
language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_DVD_DB_0. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume Archiving. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_FRZ_DB_1. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CON_DB_0. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume Sql195_Sys. sysconfig: Unless directed by NetApp Global Servic
es volu
Data ONTAP ([Link])
login: mes vol0, test, and testshare should have the volume option create_ucode
set to On.
CIFS local server is running.
Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_DVD_LOG_0. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_FRZ_DB_2. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_FRZ_LOG_0. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_2. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CON_LOG_0. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CON_DB_1. Using language config "C". Use vol lang to set language
. Thu May 5 20:04:50 GMT [netappct
rl1: proto_init00:info]: Vfiler discovery complete
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_ACC_WAT_DB_0. Using language config "C". Use vol lang to set lang
uage.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume SystemDB_Hocon1. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume Cgate_DB_LOG. Using language config "C". Use vol lang to set language.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CON_DB_2. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_CON_LOG_1. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_3. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_FRZ_DB_0. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_FRZ_LOG_1. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_4. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_DB_5. Using language config "C". Use vol lang to set language
.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_DVD_LOG_1. Using language config "C". Use vol lang to set languag
e.
May 05 20:04:44 [netappctrl1:[Link]:info]: Language not set on
volume sdw_cl_TOB_LOG_0. Using language config "C". Use vol lang to set languag
e.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_DB_7. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_LOG_1. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_Archiving_0. Using language config "C". Use vol lang to s
et language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_ACC_WAT_LOG_0. Using language config "C". Use vol lang to
set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_CON_DB_3. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_CON_LOG_2. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_DB_6. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume SHR_CWS. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_LOG_2. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_LOG_3. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_Archiving_3. Using language config "C". Use vol lang to s
et language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_Archiving_1. Using language config "C". Use vol lang to s
et language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchangeMBDB7. Using language config "C". Use vol lang to set la
nguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchangeMBLogs7. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchangePBDB7. Using language config "C". Use vol lang to set la
nguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchangePBLogs7. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExcSnapInfo7. Using language config "C". Use vol lang to set lan
guage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume testshare. Using language config "C". Use vol lang to set langua
ge.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchMngrsDb7. Using language config "C". Use vol lang to set lan
guage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchMngrsLogs7. Using language config "C". Use vol lang to set l
anguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExTopMgrsLOG7. Using language config "C". Use vol lang to set la
nguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_ExchangeMBLogs7_0. Using language config "C". Use vol lan
g to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume RBC_DB_LOG. Using language config "C". Use vol lang to set langu
age.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]
Data ONTAP ([Link])
login: cified:info]: Language not set on volume Sql151_Snapinfo. Using language
config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]
Data ONTAP ([Link]:info]:[Link])
login: Language not set on volume Sql150_Snapinfo. Using language config "C". U
se vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Langu
Data ONTAP ([Link] not)
login: set on volume MIRA150_DB_LOG. Using language config "C". Use vol lang to
set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_MIR_DB_LOG_0. Using language config "C". Use vol lang to
set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_RBC_DB_LOG_0. Using language config "C". Use vol lang to
set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume MIRA150_DB_DB. Using language config "C". Use vol lang to set la
nguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume Mirasaafdb. Using language config "C". Use vol lang to set langu
age.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume Mirasaaflog. Using language config "C". Use vol lang to set lang
uage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExHrDB. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ManagerDB7NEW. Using language config "C". Use vol lang to set la
nguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExHrLog. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Stored checksum match
es, not extracting local://tmp/prestage/[Link].
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Stored checksum match
es, not extracting local://tmp/prestage/[Link].
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:info]: Local LUN(s) on
line completed.
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:info]: FCMON is running
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:info]: FCP service star
tup
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:info]: ipspace d
iscovery is complete. Total ipspaces initialized: 1.
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:notice]: WAFL external
cache log could not be opened: aggregate sasaggr, log ec_tagstore.
Thu May 5 20:04:45 GMT [netappctrl1:[Link]:notice]: WAFL external
cache reconstruct was canceled.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:notice]: Link up o
n Fibre Channel target adapter 0d.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:notice]: Link up o
n Fibre Channel target adapter 0c.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:notice]: WAFL extern
al cache warming process terminated.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:notice]: WAFL e
xternal cache replay canceled for aggregate sataaggr: Aggregate came online afte
r timeout.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:notice]: WAFL e
xternal cache replay canceled for aggregate sasaggr: Aggregate came online after
timeout.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:warning]: vif1: switching t
o e0b
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:warning]: hosts:
Invalid entry in /etc/hosts: No end of line. "[Link] [Link]
"
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:info]: Firmware is up-
to-date on all disk drives
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:info]: Although vFiler u
nits are licensed, the routing daemon runs in the default IP space only.
Thu May 5 20:04:46 GMT [netappctrl1:[Link]:info]: iSCSI service
startup
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0d' from '21:00:00:1b:32:92:10:d1', address 0x1040
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0d' from '21:00:00:1b:32:92:84:d1', address 0x1020
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0d' from '21:00:00:1b:32:1f:7d:e8', address 0x1030
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0d' from '21:00:00:1b:32:98:5e:0e', address 0x1060
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0d' from '21:fd:00:05:33:bd:3b:4e', address 0xfffc
01.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:00:00:1b:32:98:fe:0d', address 0x1070
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:00:00:1b:32:0f:ae:80', address 0x1020
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:00:00:1b:32:98:05:0e', address 0x1060
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:00:00:1b:32:92:b2:d0', address 0x1040
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:00:00:1b:32:1f:c7:e8', address 0x1030
0.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:notice]: FCP lo
gin on Fibre Channel adapter '0c' from '21:fd:00:05:33:bd:36:62', address 0xfffc
01.
Thu May 5 20:04:47 GMT [netappctrl1:[Link]:info]: Performance archi
ver started. Sampling 31 objects and 370 counters.
Thu May 5 20:04:48 GMT [netappctrl1:[Link]:warning]: No SRV r
ecords found for the System Manager server, or the server is not located on this
subnet.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:error]: sysconfig: Unle
ss directed by NetApp Global Services volumes vol0, test, and testshare should h
ave the volume option create_ucode set to On. .
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:error]: Call home for S
YSTEM CONFIGURATION WARNING
Thu May 5 20:04:49 GMT [netappctrl1:[Link].disk_done:info]: NetApp Release 8.
1RC3 7-Mode boot complete. Last disk update written at Thu May 5 20:04:36 GMT 2
016
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: HA hw_ass
ist: hw_assist functionality on the partner node has been enabled by the user.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: Cannot
get IP address of preferred e0M ethernet interface for hardware assist functiona
lity.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: Cannot
get IP address of preferred e0M ethernet interface for hardware assist functiona
lity.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:notice]: The s
ystem automatically chose [Link] as the hardware-assist partner address. If
you want to use a different IP address, change it using the command 'options cf
.hw_assist.[Link]'.
Thu May 5 20:04:49 GMT [netappctrl1:[Link].reason_ok:notice]: System rebooted
after a giveback.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: Call home f
or REBOOT (after giveback)
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: hw_assist:
hw_assist functionality is active on IP address: [Link] port: 4444
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:CRITICAL]: Fail
ed to notify hardware-assist configuration to hardware component (SP): SP status
unknown(4)
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:warning]: The softwar
e driver for the Service Processor (SP) detected a problem: SP status unknown.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:error]: AUTH: The
filer's local user definition for administrator is missing or incomplete.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:info]: CIFS: C
IFS local server is running.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:warning]: /etc/ht
[Link] file is missing.
Thu May 5 20:04:49 GMT [netappctrl1:[Link]:notice]: "vfiler0" initi
alized.
Thu May 5 18:43:12 GMT [netappctrl1:[Link]:notice]: F
ailover monitor: takeover of netappctrl2 disabled (local halt in progress).
Thu May 5 18:43:12 GMT [netappctrl1:[Link]:warning]: CIFS: shut
ting down: CIFS local server is shutting down.
Thu May 5 18:43:14 GMT [netappctrl1:[Link]:notice]: System shut down bec
ause : "halt".
Thu May 5 18:43:14 GMT [netappctrl1:[Link]:info]: iSCSI service
shutdown
Thu May 5 18:43:14 GMT [netappctrl1:[Link]:info]: FCP service shu
tdown
Thu May 5 18:43:15 GMT [netappctrl1:[Link]:info]: Performance archiv
er stopped. (11087)
Thu May 5 18:43:17 GMT [netappctrl1:[Link]:CRITICAL]: vif1: all link
s down
Thu May 5 19:51:56 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 3b after 10 seconds. Offlining the adapter.
Thu May 5 19:51:56 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 4b after 10 seconds. Offlining the adapter.
Thu May 5 19:51:59 GMT [netappctrl1:[Link]:info]: software ownership
has been enabled for this system
Thu May 5 19:52:00 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 3c after 10 seconds. Offlining the adapter.
Thu May 5 19:52:00 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 3d after 10 seconds. Offlining the adapter.
Thu May 5 19:52:00 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 4c after 10 seconds. Offlining the adapter.
Thu May 5 19:52:00 GMT [netappctrl1:[Link]:error]: Could not recover li
nk on SAS adapter 4d after 10 seconds. Offlining the adapter.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: Disk 4a.11.0
is a local HA mailbox disk.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: Disk 4a.11.1
is a local HA mailbox disk.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: normal mailbox
instance on local side.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: Disk 0b.10.2
is a partner HA mailbox disk.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: Disk 0b.10.3
is a partner HA mailbox disk.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: normal mailbox
instance on partner side.
Thu May 5 19:52:02 GMT [netappctrl1:[Link]:info]: Failover monitor: part
ner 'netappctrl2'
Thu May 5 19:52:03 GMT [netappctrl1:[Link]:info]: All attached stora
ge on the system is multi-pathed HA.
Thu May 5 19:52:08 GMT [netappctrl1:[Link]:info]: Ethernet e0M: Link up.
Thu May 5 19:52:08 GMT [netappctrl1:[Link]:info]: Ethernet e0P: Link up.
Thu May 5 19:52:09 GMT [netappctrl1:[Link]:info]: Ethernet e0a: Link up.
Thu May 5 19:52:10 GMT [netappctrl1:[Link]:info]: Ethernet e0b: Link up.
Thu May 5 19:53:16 GMT [netappctrl1:[Link]:CRITICAL]: DS2246 (S/N
6000012546) shelf 11 on channel 4a ACP Processor error for SAS shelf ACP process
or 1: critical status ; Alternate Control Path hardware failed This module is on
the rear side of the shelf, at the at the top left, on shelf module A.
Thu May 5 20:02:17 GMT [netappctrl1:[Link]:info]: Ethernet c0a: Link up.
Thu May 5 20:02:23 GMT [netappctrl1:[Link]:info]: Ethernet c0b: Link up.
Thu May 5 20:02:29 GMT [netappctrl1:[Link]:info]: High-availabilit
y interconnect status: Starting heartbeat to [Link]
Thu May 5 20:02:29 GMT [netappctrl1:[Link]:info]: High-availabilit
y interconnect status: Starting heartbeat to [Link]
Thu May 5 20:04:40 GMT [netappctrl1:[Link]:info]: No sparecor
e disk was found for host 0.
Thu May 5 20:04:40 GMT [netappctrl1:[Link]:info]: Replayed 0
checksum blocks.
Thu May 5 20:04:40 GMT [netappctrl1:[Link]:info]: Replayed
0 stripes.
Thu May 5 20:04:40 GMT [netappctrl1:[Link]:debug]: Event '[Link]
[Link]' suppressed 4 times in last 130 seconds.
Thu May 5 20:04:42 GMT [netappctrl1:[Link]:error]: Space for v
olume ExchangeMBDB7 is NOT guaranteed
Thu May 5 20:04:42 GMT [netappctrl1:[Link]:info]: Launching failover moni
tor
Thu May 5 20:04:42 GMT [netappctrl1:[Link]:info]: Failover monitor: part
ner 'netappctrl2'
Thu May 5 20:04:42 GMT [netappctrl1:[Link]:notice]: Failover monito
r: node was previously taken over, nvram may be discarded
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume vol0. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume CON_DB. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume CON_LOG. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume TOB_DB. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume TOB_LOG. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ACC_WAT_DB. Using language config "C". Use vol lang to set langu
age.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ACC_WAT_LOG. Using language config "C". Use vol lang to set lang
uage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume CIG_SMP_TRN_DB. Using language config "C". Use vol lang to set l
anguage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume CIG_SMP_TRN_LOG. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume DUN_JEW_DB. Using language config "C". Use vol lang to set langu
age.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume DUN_JEW_LOG. Using language config "C". Use vol lang to set lang
uage.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume DVD_DB. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume DVD_LOG. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume test. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume snapinfo. Using language config "C". Use vol lang to set languag
e.
Thu May 5 20:04:44 GMT [netrappctrlpc1:vol.l [Link]:id:nfo]:
g "C". agePC not se: t on voTilume mamesterdb.d Using oulanguagte confi
Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume model. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume msdb. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume tempdb. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume SystemDB. Using language config "C". Use vol lang to set languag
e.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume SystemLog. Using language config "C". Use vol lang to set langua
ge.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume Sql190_snapinfo. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume Sql195_snapinfo. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume sdw_cl_TOB_DB_0. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume FRZ_DB. Using language config "C". Use vol lang to set language.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume FRZ_LOG. Using language config "C". Use vol lang to set language
.
Thu May 5 20:04:44 GMT [netappctrl1:[Link]:info]: Language no
t set on volume ExchangePBLogs7. Using language config "C". Use vol lang to set
language.
Thu May 5 20:04:54 GMT [netappctrl1:[Link]:info]: Stored checksum match
es, not extracting /mroot_late.tgz.
Thu May 5 20:04:54 GMT [netappctrl1:[Link]:info]: Stored checksum match
es, not extracting /platform/pmroot_late.tgz.
Thu May 5 20:04:56 GMT [netappctrl1:[Link]:notice]: ISCSI: New session fr
om initiator [Link]:[Link] at IP addr 130.1.9.
195
Thu May 5 20:04:56 GMT [netappctrl1:[Link]:notice]: ISCSI: New session fr
om initiator [Link]:[Link] at IP addr 130.1.9
.153
Thu May 5 20:04:57 GMT [netappctrl1:[Link]:notice]: ISCSI: New session fr
om initiator [Link]:[Link] at IP addr [Link]
51
Thu May 5 20:05:02 GMT [netappctrl1:[Link]:notice]: ISCSI: New session fr
om initiator [Link]:[Link] at IP addr [Link]
60
Thu May 5 20:05:04 GMT [netappctrl1:[Link]:info]: Unable to gro
w volume 'CON_LOG' to recover space: Volume cannot be grown beyond maximum growt
h limit
Thu May 5 20:05:12 GMT [netappctrl1:[Link]:info]: NBT: A
ll CIFS name registrations have completed for the local server.
Thu May 5 20:05:12 GMT [netappctrl1:[Link]:info]: Ethernet e0P: Link up.
Data ONTAP ([Link])
login: root
Password:
Thu MayThu May 5 23:05:29 5 23:AST [netappctrl1: rlmauth_login_mgr:info]: roo
t logged in from SP
05:29 AST [netappctrl1: rlmauth_login_mgr:info]: root logged in from SP
netappctrl1>
netappctrl1>
netappctrl1>
netappctrl1>
netappctrl1>
netappctrl1> Thu MayThu May 5 23:05:49 AST 5 23:[netappctrl1:[Link]
[Link]:info]: Call home for PERFORMANCE SNAPSHOT
05:49 AST [netappctrl1:[Link]:info]: Call home for PERFORMANC
E SNAPSHOT
netappctrl1>
netappctrl1>
netappctrl1> Thu MayThu May 5 23:07:50 AST [neta 5 23:ppctrl1:[Link]
ronicsWarn:warning]: DS2246 (S/N 6000012546) shelf 11 on channel 4a environmenta
l monitoring warning for SES electronics 1: not installed. This module is on th
e rear side of the shelf, at the at the top left.
07:50 AST [netappctrl1:[Link] May 5 23:0tatus.e7:50 AST [netappctrl1:[Link]
[Link]:warning]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS co
nnector warning for SAS connector 1: not installed. This module is on the rear
lectronf the shelf, at the at the top left, on shelf module A.
icsWarn:warning]: DS2Thu May 5 23:07:50 246 (S/AST [netappctrl1:[Link]
ectorWarn:warning]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS connector
warning for SAS connector 2: not installed. This module is on the rear side o
f the shelf, at the at the top left, on shelf module A.
N 6000012546) shelf 11 on chThu May 5 23:07:50 AST [netappctrl1:[Link]
lannel 4eError:CRITICAL]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS exp
ander error for SAS shelf electronics 1: not installed. This module is on the re
ar side of the shelf, at the at the top left, on shelf module A.
a environmental monitoring wThu May 5 23:07:5arning 0 AST [netappctrl1:[Link]
[Link]:CRITICAL]: DS2246 (S/N 6000012546) shelf 11 on channel 4a ACP Proces
sor error for SAS shelf ACP processor 1: ACP on partner not installed This modu
le is on the rear side of the shelf, at the at the top left, on shefor SESlf mo
dule A.
electronics 1: not installed. This module is on the rear side of the shelf, a
t the at the top left.
Thu May 5 23:07:50 AST [netappctrl1:[Link]:warning]: DS2246 (
S/N 6000012546) shelf 11 on channel 4a SAS connector warning for SAS connector 1
: not installed. This module is on the rear side of the shelf, at the at the t
op left, on shelf module A.
Thu May 5 23:07:50 AST [netappctrl1:[Link]:warning]: DS2246 (
S/N 6000012546) shelf 11 on channel 4a SAS connector warning for SAS connector 2
: not installed. This module is on the rear side of the shelf, at the at the t
op left, on shelf module A.
Thu May 5 23:07:50 AST [netappctrl1:[Link]:CRITICAL]: DS2246 (S
/N 6000012546) shelf 11 on channel 4a SAS expander error for SAS shelf electroni
cs 1: not installed. This module is on the rear side of the shelf, at the at th
e top left, on shelf module A.
Thu May 5 23:07:50 AST [netappctrl1:[Link]:CRITICAL]: DS2246 (S/N
6000012546) shelf 11 on channel 4a ACP Processor error for SAS shelf ACP process
or 1: ACP on partner not installed This module is on the rear side of the shel
f, at the at the top left, on shelf module A.
Thu MayThu May 5 23:08:20 AST [net 5 23:appctrl1:[Link]:info]:
System has transitioned to a mixture of single and multi-path HA attached stora
ge
08:20 AST [netappctrl1:[Link]:info]: System has transitioned to
a mixture of single and multi-path HA attached storage
Thu MayThu May 5 23:08:21 5 23: AST [netappctrl1:[Link]:CRITIC
AL]: SAS-Shelf24 detected without a multipath configuration.
08:21 AST [netappctrl1:[Link]:CRITICAL]: SAS-Shelf24 detected wi
thout a multipath configuration.
Thu MayThu May 5 23:08:33 AST [netappct 5 23:rl1:[Link]
:warning]: DS2246 (S/N 6000012546) shelf 11 on channel 4a temperature warning fo
r Temperature sensor 7: not installed. Current temperature: <N/A> C (<N/A> F). T
his module is on the rear side of the shelf, at the at the to08:33 Ap left, on
shelf module A.
ST [netappctrlThu May 5 23:08:33 AST 1:ses.s[netappctrl1:[Link]:CR
ITICAL]: Fault reported on disk storage shelf attached to channel 4a. Please che
ck fans, power supplies, disks, and temperature sensors.
[Link] May 5 23:08:33 AST [netappctrl1ing:war:[Link].f
ault:error]: Call home for SHELF_FAULT
ning]: DS2246 (S/N 6000012546) shelf 11 on channel 4a temperature warning for Te
mperature sensor 7: not installed. Current temperature: <N/A> C (<N/A> F). This
module is on the rear side of the shelf, at the at the top left, on shelf modul
e A.
Thu May 5 23:08:33 AST [netappctrl1:[Link]:CRITICAL]: Fault report
ed on disk storage shelf attached to channel 4a. Please check fans, power suppli
es, disks, and temperature sensors.
Thu May 5 23:08:33 AST [netappctrl1:[Link]:error]: Call home for S
HELF_FAULT
Thu MayThu May 5 23:08:57 AST [netappctrl1:[Link]:info]: Fault
previously reported on disk storage shelf attached to channel 4a has been correc
5 23:
08:57 AST [netappctrl1:[Link]:info]: Fault previously reported o
n disk storage shelf attached to channel 4a has been corrected.
Thu MayThu May 5 23:10:05 AST [netappctrl1:[Link]:info]: Event '
5 23:[Link]' suppressed 359 times in last 301 seconds.
10:05 AThu May 5 23:10:05 AST [netappctrl1:[Link]:info]: Unable
to grow volume 'CON_LOG' to recover space: Volume cannot be grown beyond maximu
m growth limitST [net
appctrl1:[Link]:info]: Event '[Link]' suppressed
359 times in last 301 seconds.
Thu May 5 23:10:05 AST [netappctrl1:[Link]:info]: Unable to gro
w volume 'CON_LOG' to recover space: Volume cannot be grown beyond maximum growt
h limit
Thu MayThu May 5 23:10:17 AST [neta 5 23:ppctrl1:[Link]:info]: Sy
stem has transitioned to multi-path HA attached storage
10:17 AST [netappctrl1:[Link]:info]: System has transitioned to mul
ti-path HA attached storage
Thu MayThu May 5 23:10:17 AST [ne 5 23:tappctrl1:[Link]:in
fo]: DS2246 (S/N 6000012546) shelf 11 on channel 4a environmental monitoring inf
ormation for SES electronics 1: normal status.
10:17 AST [netappctrlThu May 5 23:10:17 AST [n1:ses.setappctrl1:[Link]
ectorInfo:info]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS connector in
formation for SAS connector 1: normal status.
[Link] May 5 23:10:17 ASlectronT [netappctrl1:[Link]:info
]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS connector information for
SAS connector 2: normal status.
icsInfo:info]: DS2246 (S/N 6Thu May 5 23:10:17 AST 0000125[netappctrl1:[Link]
[Link]:info]: DS2246 (S/N 6000012546) shelf 11 on channel 4a SAS expander
information for SAS shelf electronics 1: normal status.
46) shelf 11 on channel 4a environmental monitoring information for SES electron
ics 1: normal status.
Thu May 5 23:10:17 AST [netappctrl1:[Link]:info]: DS2246 (S/N
6000012546) shelf 11 on channel 4a SAS connector information for SAS connector
1: normal status.
Thu May 5 23:10:17 AST [netappctrl1:[Link]:info]: DS2246 (S/N
6000012546) shelf 11 on channel 4a SAS connector information for SAS connector
2: normal status.
Thu May 5 23:10:17 AST [netappctrl1:[Link]:info]: DS2246 (S/N 60
00012546) shelf 11 on channel 4a SAS expander information for SAS shelf electron
ics 1: normal status.
Thu MayThu May 5 23:10:28 AST [netappctrl1:s 5 23:[Link]:in
fo]: DS2246 (S/N 6000012546) shelf 11 on channel 4a temperature information for
Temperature sensor 7: normal status.
10:28 AST [netappctrl1:[Link]:info]: DS2246 (S/N 6000012546)
shelf 11 on channel 4a temperature information for Temperature sensor 7: normal
status.
netappctrl1>