vMaster inconsistent with vblade errors
![[Deleted User]](https://w9.vanillicon.com/v2/93647d3a00b4757c2e0a2e6a61b6133f.svg)
in System
Getting a bunch of these in the logs: vMaster is inconsistent with vBlade 0
Here is what I am seeing in the various vcs show commands:
A10-1-Active-vMaster[1/1]#sh vcs summ
VCS Chassis:
VCS Enabled: Yes
Chassis ID: 1
Floating IP: 10.1.99.100
Mask: 255.255.255.0
Multicast IP: 224.0.0.210
Multicast Port: 41217
Version: 2.7.2-P7-SP3.b3
VCS Monitor Sync: ENABLE
Members(* means local device):
ID State Priority IP:Port Location Sync-State
---------------------------------------------------------------------------------------------
1 vMaster(*) 150 10.1.99.220:41216 Local
2 vBlade 125 10.1.99.221:41216 Remote UNSYNC
3 vBlade 100 10.1.99.222:41216 Remote UNSYNC
Total: 3
A10-1-Active-vMaster[1/1]#sh vcs stat
Parameters:
Chassis-ID: 1
time-interval: 3
failure-retry-count: 2
force-wait-interval: 5
Floating-IPv4: 10.1.99.100/24
SSL-enabled: Yes
Multicast-IP: 224.0.0.210
Multicast-Port: 41217
Dev-ID: 1
Dev-Prio: 150
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 2
Dev-Prio: 125
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 3
Dev-Prio: 100
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Local-Dev-ID: 1
Running parameters:
Chassis-ID: 1
time-interval: 3
failure-retry-count: 2
force-wait-interval: 5
Floating-IPv4: 10.1.99.100/24
SSL-enabled: Yes
Multicast-IP: 224.0.0.210
Multicast-Port: 41217
Dev-ID: 1
Dev-Prio: 150
Dev-IPv4: 10.1.99.220
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 2
Dev-Prio: 125
Dev-IPv4: 10.1.99.221
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 3
Dev-Prio: 100
Dev-IPv4: 10.1.99.222
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Local-Dev-ID: 1
Dev-State: vMaster
Version: 2.7.2-P7-SP3.b3
Config: 4570c6c6b0c6e89e, 28591
Election context:
Stop-Request: No
Parameters:
Num-Sockets: 1
Dev-State: vMaster
Dev-DynPrio: 4294967293
PDU-Seq: 1147842
vMasterTakeOverPrio: 0
vMaster-Sent: 2016-05-02 08:52:35.684000
Neighbour: seen 1091417 times, last seen 2016-05-02 08:52:34.584000
Ident: VCE
Version: 1.0
Type: vBlade-PDU
Length: 4
Seq: 1091418
HW-Model: 3030S
Chassis-ID: 1
Device-ID: 2
Device-Prio: 125
Device-DynPrio: 4294967293
Config: 28591
Neighbour: seen 472938 times, last seen 2016-05-02 08:52:36.084000
Ident: VCE
Version: 1.0
Type: vBlade-PDU
Length: 4
Seq: 1091283
HW-Model: 3030S
Chassis-ID: 1
Device-ID: 3
Device-Prio: 100
Device-DynPrio: 4294967293
Config: 28591
vMaster context:
Stop-Request: No
Server-Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 0.0.0.0:0
State: Listen
IO-State:
SSL: Yes
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
vBlade:
ID: 0
Device-ID: 2
vBlade-State: Ready
Stop-Request: No
Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 10.1.99.221:55778
State: Connected
IO-State: R
SSL: Yes
Message Buffer Send Times: 0
vBlade:
ID: 1
Device-ID: 3
vBlade-State: Ready
Stop-Request: No
Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 10.1.99.222:39483
State: Connected
IO-State: R
SSL: Yes
Message Buffer Send Times: 0
Counters:
Daemon:
Start Time: 2016-03-22 13:51:00.356000
Election Started: 1 times
Election Stopped: 0 times
Receive Errors: 0
Send Errors: 0
Received Bytes: 154288958569
Sent Bytes: 1318202978856
Received Messages: 1465597363
Sent Messages: 1465597363
Invalid Messages: 0
Message Handling Failure: 0
Election:
Start Time: 2016-03-22 13:51:06.356000
Receive Errors: 0
Send Errors: 0
Received Bytes: 123962876
Sent Bytes: 71165892
Received vMaster-PDU: 34
Received MC-PDU: 16
Received vBlade-PDU: 2295548
Received MTO-PDU: 0
Received Unknown-PDU: 0
Sent vMaster-PDU: 1147803
Sent MC-PDU: 3
Sent vBlade-PDU: 30
Sent MTO-PDU: 6
Sent Unknown-PDU: 0
Invalid PDU: 0
PDU HW mismatch: 0
PDU Chassis-ID mismatch: 0
PDU Device-ID collision: 0
MC, discarded vMaster-PDU: 0
MC, replaced vMaster-PDU: 0
MC, duplicate vMaster-PDU: 0
MC, timers reset by MC-PDU: 0
MC, timers reset by MTO-PDU: 0
vBlade, duplicate vMaster-PDU: 0
vBlade, discard challenger: 0
vBlade, replace challenger: 0
vBlade, duplicate challenger: 0
vBlade, discard neighbour: 5
vBlade, too many neighbours: 0
vBlade, duplicate neighbours: 0
vMaster, discard challenger: 0
vMaster, new challenger: 0
vMaster, replace challenger: 0
vMaster, duplicate challenger: 0
vMaster, discard neighbour: 0
vMaster, too many neighbours: 0
vMaster, duplicate neighbours: 0
Enter MC: 1
Enter vBlade: 1
Enter vMaster: 1
Enter MTO: 1
Leave MC: 1
Leave vBlade: 1
Leave vMaster: 0
Leave MTO: 1
vMaster:
Start Time: 2016-03-22 13:52:49.292000
Start vBlade Errors: 0
vBlades Started: 8
vBlades stopped: 6
Received Configuration Updates: 15614
Last Configuration Update: 2016-04-29 16:38:26.940000
Local Configuration Update Errors: 0
Remote Configuration Update Errors: 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade: 0
Start Time: 2016-03-24 13:59:52.624000
Device-ID: 2
Receive Errors: 0
Send Errors: 0
Received Bytes: 851719626
Sent Bytes: 93655729
Received Messages: 1128543
Sent Messages: 1128543
Invalid Messages: 0
Sent Keepalives: 1005353
Sent Configuration Updates: 123190
Last Configuration Update: 2016-05-02 08:51:52.588000
Local Configuration Update Errors (1): 0
Remote Configuration Update Errors: 0
Local Configuration Update Errors (2): 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade: 1
Start Time: 2016-04-15 13:33:38.292000
Device-ID: 3
Receive Errors: 0
Send Errors: 0
Received Bytes: 415730885
Sent Bytes: 35886772
Received Messages: 487416
Sent Messages: 487416
Invalid Messages: 0
Sent Keepalives: 435020
Sent Configuration Updates: 52396
Last Configuration Update: 2016-05-02 08:51:07.528000
Local Configuration Update Errors (1): 0
Remote Configuration Update Errors: 0
Local Configuration Update Errors (2): 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade:
Start Time: 2016-03-22 13:51:13.852000
Receive Errors: 0
Send Errors: 0
Received Bytes: 2016
Sent Bytes: 10868
Received Messages: 28
Sent Messages: 28
Invalid Messages: 0
Received Keepalives: 25
Received Configuration Updates: 0
Last Configuration Update: N/A
Configuration Update Failures: 0
2016/05/02 07:11:45, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 51
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], getting the running-configuration from vblade 1
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 49
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 48
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 50
2016/05/02 07:11:42, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 22
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 22
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 21
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 21
2016/05/02 07:11:39, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 22
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 22
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 21
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 21
Here is what I am seeing in the various vcs show commands:
A10-1-Active-vMaster[1/1]#sh vcs summ
VCS Chassis:
VCS Enabled: Yes
Chassis ID: 1
Floating IP: 10.1.99.100
Mask: 255.255.255.0
Multicast IP: 224.0.0.210
Multicast Port: 41217
Version: 2.7.2-P7-SP3.b3
VCS Monitor Sync: ENABLE
Members(* means local device):
ID State Priority IP:Port Location Sync-State
---------------------------------------------------------------------------------------------
1 vMaster(*) 150 10.1.99.220:41216 Local
2 vBlade 125 10.1.99.221:41216 Remote UNSYNC
3 vBlade 100 10.1.99.222:41216 Remote UNSYNC
Total: 3
A10-1-Active-vMaster[1/1]#sh vcs stat
Parameters:
Chassis-ID: 1
time-interval: 3
failure-retry-count: 2
force-wait-interval: 5
Floating-IPv4: 10.1.99.100/24
SSL-enabled: Yes
Multicast-IP: 224.0.0.210
Multicast-Port: 41217
Dev-ID: 1
Dev-Prio: 150
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 2
Dev-Prio: 125
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 3
Dev-Prio: 100
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Local-Dev-ID: 1
Running parameters:
Chassis-ID: 1
time-interval: 3
failure-retry-count: 2
force-wait-interval: 5
Floating-IPv4: 10.1.99.100/24
SSL-enabled: Yes
Multicast-IP: 224.0.0.210
Multicast-Port: 41217
Dev-ID: 1
Dev-Prio: 150
Dev-IPv4: 10.1.99.220
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 2
Dev-Prio: 125
Dev-IPv4: 10.1.99.221
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Dev-ID: 3
Dev-Prio: 100
Dev-IPv4: 10.1.99.222
Unicast-Port: 41216
Interfaces: management
Enabled: Yes
Local-Dev-ID: 1
Dev-State: vMaster
Version: 2.7.2-P7-SP3.b3
Config: 4570c6c6b0c6e89e, 28591
Election context:
Stop-Request: No
Parameters:
Num-Sockets: 1
Dev-State: vMaster
Dev-DynPrio: 4294967293
PDU-Seq: 1147842
vMasterTakeOverPrio: 0
vMaster-Sent: 2016-05-02 08:52:35.684000
Neighbour: seen 1091417 times, last seen 2016-05-02 08:52:34.584000
Ident: VCE
Version: 1.0
Type: vBlade-PDU
Length: 4
Seq: 1091418
HW-Model: 3030S
Chassis-ID: 1
Device-ID: 2
Device-Prio: 125
Device-DynPrio: 4294967293
Config: 28591
Neighbour: seen 472938 times, last seen 2016-05-02 08:52:36.084000
Ident: VCE
Version: 1.0
Type: vBlade-PDU
Length: 4
Seq: 1091283
HW-Model: 3030S
Chassis-ID: 1
Device-ID: 3
Device-Prio: 100
Device-DynPrio: 4294967293
Config: 28591
vMaster context:
Stop-Request: No
Server-Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 0.0.0.0:0
State: Listen
IO-State:
SSL: Yes
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
Local-Addr: 0.0.0.0:0
Remote-Addr: 0.0.0.0:0
State: Closed
IO-State:
SSL: No
vBlade:
ID: 0
Device-ID: 2
vBlade-State: Ready
Stop-Request: No
Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 10.1.99.221:55778
State: Connected
IO-State: R
SSL: Yes
Message Buffer Send Times: 0
vBlade:
ID: 1
Device-ID: 3
vBlade-State: Ready
Stop-Request: No
Connection:
Local-Addr: 10.1.99.220:41216
Remote-Addr: 10.1.99.222:39483
State: Connected
IO-State: R
SSL: Yes
Message Buffer Send Times: 0
Counters:
Daemon:
Start Time: 2016-03-22 13:51:00.356000
Election Started: 1 times
Election Stopped: 0 times
Receive Errors: 0
Send Errors: 0
Received Bytes: 154288958569
Sent Bytes: 1318202978856
Received Messages: 1465597363
Sent Messages: 1465597363
Invalid Messages: 0
Message Handling Failure: 0
Election:
Start Time: 2016-03-22 13:51:06.356000
Receive Errors: 0
Send Errors: 0
Received Bytes: 123962876
Sent Bytes: 71165892
Received vMaster-PDU: 34
Received MC-PDU: 16
Received vBlade-PDU: 2295548
Received MTO-PDU: 0
Received Unknown-PDU: 0
Sent vMaster-PDU: 1147803
Sent MC-PDU: 3
Sent vBlade-PDU: 30
Sent MTO-PDU: 6
Sent Unknown-PDU: 0
Invalid PDU: 0
PDU HW mismatch: 0
PDU Chassis-ID mismatch: 0
PDU Device-ID collision: 0
MC, discarded vMaster-PDU: 0
MC, replaced vMaster-PDU: 0
MC, duplicate vMaster-PDU: 0
MC, timers reset by MC-PDU: 0
MC, timers reset by MTO-PDU: 0
vBlade, duplicate vMaster-PDU: 0
vBlade, discard challenger: 0
vBlade, replace challenger: 0
vBlade, duplicate challenger: 0
vBlade, discard neighbour: 5
vBlade, too many neighbours: 0
vBlade, duplicate neighbours: 0
vMaster, discard challenger: 0
vMaster, new challenger: 0
vMaster, replace challenger: 0
vMaster, duplicate challenger: 0
vMaster, discard neighbour: 0
vMaster, too many neighbours: 0
vMaster, duplicate neighbours: 0
Enter MC: 1
Enter vBlade: 1
Enter vMaster: 1
Enter MTO: 1
Leave MC: 1
Leave vBlade: 1
Leave vMaster: 0
Leave MTO: 1
vMaster:
Start Time: 2016-03-22 13:52:49.292000
Start vBlade Errors: 0
vBlades Started: 8
vBlades stopped: 6
Received Configuration Updates: 15614
Last Configuration Update: 2016-04-29 16:38:26.940000
Local Configuration Update Errors: 0
Remote Configuration Update Errors: 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade: 0
Start Time: 2016-03-24 13:59:52.624000
Device-ID: 2
Receive Errors: 0
Send Errors: 0
Received Bytes: 851719626
Sent Bytes: 93655729
Received Messages: 1128543
Sent Messages: 1128543
Invalid Messages: 0
Sent Keepalives: 1005353
Sent Configuration Updates: 123190
Last Configuration Update: 2016-05-02 08:51:52.588000
Local Configuration Update Errors (1): 0
Remote Configuration Update Errors: 0
Local Configuration Update Errors (2): 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade: 1
Start Time: 2016-04-15 13:33:38.292000
Device-ID: 3
Receive Errors: 0
Send Errors: 0
Received Bytes: 415730885
Sent Bytes: 35886772
Received Messages: 487416
Sent Messages: 487416
Invalid Messages: 0
Sent Keepalives: 435020
Sent Configuration Updates: 52396
Last Configuration Update: 2016-05-02 08:51:07.528000
Local Configuration Update Errors (1): 0
Remote Configuration Update Errors: 0
Local Configuration Update Errors (2): 0
Configuration Update Notif Errors: 0
Configuration Update Result Errors: 0
vBlade:
Start Time: 2016-03-22 13:51:13.852000
Receive Errors: 0
Send Errors: 0
Received Bytes: 2016
Sent Bytes: 10868
Received Messages: 28
Sent Messages: 28
Invalid Messages: 0
Received Keepalives: 25
Received Configuration Updates: 0
Last Configuration Update: N/A
Configuration Update Failures: 0
2016/05/02 07:11:45, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 51
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], getting the running-configuration from vblade 1
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 49
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 48
2016/05/02 07:11:43, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 50
2016/05/02 07:11:42, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 22
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 22
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 21
2016/05/02 07:11:40, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 21
2016/05/02 07:11:39, [election called by a10dcs(11696)], send vMaster pdu
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, received msg 22
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, received msg 22
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 0, msg loop, sent msg 21
2016/05/02 07:11:37, [vMaster called by a10dcs(11696)], vBlade 1, msg loop, sent msg 21
Tagged:
0