Tuesday, March 22, 2016

NE Configuration Loss Due to Disabling of the Automatic and Periodic Database Backup Functions on MSTP Products

Summary:If the automatic and periodic database backup functions of an MSTP NE are disabled, NE configurations may be lost after the system control board is warm or cold reset, active and standby 
system control boards switch over, or the NE is restarted.
[Problem Description]
Trigger conditions:
This problem occurs if the following conditions are met:
Automatic and periodic database backup functions of the NE are disabled.
After automatic and periodic database backup functions of the NE are disabled, modifications such as service configuration or ASON rerouting are made to the NE.
The system control board is warm or cold reset, active and standby system control boards switch over
or the NE is restarted.
Fault symptoms:
After the system control board is warm or cold rest or active and standby system control boards switch over, some configurations modified after automatic and periodic database backup functions of
 the NE are disabled may be lost. In this case, a service board reset will result in complete or incomplete service interruption.
After the NE is restarted, some configurations modified after automatic and periodic database backup functions of the NE are disabled may be lost, resulting in complete or incomplete service interruption.
Identification method:
This problem can be identified using the inspection tool or commands.
Problem identification using the inspection tool
For OptiX OSN 5X0 (except OptiX OSN 580) of versions earlier than V100R006C00, OptiX OSN 2000, OptiX OSN 1500/2500/2500REG/3500/3500II/3580/7500/7500II of V100R010 and TDM versions earlier than V100R010, OptiX OSN 9500, and OptiX OSN 9560, run the check item selected in the following figure.


For OptiX OSN 5X0 (except OptiX OSN 580) of V100R006C00 and later versions, and OptiX OSN 1500/2500/2500REG/3500/3500II/3580/7500/7500II of V100R009C03, V200R011, and packet versions later than V200R011, run the check item selected in the following figure.


For OptiX OSN 580, run the check item selected in the following figure.


For OptiX Metro 1000 V300, run the check item selected in the following figure.


For OptiX Metro 3000, run the check item selected in the following figure.


If the check results meet the analysis result shown in the following figure, the automatic and periodic database backup functions are disabled.


Problem identification using commands

Whether automatic and periodic database backup functions are enabled cannot be queried using the NMS.
Periodic database backup
Run the :dbms-get-cyclebackup command. If the returned result is disable, periodic database backup is disabled.
The following figure shows an example.


Automatic database backup
Run the :dbms-get-autobackup command. If the returned result is disable, automatic database backup is disabled.
The following figure shows an example.


[Root Cause]
After automatic and periodic database backup functions of the NE are disabled, new configurations or configuration modifications cannot be saved to the database. Therefore, after the system control board is warm or cold reset, active and standby system control boards switch over, or the NE is restarted, the new configurations or configuration modifications fail to be restored from the database, resulting in partial or complete configuration loss.

[Impact and Risk]
Scope: in and outside China
Risk: New configurations and configuration modifications may be lost after the system control board is warm or cold reset, active and standby system control boards switch over, or the NE is restarted.

[Upgrade Scenario]
System control board reset and active/standby switching are required during an NE upgrade. If automatic and periodic database backup functions are disabled before the NE upgrade, NE configurations may be lost after the NE upgrade.
According to the OptiX NG-SDH Upgrade Guide_Simulation Package Loading Method, checking the consistency of databases and checking the periodic backup and automatic backup statuses must be performed before the NE upgrade. In addition, NE upgrade must be performed by following instructions in the corresponding upgrade guide; otherwise, exceptions may occur during the NE upgrade.
NoteCurrently, the OptiX database check tool can automatically check whether backed up databases are normal. However, it cannot identify whether the backed up database is the latest one. Therefore, before upgrading an NE, use the inspection tool to check whether the automatic and periodic database backup function is enabled. If the function is disabled, please enable it.







[Measures and Solutions]
Recovery measures:
If automatic and periodic database backup functions are detected to be disabled while services are not affected, run the following commands to enable the functions:
Automatic database backup:
:dbms-set-autobackup:enable
Periodic database backup:
:dbms-set-cyclebackup:enable;
Then, run the :dbms-copy-all:drdb,fdb command to manually save new configurations and configuration modifications to the database.
If automatic and periodic database backup functions are detected to be disabled and services are interrupted, perform the following operations to restore the services:
Run the following commands to enable the automatic and periodic database backup functions.
Automatic database backup:
:dbms-set-autobackup:enable
Periodic database backup:
:dbms-set-cyclebackup:enable;

Restore configurations.
Use the NMS to re-deliver configurations to the NE according to the corresponding product guide.

After services are interrupted, do not upload configurations to the NMS. Otherwise, configurations on the NMS and NE will be inconsistent.
Run the :dbms-copy-all:drdb,fdb command to manually save configurations to the database.
----End
Workarounds:
Exercise caution when using the commands to disable automatic and periodic database functions. In some maintenance scenarios, the two functions need to be disabled. Promptly enable the two functions once the maintenance is finished.
Solutions:
Same as the recovery measures

More blog:

What’s the IGMP Framework on the Device

No comments:

Post a Comment