How to precaution the using problem of Huawei MA5603T product?

Sub-product line: Access Network Line   Product: MA5603T

[Problem Description]

In the 6 U MA5603T, when the H801BIUA board with the software of 117 or earlier versions works with the SCUB, SCUL, and SCUF control boards, the H801BIUA board fails to register and is in the faulty state all the time, and the board in slot 0 resets repeatedly.

[Cause Analysis]

The software version of the H801BIUA board is too early. In the 6 U MA5603T, the H801BIUA board is installed in slot 12, and in other products which use the H801BIUA board with the software of 117 or earlier versions, the H801BIUA board can only be installed in slot 0. If the H801BIUA board with the software of 117 or earlier versions is installed in slot 12 of the MA5603T, the master-slave communications of the boards in slots 12 and 0 conflict with each other, the board in slot 0 resets repeatedly and the H801BIUA board is in the faulty state all the time.

[Impact and Risk]

1. In the 6 U MA5603T, the H801BIUA board can not start up in the normal state.

2. In the 6 U MA5603T, the board in slot 0 resets repeatedly.

[Measures and Solutions]

Avoidance Measures:

Do not use the H801BIUA board with the software of 117 or earlier versions in the MA5603T.

Solution:

When the problem occurs, re-load the software of the H801BIUA board to the version that matches the host version through the serial port cable (the BOM of the serial port cable is 04028285) of the H801BIUA board. Upgrade the software of the H801BIUA board through the commissioning subboard and then load the BIOS software online through the host.

[Supplementary Information]

The methods of checking the software version of the H801BIUA board are as follows:

(1) If the board is in use, run the display version command through CLI on the host.

For example:

MA5603T(config)#display version 0/12

  Main Board: H801BIUA           

  ---------------------------------------     

  Pcb            Version: H801BIUA VER B

  Mab           Version: 0001           

  Logic          Version: (U21)102        

                                       

  Main CPU:                            

  APP           Version: 118(2009-1-17)   

  BIOS          Version: 118             

  SubClockBoard:                      

    PCB        Version: H802CKMA VER B  

    Software    Version: 103                  

    Bios        Version: 103                 

  ---------------------------------------

The number after "APP Version" is the APP version of the board.

The number after "BIOS Version" is the BIOS version of the board.

(2) Use the related board commands to query the software version through the serial port on the board.

     BIUA>1

    SFT ver:118

    BIO ver:118

    PCB ver:B

    CPD ver:(U21)102

    Cmp tim: Jan 14 2009 14:47:25

     H802CKMA

     SFT ver:103

     BIO ver:103

     PCB ver:B

     BIUA>

(3) Manually upgrade the BIOS and APP.

1) Install the H801BIUA board in the shelf and then connect the PC serial to the H801BIUA board through the commissioning subboard H561SEDB. Log in to the H801BIUA board through the serial port of the PC. For how to log in to the H801BIUA board through the serial port

2) Upgrade the APP. When the following information is displayed during the startup, press d to begin the loading.

starting...          

 ma5600 BIUA Bios

 BIOS Ver 118,     

 PCB Ver B,       

 Manu Ver 1,       

 Cpld Ver 102      

 Build time: Jan 14 2009 12:09:10

 Please Press <D> key download app program with XModem ... 2

 Press CTRL+C key to abort!                             

 Waiting ...CCCC

3) On the GT3000, choose File > Transfer > XMODEM > Send, and then choose the APP file to be loaded.

Please Select Program File .

XMODEM downloading ...CCCC

4) The APP loading is completed.

5) Upgrade the BIOS: install the board into the shelf and then run the following command in the CLI of the host after the board is in the normal state.

MA5603T(config)#load program

{ emu<K>|ftp<K>|sftp<K>|tftp<K>|xmodem<K> }:xmodem

{ frameid/slotid/subid<S><Length 1-15>|frameid/slotid<S><Length 3-15>|frameid<U>

<0,32> }:0/12

           

  Command:

          load program xmodem 0/12

  Current baud rate is 9600bps, and it can be modified by 'baudrate' command

  Are you sure to use this baud rate? (y/n)[n]:y

  Whether to load other boards of same type ? (y/n)[n]:

  Board name[H801BIUA]:

  Whether to start loading? (y/n)[n]:y

You can also load the program in the tftp mode.

6) After the BIOS and the APP are loaded successfully, used methods (1) and (2) in the preceding section to check whether the loaded versions are correct.

MORE BLOG:

Due to disabling TDC-ADJUSTENABLE function high Bit errors on NS3 card

When compatible stp mode in S5700 Huawei switch with pvst in cisco switches?

When OSN 1500 R1PCXLN board fails to query optical power due to software BUG?

Board Resets due to High Temperature

Summary: In V800R008 and earlier versions, the MA5683T and MA5603T, if working in the automatic 

fan speed adjustment mode, read the air intake vent temperature as a reference temperature for fan speed 

adjustment. The air intake vent temperature is usually the ambient temperature, which is low. As a result,

 fans are running at low speed and cannot meet heat dissipation requirements. The possibility of board resets due to high temperature increases.

Moreover, finish fan tray replacement within a proper period (less than 3 minutes from removal of the original fan tray to the insertion of a new fan tray as suggested by the product manual). If the replacement takes too 

long time, ineffective heat dissipation of equipment may occur, causing high risks of board resets due to high 

temperature. 

[Problem Description]

Trigger conditions:

1 The MA5683T/MA5603T products are involved.

2 The software version is V800R008 or an earlier version.

3 Fans work in the automatic speed adjustment mode.

If all the above three conditions are met, poor board heat dissipation is prone to occur and there are risks of board resets due to high temperature.

Symptom:

The equipment or NMS has high temperature alarms for boards. Board resets and service interruptions or 

even repeated board resets and service interruptions may occur.

Identification method:

Check whether fans are blocked. If high temperature is confirmed to cause the boards resets, query board 

temperature to see whether it is over high (recommended board temperature: 65°C or lower). Meanwhile,

check whether fans work in the automatic speed adjustment mode.

Run the display fan alarm command to check whether fans are blocked.

MA5603T(config-if-fan-0)#display fan alarm                                      

  EMU ID: 0                                                                     

  ----------------------------------------------------------------------------  

  Alarm name                    Alarm state                                     

  ----------------------------------------------------------------------------  

  Read temperature fault        Normal                                          

  Fan block                     Normal                                          

  Temperature abnormal          Normal                                          

  Power fault                   Alarm                                           

 ----------------------------------------------------------------------

Run the MA5603T (diagnose)%%display reset-record command to check for historical alarms of boards. 

The board reset and high-temperature alarm logs are as follows:

------------------------------------------------------------------------            

  05-04 09:57:13  Frame 0  Slot 8  Line:3085                

  Reset reason:The board is reset when the link is faulty.                

  Stack info: 0x03474ef8  0x0349582c

  ----------------------------------------------------------------------------                 

  05-04 09:56:23  Frame 0  Slot 16  Line:1207                

  Reset reason:The board or LSW port is powered off due to high-temperature 

protection of the main control board                

  Stack info: 0x03474ef8  0x03461388

  -----------------------------------------

Run the MA5603T(config)#display temperature 0/slotid command to query the board temperature.

Run the MA5603T(config-if-fan-0)#display fan speed mode command to query the working mode of fans.

[Root Cause]

The heat dissipation design for fan trays of the MA5683T/MA5603T is at the early version planning phase. The fan trays are intended for low-power boards. With the development and application of high-density, large-capacity, and high-power boards, the fan speed adjustment policy of the MA5683T and MA5603T of V800R008 or an earlier version is inadequate.

In V800R008 and earlier versions, the MA5683T and MA5603T, if working in the automatic fan speed 

adjustment mode, automatically adjust the fan speed according to the temperature of the air intake vent on 

the equipment. The temperature of the air intake vent on the equipment is close to the ambient temperature 

(lower than the board temperature). As a result, fans work at a low speed most of the time. 

In this case, heat cannot be properly dissipated from the equipment and boards work at high temperature, 

causing board resets and service interruptions.

Fan tray of the MA5683T and MA5603T

[Impact and Risk]

In summer, the ambient temperature is high. If the equipment configuration or service load is high, board 

resets in the problem description may occur, causing service interruptions.

[Measures and Solution]

Recovery measures:

Set the fan speed adjustment mode to the manual mode, and adjust speed levels.

For V800R008 and earlier versions, fans in the manual mode can only be adjusted to a fixed rotation speed. Fan speed levels range from 0 to 5. Level 0 indicates a 50% rotation speed. The increase of a level means 

a 10% increase of the rotation speed. The maximum rotation speed is 100%. It is recommended that you 

set the fan speed to level 2 or 3. Observe the board temperature for a period of time. If the board 

temperature stays at about 65°C, the fan speed is suitable.

Run the following commands to query the fan tray parameters:

MA5603T(config)#interface emu 0

MA5603T(config-if-fan-0)#display fan system parameter

EMU ID: 0                                                                     

  FAN configration parameter:                                                   

  ----------------------------------------------------------------------------  

  FAN timing mode: Manual timing                                                

  FAN speed level: 1                                                            

  ----------------------------------------------------------------------------  

  Alarm_name                        Permit/Forbid                               

  Read temperature fault                Permit                                  

  Fan block                             Permit                                  

  Temperature high                      Permit                                  

  Power fault                           Permit                                  

  ----------------------------------------------------------------------------

MA5603T(config-if-fan-0)#fan speed mode manual         

MA5603T(config-if-fan-0)# fan speed adjust 2       

Preventive measures:

Periodically clean the subrack air filter and dust on fans to avoid poor heat dissipation.

For MA5683T and MA5603T NEs, query the board temperature. If the board temperature exceeds 65°C, set the fan speed adjustment mode to the manual mode, and adjust speed levels. For details, refer to the 

recovery measures above.

Solution: 

Upgrade the equipment version to V800R009 or later. In V800R009 and later versions, the MA5683T and MA5603T, if working in the automatic fan speed adjustment mode, automatically adjust the fan speed 

according to the board temperature.

[Relevant Maintenance Precautions] (Not Directly Related to the Warning Above)

Time Constraints on Fan Tray Replacement

If a fan tray is removed for cleaning or replacement, large-power components on boards heat apparently and board temperature rises fast. To prevent abnormal board resets due to high temperature, finish the fan tray replacement within a proper period.

As described by the following precautions for operation guidance of the relevant product manual, the time used for replacing a fan tray is suggested to be within 3 minutes.

[Rectification Scope and Time Requirements]

N/A

[Attachment]

N/A

More blog:

How to change the MA5600T Boards

How to precaution the using problem of Huawei MA5603T product?

MA5616 Resource Overload Due to the Registration Using an H.248 Service Domain Name-20131010-A

when Some Abnormal OLT Optical Modules at High Temperature

Some OLT GPON CLASS B+ optical modules provided by SOURCE PHOTONICS 

may rarely become faulty after long-term working at high temperature, resulting in unstable transmit optical power, and ONUs being 

offline.

Product Line: Access network          Product Family:   OLT

Product Model:  MA5600T, MA5603T, MA5680T, and MA5683T               

Keywords:  GPON CLASS B+, SPS-43-48H-HP-CDE, high temperature, offline ONU

[Problem Description]

Trigger conditions:

1.Optical modules have been working at the temperature higher than 60 degrees for a long term.

2.Optical modules are OLT GPON CLASS B+ optical modules of the SPS4348HHPCDE model 

provided by SOURCE PHOTONICS.

When the above conditions are met, 0.143% of the optical modules may have unstable transmit 

optical power, resulting in offline ONUs.

Symptoms:

Optical modules have unstable transmit optical power, resulting in offline ONUs.

Identification methods:

Method 1

If the ONU that connects to the PON port on a GPBD board is offline, perform the following 

steps to check whether the cause is the involved optical module in the warning.

Step 1 Check whether the optical module is working at high temperature and belongs to the 

SPS4348HHPCDE model.

Steo 2 Run the command to check whether the optical module has been working at high temperature 

for a long term.

Temperature(C)               60    ----Enclosure temperature of the involved optical module in the warning exceeds 60 degrees.

Step 3 Run the command or query the label on the top side of the optical module to check whether 

the optical module is the SPS4348HHPCDE model.

Query using the command

Related optical module information in the query result is as follows:

Vendor PN            SPS4348HHPCDE       ----involved vendor PN

Vendor name          SOURCEPHOTONICS     ----involved vendor name

Query the label on the top side of the optical module.

The involved information is in red blocks on the label on the top side of the optical module, as shown 

in Figure 1.

Figure 1 Label on the top side of the optical module.

Step 4 Check whether the optical module is the involved optical module in the warning based on the 

transmit optical power. If the transmit optical power not in the range from 1.5 dBm to 5 dBm after 

multiple queries (using commands), the optical module is the involved optical module in the warning.

TX power(dBm)                -10.61    ----The transmit optical power of the involved optical module is generally less than 1.5 dBm and a negative 

number.

Query command:

:display port state [ponid]

MA5600T(config)#interface gpon 0/2                                                   

                                                                                            

MA5600T(config-if-gpon-0/2)#display port state 1                                  

---------------------------------------------------------------------------

 F/S/P                        0/2/1                                                      

  Optical Module status        Online                                                  

  Port state                   Offline                                                   

  Last down cause              -                                                         

  Last up time                 -                                                          

  Last down time               -                                                         

  Laser state                  Normal                                                    

  Available bandwidth(Kbps)    1239168                                                 

  Temperature(C)               60          ----current enclosure temperature       

  TX Bias current(mA)          12                                                        

  Supply Voltage(V)            3.07                                                      

  TX power(dBm)                -10.61      ----current transmit optical power     

  Illegal rogue ONT            Inexistent                                              

  Max rate(Kbps)               2500000                                                  

  Max Distance(Km)             20                                                        

  Wave Length(nm)              1490                                                      

  Fiber type                   Single Mode                                               

  Signal detect                Failed                                                    

  TX fault                     Normal                                                     

  Identifier                   SFP                                                        

  Ext.Identifier               GBIC/SFP function is defined by serial ID only    

  Connector                    SC                                                          

  Encoding                     NRZ                                                         

  Length(9um)(Km)              20.0                                                       

  Length(50um)                 -                                                           

  Length(62.5um)               -                                                           

  Length(Copper)               -                                                           

  Cc_base                      0xa2                                                         

  CC_EXT                       0xb2                                                         

  BR,max                       Unspecified                                                 

  BR,min                       Unspecified                                                 

  SFF-8472 Compliance          Includes functionality described in Rev 9.4        

  Diagnostic Monitoring Type   Digital diagnostic monitoring                       

                               Externally Calibrated                                      

                               Power measurement type: Average Power                   

  Options                      TX_DISABLE,and disables the serial output             

                               TX_FAULT                                                      

                               LOS(signal inverted from standard definition)          

  Enhanced Options             Alarm/warning flags                                      

                               TX_DISABLE control and monitoring                        

                               TX_FAULT monitoring                                         

  Vendor Rev                   Unspecified                                                 

  Vendor PN                    SPS4348HHPCDE       ----vendor PN                       

  Vendor SN                    B4W2001959                                                 

  Manufactured                 10-04-29                                                   

  Vendor name                  SOURCEPHOTONICS     ----vendor name                    

  Vendor OUI                   0006b5                                                      

  Vendor specific              53 50 53 2d 34 33 2d 34 38 48 2d 48 50 2d 43 44    

                               45 20 20 20 20 20 20 20 20 20 00 00 00 00 00 00       

  Module type                  -                                                            

  Module sub-type              -                                                           

  Used type                    -                                                            

  Encapsulation Type           -                                                          

  ---------------------------------------------------------------------------- 

----End

Method 2

Use the SMARTKIT inspector to query all optical modules. Manually collect information about 

vendor PN, transmit optical power, and enclosure temperature in the query results, as shown 

in Figure 2.

Characteristics of the involved optical module: The temperature is higher than 60 degrees, the 

transmit optical power is not in the range from 1.5 dBm to 5 dBm, the vendor PN is 

SPS4348HHPCDE, and the vendor is SOURCE PHOTONICS.

Figure 2 Information collection in the query results

Select the two check items as shown in the Figure 3.

Figure 3 Inspection template configuration

[Root Cause]

Some optical modules may rarely become faulty after long-term working at high temperature, resulting in unstable transmit optical power.

[Impact and Risk]

When the problem occurs, corresponding ONUs are offline. According to the vendor, 0.143% of 

the optical modules may become faulty at high temperature.

[Measures and Solutions]

Recovery measures:

Perform the following steps to cool the enclosure of the involved optical module.

Tune down the temperature in the equipment room.

If dust on fans or subracks results in weak heat dissipation capacity, urge customers to clear the 

dust. For details, customers can refer to corresponding product documentation, such as the 

MA5600T&MA5603T V800R011C00 Product Documentation 03.

Manually accelerate the rotating speed of fans. (Long-term high-speed rotation shortens the useful life of a fan, so this solution is just a temporary solution.) Setting 

examples are as follows:

For V800R005/V800R006/V800R007/V800R008:

MA5600T(config)#interface emu 0 

MA5600T(config-if-fan-0)#fan speed mode manual 

MA5600T(config-if-fan-0)#fan speed adjust 5

For V800R009/V800R010/V800R011/V800R012:

MA5600T(config)#diagnose 

MA5600T(diagnose)%%fan speed mode manual 6

NOTE:

The digit in red in the command indicates the rotating speed level of the fan (the highest levels 

for V800R008 and V800R011 are 5 and 6 respectively), the higher the digit, the faster the rotating 

speed. It is recommended to tune up the rotating speed to the maximum, and then gradually tune 

it down. Long-term high-speed rotation shortens the useful life of a fan. Therefore, exercise caution when adopting this solution.

Preventive measures:

Use the preventive maintenance inspection tool to check the enclosure temperature of optical modules 

on the live network. For the site where the enclosure temperature of optical modules is higher than 60 

degrees, urge customers to improve equipment room environment. The recommended temperature is 

about 23 (±1) degrees.

Solution:

When the problem occurs, perform the recovery measures to cool involved optical modules, and then 

perform the following steps based on actual situations:

If the problem is solved, the optical module can be used but not used at high temperature.

If the problem persists (the hardware of the optical module is faulty), use a spare part to replace it. A 

small number of faulty optical modules can be directly sent to Huawei for repair based on the specified 

procedure. A large number of faulty optical modules are handled by corresponding regional service 

contact personnel.

[Warning Conditions]

The warning does not take effect when the trigger conditions are not met.

[Attachment]

None

More blog: 

Huawei OLT MA5600T Series Equipment Upgrade Instructions

​MA5600T Series Equipment Aggregate Docking Cisco Equipment