Cisco UCS 5108 Chassis Power Policy Options and Redundancy Demystify

Cisco UCS server chassis 5108 comes with three (03) different Power Policy options; UCS power management is efficient and energy saving by default but NONE of the policy option explanation says which PSUs will be full ON and which PSUs will be put on to Power Saving Mode. This is what official Cisco document says about these options:

  • Non Redundant – All installed power supplies are turned on and the load is evenly balanced. Only smaller configurations (requiring less than 2500W) can be powered by a single power supply.
  • N+1 – The total number of power supplies to satisfy non-redundancy, plus one additional power supply for redundancy, are turned on and equally share the power load for the chassis. If any additional power supplies are installed, Cisco UCS Manager sets them to a “turned-off” state.
  • Grid – Two power sources are turned on, or the chassis requires greater than N+1 redundancy. If one source fails (which causes a loss of power to one or two power supplies), the surviving power supplies on the other power circuit continue to provide power to the chassis.

Probably the above definition applied to old version UCS and not the latest. Also I couldn’t find details on what exactly happen on power redundancy when you have 2 x PSUs and 4 x PSUs installed and your power load is not very high due to not all the blades are installed and functional.

Cisco-UCS-PowerPolicy-1

Following are what I captured regarding which PSUs will be ON and PSUs will be put on to Power-Saving-Mode when you set different “Power Policy” options – this is done a four (04) PSU server chassis. Changing in Power Policy takes effect immediately (might be a 10-20 second delay to refresh the Web GUI) and it doesn’t require any system reboot.

Assumption is all the four (04) PSUs are installed and connected to power socket; also the chassis is running 2 blades.

When Power Policy is set N+1, this is what happen:

PSU1 – ON
PSU2 – ON
PSU3 – OFF (Power Saving Mode)
PSU4 – OFF (Power Saving Mode)

When Power Policy is set GRID, this is what happen:

PSU1 – ON
PSU2 – OFF (Power Saving Mode)
PSU3 – ON
PSU4 – OFF (Power Saving Mode)

When Power Policy is set Non-Redundant, this is what happen (only one is ON! not ALL):

PSU1 – ON
PSU2 – OFF (Power Saving Mode)
PSU3 – OFF (Power Saving Mode)
PSU4 – OFF (Power Saving Mode)

Data centre racks are equipped with two power rails – A (left hand side) & B (right hand side) for redundancy. Now interesting thing is – your physical power connection must be in-line with the UCS Power Policy options, otherwise your blades will be rebooted in case any power issue on “power rail A”.

You can have only two different combinations of power connections to connect all the four (04) PSUs to the power rails A & B. The combinations are following –

Option 1:
PSU1/PSU2 (first two) connected to > power rail A
PSU3/PSU4 (last two) connected to > power rail B

Option 2:
PSU1/PSU3 (odd numbers) connected to > power rail A
PSU2/PSU4 (even numbers) connected to > power rail B

I had N+1 configured with “Option 1” and power issue due to maintenance on rail A rebooted my blades!

This is what happen as following – either “you are saved” during a power failure on rail A! or “you are not saved!

GRID Mode with (Option 1) PSU1/PSU2 to A & PSU3/PSU4 to B;You are saved!
PSU1 – A ON
PSU2 – A OFF (Power Saving Mode)
PSU3 – B ON
PSU4 – B OFF (Power Saving Mode)

GRID Mode with (Option 2) PSU1/PSU3 to A & PSU2/PSU4 to B;You are NOT saved
PSU1 – A ON
PSU2 – B OFF (Power Saving Mode)
PSU3 – A ON
PSU4 – B OFF (Power Saving Mode)

Screenshot of GRID mode following –

Cisco-UCS-PSU-GRID-Pic1

N+1 Mode (Option 1) PSU1/PSU2 to A & PSU3/PSU4 to B;You are NOT saved!
PSU1 – A ON
PSU2 – A ON
PSU3 – B OFF (Power Saving Mode)
PSU4 – B OFF (Power Saving Mode)

N+1 Mode (Option 2) PSU1/PSU3 to A and PSU2/PSU4 to B;You are saved!
PSU1 – A ON
PSU2 – B ON
PSU3 – A OFF (Power Saving Mode)
PSU4 – B OFF (Power Saving Mode)

Screenshot of N+1 mode following –

Cisco-UCS-PSU-N1-Pic1

Non-Redundant Mode (Option 1) PSU1/PSU2 to A & PSU3/PSU4 to B;NOT saved!
PSU1 – A ON
PSU2 – A OFF (Power Saving Mode)
PSU3 – B OFF (Power Saving Mode)
PSU4 – B OFF (Power Saving Mode)

Non-Redundant Mode (Option 2) PSU1/PSU3 to A & PSU2/PSU4 to B;NOT saved!
PSU1 – A ON
PSU2 – B OFF (Power Saving Mode)
PSU3 – A OFF (Power Saving Mode)
PSU4 – B OFF (Power Saving Mode)

Screenshot of Non Redundant mode following –

Cisco-UCS-PSU-NonRedundant-1.jpg

9 thoughts on “Cisco UCS 5108 Chassis Power Policy Options and Redundancy Demystify

    • Hi Curtis, I haven’t tried this – turning on all PSUs at a time. I think this might be proportionate to blade density – probably a fully loaded 5108 chassis turns on all of its PSUs! Unfortunately none of my 5108 blade chassis are fully loaded (4-6 blades on each chassis).

      If you have a non-production fully loaded chassis – please simulate different power options and let us know your experience.

      Cheers.

      Like

  1. Hello,I read your new stuff named “Cisco UCS 5108 Chassis Power Policy Options and Redundancy Demystify | iCookServers-&-Networks” regularly.Your story-telling style is witty, keep it up! And you can look our website about free proxy.

    Like

  2. what happen if i connect this way
    Option 3
    PSU1/PSU4 (extremes two) connected to > power rail A
    PSU2/PSU3 (middle two) connected to > power rail B

    GRID Mode with (Option 3) PSU1/PSU4 to A & PSU2/PSU3 to B; are we saved?
    PSU1 – A ON
    PSU2 – B OFF (Power Saving Mode)
    PSU3 – B ON
    PSU4 – A OFF (Power Saving Mode)

    ARE WE SAVED?

    Like

    • I would move all VMs/services running on the physical node to -> another physical node before applying a new power policy just to minimise any impact.

      Like

  3. Great article. I have a question. I have an N+1 config, in which Power A goes to PSU 1,2 and B to 3,4. Thus Option 1. But, if all the PSUs are ON, (not in power save mode), if Power A or B fails, the chassis will still be up. Are we safe to say in there are no PSUs in power saving move we are OK?

    N+1 Mode (Option 1) PSU1/PSU2 to A & PSU3/PSU4 to B;You are NOT saved!
    PSU1 – A ON
    PSU2 – A ON
    PSU3 – B OFF (Power Saving Mode)
    PSU4 – B OFF (Power Saving Mode)

    N+1 Mode (Option 2) PSU1/PSU3 to A and PSU2/PSU4 to B;You are saved!
    PSU1 – A ON
    PSU2 – B ON
    PSU3 – A OFF (Power Saving Mode)
    PSU4 – B OFF (Power Saving Mode)

    Like

    • Thanks; I no longer have 5108 chassis in any of our data centres; also Cisco made changes in their later firmware versions. Unfortunately, I don’t have any further information on this.

      Like

  4. Pingback: Cisco UCS 5108 Chassis Power Policy Options and Redundancy – Real World UCS

Leave a comment