 |
|
Datatrend Newsletter
2Q 2007 |
|
Turning the
Data Center a Deeper Shade of Green
|
|
President's
Perspective |
 |
|
|
Power and cooling planning
and solutions are a serious part of the spend (and potential
savings) in your IT investments. The growing importance of this
topic in data center decisions is the theme of our newsletter. |
|
The Scramble to
be "Seen
to Be Green" |
 |
|
|
From ethanol-powered cars to tax
credits for renewable energy plants, the focus on excessive energy consumption
and its fallout is all around us. The average data center is
the poster child for reducing power usage. Here we'll examine
why, with a look at the "second order" effect of cooling. |
|
Measuring Server Power
Consumption |
 |
|
|
Before data center managers can implement the
right "greening" solutions, they must be able to measure
the rate at which their servers consume power. In this article we will
discuss how, despite the inherent challenges of doing so, a
new standard has emerged and
we'll touch on the "performance per watt" metric. |
|
Consolidate and
Virtualize to Save (Perhaps Big) |
 |
|
|
Now let's get down to how greening the data center
can be good for your business. Here
we'll demonstrate the sort of savings that are possible when you
adopt the "consolidate and virtualize"
mantras of today's server environment. |
|
Score One for You,
One for Green |
 |
|
|
Here we turn towards putting other power savings
measures into practice. Busy data center managers can't make, in
some cases, major changes just because it's a win for green. We're here
to demonstrate three "non-server" related things you can do which are
both a
win for you and a win for the planet. |
|
TechTip:
Rack ‘em Stack ‘em... remember to keep your AIRFLOW in check |
 |
|
|
As
racks and server components are reconfigured or added,
inadvertent mixing of hot and cold air or insufficient airflow
can cause problems. Here are some tips to help improve airflow
and cooling. |
| |
|
 |
 |
 |
Find out more
Here's how to find out more or move ahead:
Needs consultation:
Our needs consultants are highly experienced and can discuss your specific
situation. Call them to discuss your data center or anything else. If they
don't know the answer, they know how to find out. It's a free service with no
obligation or pressure. You decide if and when to proceed beyond the initial
consultation.
 |
 |
| |
|

We publish this newsletter
quarterly for our valued customers.
To review past editions or add
colleagues to the distribution, click the links below:
TrendSetter Archives
New Subscriptions |
| |
| |
|
|
 |
|
President's Perspective
Power
and Cooling in the Data Center
In this issue of TrendSetter, we move
away from the more traditional content associated either with
specific technology realms, vertical offerings, industry specific
issues or services... into the ever maturing science now being
applied to planning and implementing power/cooling and related data
center considerations. While the manufacturers today are providing
more useful power and cooling spec data, than compared to the past,
the science and art of planning requirements and articulating needs
(in the form that translates into material business impact) is being
realized by the IT talent leaders in the industry today.
|
 |
|
|
The
most significant and positive contrast in looking at full IT
business planning today, compared to yesteryear, is how big a role
the power and cooling facts and projections are playing in data
center decisions. Those on the leading edge of this analysis curve
are a step ahead of the rest, and will soon find data center
managers quickly adding this criteria to their decision making
factors. Power and cooling planning and solutions are a serious part
of your spend and savings in your IT investments. There can be huge
cost variances, over just a few years, between differing
architectures under consideration and how the workloads are managed
using advanced functions. The following articles will delve into the
topic of power and cooling to help you get a better understanding
and offer advice as you bring this important cost-saving measure
into your decision making.
Enjoy this edition of
TrendSetter and look for a Datatrend webinar covering this subject
in the near future.
|
 |
|
The Scramble to be "Seen to be Green"
Everywhere you turn these days, there's heated discussion about fossil fuel
consumption and rising oil/gas prices — and about how renewable energy sources are
at least part of the answer to both. Everyone wants to be "seen to be
green", including President Bush who, in his
promotion of higher ethanol to gas ratios and
tax
|
 |
credits for renewable energy plants, makes continuing references to being "good stewards of the
environment".
Of
course, the average person or business is a long way from powering their
home or workplace with renewable energy sources like wind.
And the average data center is a long way from operating in a dark green, liquid-cooled state.
|
|
|
Not
surprisingly, most of the reasons come back to costs. But before we delve
into any costs associated with "greening" (many of which are off-set by
the resulting savings in other areas), let's take a look at how energy costs did
their part to push us all towards the green "movement".
The eternal laws of supply
and demand
It
appears you can never get away from the fundamental demand rises, supply
goes down, prices go up principle, whether the subject is houses, cars,
crops or electricity. As the charts below illustrate, the demand for
electricity over the past 10 years has increased by
approximately 30% which, in turn, has driven the price per kilowatt hour up
by about the same amount.
|
|
|
|
Given that energy
costs consume approximately 20% of the average data center budget, power consumption
and cooling issues are, if not taking center stage, at least no longer
waiting in the wings.
Why data centers are the
"SUVs" of corporate facilities
It is
estimated that a typical 10,000 sq ft data center consumes enough
electricity to turn on more than 8,000 60-Watt light bulbs. This amount is
somewhere around ten times the amount of electricity needed to operate
a typical office building during peak hours. In many ways, the data
center design is inherently "un-green":
-
Centers run in an always-on 24x7 state
-
Powerful machines consume a lot of energy
-
Energy consumed produces heat — heat requires cooling
-
Much of the cooling equipment uses toxic chemicals which, in and of
itself, have a negative impact on the environment.
Cooling as the "second
order" effect
|
|
Replacing computer hardware with newer and
more powerful machines cannot be the stand-alone answer to turning your data
center a deeper shade of green.
This is due to the fact that ironically,
higher-performance machines can be part of the energy consumption problem.
As machines become more powerful, they generate
more heat. This falls under the "robbing Peter to pay Paul" heading:
what you gain in efficiency per unit of computing, you lose in cooling power
requirements.
Stated another way, for every watt of power
used by today's computer hardware, one or more is needed to remove heat
waste (heat dissipation rises with increasing chip clock speeds). And, the
more heat there is to remove, the bigger your data center's cooling bills
will be.
|
|
A picture
is worth a thousand words..
In the front is a Pentium
Overdrive from 1993, complete with its cooler. The looming
presence behind it is the standard Pentium 4 cooler
from 2005. Will the future bring us even larger cooling
devices? |
|
While chip manufacturers are busily working
on the heat dissipation issue, data centers around the world are discovering
another key part of the answer: don't just replace servers, consolidate
and/or virtualize them! (See the article "Consolidate and Virtualize to Save
Big" below for examples.) |
 |
|
Measuring Server Power Consumption
In practice, something as apparently simple as a vehicle's
fuel efficiency isn't straightforward to measure and compare.
While a motorcycle beats out an SUV in raw miles per gallon, an SUV can rate
higher on overall efficiency because it can carry more passengers. Then
again, SUVs generally don't carry passengers to capacity, so that has
to be factored in. See how tricky this can get?
Now there's a
contradiction!
According to a Ziff-Davis survey of 1,200 key
players in the data center industry, 71% of data center owners
identified power and cooling as the primary issues their data centers are
facing, yet 62% of that same group reported those concerns did
not affect their server purchases in the preceding 12 months. No doubt it's
a contradiction, but an understandable one if there's no standard way to
measure and report server energy consumption.
The latest metric
About a year ago, a group of EPA officials,
researchers, and some of the computing industry's "heavy hitters" gathered
at Sun Microsystems' headquarters to develop such a standard.
Despite some of the obvious obstacles to the process (companies inevitably
opting for tests that make their own equipment look good, finding criteria
to represent the performance of everything from processors
to storage and networking), the conference attendees emerged successful.
To capacity or not to
capacity?
In
July of 2007, the EPA's Server Energy Measurement Protocol
will go into effect and will provide a standard way of measuring
power requirements for servers at different load levels. (Such metrics
already exist for desktop and laptops computers.)
|
|
Jonathan Koomey, staff scientist at Lawrence Berkeley National
Labs and consulting professor at Stanford is the author of
the new metric. |
|
According
to the study's author, Jon Koomey, "Measuring server
performance is harder because servers rarely operate at full
capacity, and the measures each vendor uses to scale back power use under
lighter loads vary widely."
According to a
draft of the study, the average
corporate server only runs at between 15 percent and 20 percent of capacity. |
|
|
Yet
one more reason why server consolidation is a key part of the greening
solution for the corporate data center. The
more "consolidated" your equipment, the higher the utilization rate, so the
lower the overall power requirement will be. (Think of 20 machines running at
20% capacity with all the necessary power supplies and cooling equipment
running at "full speed" vs. five machines running at 80% capacity with a
fraction of the peripheral power and cooling equipment needed).
Energy Star "seals" the
deal
|
 |
When
data center managers go to buy new servers next year, it will be readily
apparent which are the most energy efficient since they'll be sporting the
EPA's Energy Star label. By the middle of 2008, the server metric discussed
above will have been in place for a year, so the measurements which
determine who gets the "seal" will be based in reality. |
|
|
The great "Performance
Per
Watt" debate
No discussion of energy metrics would be
complete without at least touching on Performance Per Watt (PPW). This term began
generating industry buzz in the fall of 2005, when chip
manufacturers started adopting it as the new yardstick of system
performance.
Here
are the facts:
-
It's a chip-to-chip comparison
-
It's calculated by taking a
benchmark score (e.g. chip clock speed) and dividing by average
system power (AC power from the wall)
-
It's solely affected by changes
in microprocessor architecture (how chips are built).
|
 |
In this chart, performance per watt is illustrated by major
upgrades to the Xeon processor line: as the number of "cores
per chip" increase, the performance per watt goes up by
about the same factor. |
|
|
The Green Grid
Alliance
What is
it?
A group of IT companies and
professionals from around the world whose mission it is to
decrease the consumption of power in data centers.

What are
they doing?
Developing their own metrics
and technologies that improve energy efficiency against the
new metrics — then promoting the adoption of both!
The consortium is also looking
at power & cooling issues from the perspective of overall
design of the data center.
So, they
have their own metrics then?
Yes, the Power Usage
Effectiveness (PUE) and the Datacenter Efficiency (DCE).
Who can
join?
Anyone who's interested in
being part of their mission. It was founded last year by
AMD, HP, IBM and Sun and since has boosted its "high
profile" membership with the addition of Dell and VMWare.
www.thegreengrid.org |
|
|
|
And the debate is?
Intel and AMD are the chip vendors currently
doing battle over this metric. Intel argues that performance per watt is not
meaningful "enough" to consumers since it focuses only on the chip. AMD, on
the other hand, maintains it's the most concrete, "apples-to-apples"
measurement in the industry.
For its part, Intel would like to see the more
nebulous "Satisfaction per watt" measure adopted — a measure which addresses
not just raw power consumption but noise levels (with newly-designed fan
struts) and better battery life (through a process of caching display
images).
"What does this have to do with
my data center?"
At this point you might be asking
yourself, "If these measurements all pertain to new servers, why
should I care about them?" Fair enough. There are two parts to the answer:
-
When comparing "Performance Per
Watt" between a current server and, say a four year old one, the
differences can be really big.
Server architecture has
come a long way in a short time, and if you put your older boxes up
against the newest, you will quickly see how much there is to be
gained (and saved) by modernizing your hardware.
-
When you are ready to make new server
purchases (because at some point you will be), your decision will be
an informed one from the power perspective. Consider the data center manager
of the Ziff-Davis survey mentioned above who claims power and
cooling are the biggest issues his/her center is facing, then
buys new hardware without even taking them into account.
...
on improving the efficiency of your data center. |
 |
|
Consolidate and Virtualize to Save (Perhaps
Big)
Who wouldn't want to be "seen to be green"
if there was an easy way to do it which could also save you money? As we've
already alluded to, server consolidation and/or virtualization allows you
to do your bit for the planet and do something really good for
your organization at the same time.
Less (servers) is more
There are some alarming numbers floating
around concerning when "legacy" data centers will run out of power — some
percentage of them as soon as a year from now! In response, data center
managers are turning to logical solutions like server consolidation and
virtualization as key power-saving measures.
Example 1: Consolidate
with BladeCenter Grid solution
Rack-based blade servers have become
synonymous with the term server consolidation. Their rack-based design
allows multiple physical boxes to be "consolidated" onto one server (with
one or more CPU per rack), providing for:
-
Less energy consumed for the same processing
power
-
Greatly reduced physical space
requirements
-
CPUs to be
turned off while not in use, saving additional power
-
More efficient peripherals, i.e. power
supplies (see
Score
One for You, One for Green article below).
|
 |
The chart at left shows how the costs stack up
when you replace eight x86 servers with one IBM BladeCenter. As you can see,
the power costs with the replacement solution are about one fourth.
The back-up and general admin costs also
decrease by about the same factor. Bottom line: A more energy-efficient,
powerful, space-saving solution will save you several hundred dollars a
month, even with lease costs of the new server taken into account!
|
|
|
Example 2: Virtualize
with VM Software on a BladeCenter
Virtualization takes server consolidation to
the next level by allowing for the creation of multiple "virtual" machines
with one CPU. Combining a blade solution with virtualization is a
"double-whammy" in terms of power savings since you reduce the number of
racks needed to get to the same number of servers (fewer racks means fewer
physical CPUs running).
The decision "to virtualize or not" can be an
involved one which might dictate a technology assessment, especially when
applications requiring different CPU utilization are involved. There is also
some discussion surrounding the "break-even" point for virtualization or the
ratio for server reduction (industry average is currently 8:1).
|
|
The
purpose of this example is not to tackle this weighty decision, rather to
simply illustrate the sort of savings possible with the virtualization
approach.
As you can see in the chart at right,
electric power costs are also slightly higher at about one fifth with a virtualized solution.
Of course, the lease cost in this scenario is
higher due to the VMware licenses, but because you are effectively getting
"more servers with much less equipment", all the other costs are
considerably lower.
Your bottom line here is rather attractive: with a
considerably more
energy-efficient, powerful, space-saving solution utilizing the latest
virtualization technology, you can break even!
|

 |
|
|
...
on server consolidation and virtualization in your data center. |
 |
|
Score One for You, One for Green
Taking the observer stance, we might even go so far as to say you should
never do something just because it is a win for green. In the IT power
usage reduction movement, there are many things you can do above and
beyond server consolidation/virtualization which are clearly a win for you and a win for the environment. We'll
start small
and work our way up.
Power supply woes
The
amount of power in the data center wasted due to inefficient power supplies
is nothing short of astounding.
According to a joint study by Eco Consulting and EPRI Solutions, an
inefficient, oversized power supply can waste up to three times as much net
AC power as a properly-sized, efficient unit. The same is true for
UPS systems, which often waste power when lightly loaded.
The
same study found that the
efficiency of server power supplies peaks at loads between 50%
and 60%, then drops off dramatically at loads under 30%. Given that
the average enterprise server operates at only 20% of capacity (see Measuring
Power Consumption article above), you can see how quickly the waste adds
up.
What you can do |
 |
According to industry experts including Berkeley Lab and PG&E,
switching to efficient power supplies can yield between $3,000 and $6,500
per server rack per year.
With
the funding of electrical utilities behind them, Ecos Consulting launched
the "80 Plus certification and incentive program" which mandates that
power supplies operate with energy efficiencies of 80% or greater at loads
of 20%, 50%, and 100%. (See chart.) |
|
|
So maybe
you're simply not ready to switch power supplies right now (perhaps because
of warranty concerns on your current ones). Just tuck this information in
your back pocket when you go to purchase your next round of servers.
When
you do, keep in mind that blade
servers tend to have more efficient power supplies and use less power
overall than non "rack-based" servers. The latest generation of blade
servers can also control the output of power supplies and even turn some off
while maintaining redundancy. One day in the not-so-distant future you'll be
reaping the benefits of lower energy bills when those efficient power
supplies are humming along!
|
|
AC to DC: What would
Tesla think?
AC
(alternating current) is the form in which electricity is delivered to homes
and businesses, including most data centers. Once delivered, an
AC-DC-AC conversion is required to run the data center — a
conversion that can eat up 11% of total data center power consumption.
A
DC-based power architecture reduces the number of conversions and results in
better overall efficiency. This has actually been proven in
telecommunications operations centers which have been operating on DC power
for decades.
|
|
Nicola
Tesla (1856 - 1943)
is best known for his
revolutionary work in electricity and magnetism at the turn
of the century. His many patents and theoretical work formed
the basis of modern AC systems. |
|
|
|
What you can do
To
quote the experts at Berkeley Lab, data centers can obtain between 10%
and 20% energy savings by switching from AC to DC power.
With the exception of monitors and
other non-DC peripherals, DC can power the entire data center and since only
one AC to DC converter is required at the location of input, there isn't as
much power lost. By plugging some numbers into this
DC power savings calculator, you can
quickly see how much this change could save your company.
Of course you will want to proceed with
caution, but if and when you're ready, all the major IT
vendors now offer:
Relocate or colocate?
The statistics on the sheer volume of
data center square footage coming online within the next several years
are simply staggering: 12 million sq ft by 2009! Just to give you a frame of
reference, the United States' largest shopping mall in Minnesota, the Mall of
America, covers only 2.5 million sq ft.
|
 |
Where all this extra data center space is
built will make a huge difference in terms of operating costs. Not too
surprisingly, data centers erected in New York City or San Francisco can
cost up to 25% more than those taking shape in Sioux Falls, SD or
Birmingham, AL. Factors such as probability of natural disasters, raw energy
costs, labor costs, and local incentives all contribute to this sizeable
difference.
This explains at least in part why many
companies are turning to colocation centers as a possible solution. |
|
|
A colocation center (aka "colo" or carrier hotel) is, quite simply, a hosted
data center — both the logical and physical components. Not so simply, it's
defined as a data center where multiple network service providers locate
connections adjacent to each others' networks and where users of these services
place their network, server, and storage gear for the purpose of reducing
cost and complexity.
What you can do
With a decision of this magnitude, a "relocate
or colocate" assessment would be the first order of business. If you opt for
building your own center, consider:
-
Geographical placement for maximum cost
savings
-
Ways to build a green data center, e.g.
the U.S. Green Building Council's
Certification for Leadership in Energy and
Environmental Design (LEED). The criteria include sustainable
site development, water savings, energy efficiency, materials selection,
and indoor air quality.
If the colocation option appears more
attractive to you, there is also much assessment work to be done. What you
gain in economies of scale and lower costs, you might lose in convenience
and accessibility.
...
on improving the efficiency of your data center.
|
|
 |
|
TechTip:
Rack ‘em Stack ‘em… just remember to keep your AIRFLOW in check…
By Debi Riedel,
Lead Architect,
Datatrend Technologies
Today, most server and rack level cooling
issues are caused due to either the inadvertent mixing of hot and cold
air or insufficient airflow.
Airflow efficiencies are typically
addressed during the new build or major data center design, but can be
overlooked as racks and server components shift and change, as new
equipment is added, and as data center personnel become absorbed in
daily production demands.
The mixing of hot and cold air, a more
subtle issue, can dramatically reduce the efficiency of a cooling system
and also has the potential to negatively impact airflow.
To minimize these issues, here is a list
of things to consider:
-
Understand airflow requirements for
specific equipment.
-
There are four basic airflow
scenarios: front-to-back, side-to-side, bottom-to-top,
top-to-bottom.
-
Understanding the requirements for
specific equipment will enable an efficient rack-level design and
cooling strategy.
-
Map the technologies under consideration
as part of an IT Design and Performance Planning activity, against the
thermal characteristics specified by the specific vendor.
-
On racks designed for high-density
environments, standardize power and thermal policies to maximize rack
effectiveness.
-
Avoid shallow racks to eliminate
airflow obstructions caused by in-rack cabling.
-
Plan for adequate fans, cooling units,
or localized supplemental cooling for individual racks which can
accommodate future high-density systems without compromising
room-wide efficiency.
-
Arrange racks in rows to establish hot and
cold aisles.
-
Align racks front-to-front along cold
aisles, and back-to-back along hot aisles. Within each row, tightly
abut the racks. Cold air needs to be delivered to cold aisles and
hot air needs to be extracted from hot aisles, for this strategy to
be effective.
-
Use blanking panels.
-
Ensure adequate airflow to individual
racks and systems.
-
Clearly define power and cooling
requirements for room, row, and racks.
-
Ensure sufficient airflow to racks
based on system-level inlet air temperature and airflow
requirements, and use thermal and aerodynamic analysis tools to
model and design your cooling solutions.
|
|
 |
|

Contact us |
Visit Datatrend website
All trademarks,
registered trademarks and service marks are the property of their respective
owners.
IBM, the IBM logo and other referenced IBM products and services are
trademarks
or registered trademarks of the International Business Machines Corporation
in the United States,
other countries, or both. All rights reserved.
Brought to you by Datatrend Technologies
Inc.
121 Cheshire Lane, Suite 700 Minnetonka, MN
55305 |
 |