Thoughts on Infrastructure : Server

The New Moore’s Law

BjarneD — Wed, 01 Apr 2009 20:46:47 GMT

Times They are a-Changing

A new report from IDC lays out what should be obvious to anyone who has followed two of the biggest recent trends in the server market—multicore and virtualization—by suggesting that when you have two popular new technologies that are designed to let customers consolidate multiple servers into a single box, then server vendors can expect to sell fewer such boxes. In other words, when customers begin rapidly replacing multiple servers with single servers, server sales start to dip (http://arstechnica.com/hardware/news/2007/03/multicore-virtualization-and-a-shrinking-server-market-maybe-or-maybe-not.ars)

As some of you may know software has been riding what we refer to as Moore’s Law for a couple of decades. What you may not know is that this “observation” dates back to 1965.

Here’s what I found at Wikipedia:“Moore's law describes a long-term trend in the history of computing hardware. Since the invention of the integrated circuit in 1958, the number of transistors that can be placed inexpensively on an integrated circuit has increased exponentially, doubling approximately every two years. The trend was first observed by Intel co-founder Gordon E. Moore in a 1965 paper. It has continued for almost half a century and in 2005 was not expected to stop for another decade at least.” (http://en.wikipedia.org/wiki/Moore%27s_Law)

It seems that we should all fear progress doesn’t it? Just when Intel/AMD has started to take advantage of silicon in new and imaginary ways, somebody needs to paint a very bleak picture of our future. As if we need more bad news, right?

While I don’t disagree with the fact as IDC sees them I’m not sure about their conclusion and I believe they report is over-simplify the issue. In fact over a century ago, Mark Twain put it very succinctly “The reports of my death are greatly exaggerated”

No one is suggesting the way Moore’s will continue to manifest itself is by continuing to crank up the clock speed, we may actually see the clock speed go down a bit. In fact, both Intel and AMD are going to increase the power of the microchip by adding more cores. How many? How fast? That depends on how much you trust the two chip manufacturers ability to continue shrinking the size of the transistors on their CPU’s.

The public roadmaps from both Intel and AMD clearly shows that they are going to continue to add more cores, in fact everything points to that at least Intel will continue to double the numbers of transistors on their CPU as well as other innovative steps (I’ll get to that later). This would mean that we are going to see the number of cores on Intel CPU’s double every two years (as per Moore’s Law). If we start applying that to PC’s coming in the first part of the next decade, that means we’ll see cell phone with dualcore CPU designs, Laptops with 4-8 cores, desktops (or Workstations) with 12-16 cores and servers with over 512 cores.

In the next couple of years we will likely see Intel and AMD continue to take advantage of their ability to continue to shrink the transistors, but rather that use this to add more CPU like cores to the design, you will see them add more specialized cores to their CPU designs: Dedicated cores for IO, networking, and graphics (check out Intel’s Larrabee).

This will likely provide computer manufacturers with some very scalable designs. Think LEGO (TM) brinks.

We are also going to see Intel and AMD pull a fast one and reverse it. Huh? Well, think about the Atom CPU presently powering the ultra-compact laptops commonly knows as Netbooks. What Intel did what to take a single-core CPU and rather than adding more CPU’s to the die, they shrunk it. Everything we’ve seen so far indicates that Intel will continue that trend. This obviously means that we’ll get more powerful Atom (dualcore and beyond with more powerful graphics capabilities), but also smaller CPU’s as well as PC-on-an-chip designs designed for smaller devices such as smartphones and devices between the Netbooks and Smartpones, commonly known as MID’s (Moblie Internet Devices).

But all of this great stuff is all for naught, at least according to Gartner and IDC, right? No so fast!

Windows Server 2008 R2 and Windows 7 will both dramatically increase their multi-tasking (actually their multi-threading) capabilities when they become available. The redesigned kernel architectures that went into Windows (with 7 and Server 2008 R2) is believe to scale linearly by introducing a new scheduling design as well as a better way to control processor affinity (for more about this, check out this video interview with Mark Russinovich on http://channel9.msdn.com/shows/Going+Deep/Mark-Russinovich-Inside-Windows-7/) . To date the Server team has publicly demonstrated Windows Server 2008 R2 up to 256 cores (or logical processors) in a single machine the only thing holding the test team back is the relative scarcity of these monster servers.

And as most of us tend to run multiple applications, browsers, email clients and background processing such as anti-virus, you will continue to take advantage of the multicore CPU’s by way of Windows multi-threading capabilities. In fact, the real challenge moving forward may not be Windows (or any other OS), but the tools available to write applications. For more information about this check out what our Developer Tools Division is doing with the parallel extension and their recently announced next generation tools and compilers.

All of this is to simply suggest that we will continue to tweak our products capabilities, including Windows, to ensure our customers can take advantage of the power of Moore’s Law. Now, the Virtualization and Virtual Machine (VM) density on servers? That’s a different story!

Windows Server 2008 is called SP1 - a shameless plug

BjarneD — Sat, 01 Mar 2008 02:04:17 GMT

As I'm sure you're perfectly well aware, Windows Server 2008 just shipped. Let's try that again: Windows Server 2008 just shipped! The server companion of the much criticized Window Vista.

It's been a 4 year journey for a lot of people in our organization. But it's finally out and you can now enjoy the fruits of our labor.

Windows Server 2008 is both and end-point as well as the first station in a longer journey. Let me elaborate a bit on that:

Windows Server 2008 is the last 32-bit server operating system from Microsoft.

We said it before, and we will say it again, the next version of Windows Server is going to a 64-bit release only. In fact Bob Muglia first announced this during IT Forum in Barcelona a couple of years ago. We want to make sure that our customers can take advantage of the good stuff that AMD and Intel put in their CPU's. And transitioning to 64-bit will allow you to run more on a Windows Server, it will allow us to continue to make Windows Server a more secure OS.

Windows Server 2008 is the first deliverable towards modularizing Windows Server for particular workloads.

We worked really hard to start the process of both provide a better layering of the OS as well as ensure that you can deploy Windows Server 2008 for a particular workload (such as Virtualization) and not have to content with the extra baggage of the stuff you don't want, this is referred to as Server Core. The Server Manager will go a long way towards make it very simple to do this.

Windows Server 2008 is the first deliverable towards making Windows Server the best virtualization platform.

Even though Hyper-V didn't make it onto the CD for the release, a lot of effort has gone into making sure that when it is released, it will fit perfectly. Indeed, there's even a Server Core role for Hyper-V. The initial feedback from both beta testers and reviewers looks very good, and we will continue to make Hyper-V the best it can be.

If you're interested in the the journey of Windows Server and why Windows Server 2008's called Windows Server 2008 SP1, here a link to a blog from Iain McDonald explaining it:

http://blogs.msdn.com/iainmcdonald/archive/2008/02/15/windows-server-2008-is-called-sp1-adventures-in-doing-things-right.aspx

Of Instrumentation and Management Packs

BjarneD — Sat, 02 Jun 2007 01:59:00 GMT

Why should you care?

What is a Management Pack? What about Health Models? What's instrumentation good for? And, finally we should you care about all of it? ......

Let's take the last of my rhetorical question first: Why should you care? As an IT pro implementing Microsoft server products or 3rd party products running on Windows you need all the help you can get. I know how this sounds, but trust me, I'm not pointing fingers at any one, nor am I trying to patronizing anyone. With all the variables of setting up a server environment, it's complex enough, the last thing you need is to further add complexity by adding multiple server applications from both Microsoft and others to the mix. And, in case it's not completely clear, I'm referring to managing these applications.

Recent studies have shown that administration and management of server applications is increasing at a whopping 8 times the annual spend on the servers themselves. Some of that complexity comes from the fact that achieving scale (across many users and servers) is inherently complex, some of it comes from the fact that we all trying to solve these problems using whatever Shinny New Ultimate Technology that comes along. A good example of this is Virtualization. We are starting to see that our customers are using Virtualization as a means to consolidate the number of physical servers that they have in their datacenter onto bigger boxes. Now, using Virtualization doesn't necessarily solve the underlying problem (of managing many physical boxes) it simply consolidates many (virtual) instances of OS's and applications onto a smaller number of boxes. Unless you add Virtualization Management tools (such as the recently announced System Center Virtual Machine Manager) to the equation, you still have to care and feed the individual OS's and applications with regards to patches, etc. In other words, you have realized none of the benefits of scale and all of the issues, and you now have a potential single point of failure to boot!

So, you ask, what do we do to solve the issue? The real answer is instrumentation. Making sure that the applications themselves are more intelligently aware of their environment and are able to communicate the root cause of whatever problem arises to IT operations (through a management console). This leads us to my remaining two rhetorical questions around Management Pack and Health models.

Management Packs

Systems Center Operations Manager utilizes management packs to provide intelligent operations management for a wide variety of your server applications. Management packs monitor a wide array of server health indicators which enable them to call attention—often preemptively—to many critical events that require administrator intervention. Monitoring is augmented by in-depth knowledge base content associated directly with the relevant alerts included in the management pack module, providing prescriptive guidance for the administrator to quickly resolve outstanding alerts.

To provide the best possible management of your infrastructure, we encourages management packs to be developed by the application providers who have the knowledge to embed the necessary operational intelligence to aid you in maintaining your system.

In the Management Pack Catalog, you will find not only management pack provided by Microsoft, but a number of non-Microsoft management packs that allow MOM to manage a variety of other applications as well.

Management Packs in Operations Manager 2007 are XML based and use the Service Modeling Language (SML) language to define health models and store knowledge documents in XML.

Health Models

Health models define what it means for a system and its components to be healthy or unhealthy, and define how a system and its components move in and out of these states. Good information about a system’s health is necessary for maintaining, diagnosing, and recovering from errors in applications and operating systems deployed in production environments. Health models capture system events and instrumentation for your software.

Providing the right view of an application, what it looks like when it is and isn’t functioning normally, and providing the right knowledge to help you troubleshoot system and application issues.

As you can probably see, Health models and Management pack go hand-in-hand to allow you to meet your service level agreements (SLAs) to your own customers, whether they are internal or external to your business.

Lastly, let me conclude with what we are doing to ensure the adoption of this model based approach across Microsoft infrastructure server products (also know as the shameless "plug"):

Common Engineering Criteria Infrastructure Management

Let me point out what we done so far using the Common Criteria:

2005 Criteria

MOM 2005 Management Pack Support at Launch

To help businesses reduce the cost of managing infrastructure, all server products will have a MOM Management Pack available at launch. The management pack will be serviced on the same schedule as the core product. MOM packs will provide:

Event and performance processing alerts.
Basic views that graphically map performance and event trending information.
State Monitoring view (green/yellow/red) state for managed entities.
Tasks.

Recently, we've updated the Management requirement to include v3 Management Pack capabilities and added the new Health Model capabilities to the requirement.

2008 Criteria

New Health Model to improve Troubleshooting

IT often have to perform an "information treasure hunt" when presented with events and trying to troubleshoot them. The documentation of events is often inconsistent between product documentation, the Windows Event Viewer, and documents on the web.

To solve this problem, all server products must create and maintain a health model based on the standard Service Modeling Language (SML) including relevant operational events and performance counters, in addition to identifying potential failures and define diagnose and recovery information.

Improved Management Pack(s)

The new version of the Management Pack specification released as part of System Center Operations Manager 2007 offers significant improvement in system monitoring, availability, and health through centralized and proactive management. In order to ensure that IT can continue to support existing products in addition to implementing new products by taking advantage of the new Health Model and Management Packs, all server products will continue to also ship Microsoft Operations Manager 2005 Management Packs.

If you would like to know more about Health Models and Management packs, here's a couple of relevant links:

Common Engineering Criteria Homepage

Microsoft Dynamic Systems Homepage

Microsoft System Center Homepage

How To Develop A Management Pack for System Center Operations Manager 2007

64-bit and Virtualization - Mainstream?

BjarneD — Fri, 06 Apr 2007 00:45:53 GMT

Virtualization will drive the adoption of 64-bit computing.

Back when we first started with the program we refer to as the Common Engineering Criteria (CEC), we pushed support for Virtualization and 64-bit processors across our products. Now it looks as if we're going to get help making them mainstream from customer demand, no less.

In case you don't know what Virtualization is or what 64-bit means, let me provide a short primer.

Effectively, Virtualization (Virtual Server and Longhorn Server's Windows Virtualization) creates a sandbox, where the application(s) running believe that there's nothing else running beside them and an OS. Access to hardware is provided through the Virtualization layer and it can support many different OS's. In many ways you can argue that we are simply taking the vitalization of resources in Windows one stop further.

64-bit is simply the next generation of processors. Both Intel and AMD have been pushing 64-bit for a while, albeit using different designs initially. There are many benefits of 64-bit computing, and it is not the purpose of this blog to go into them all, but let me summarize:

Hardware support for Virtualization
Support for a vast memory space
Better hardware protection from rogue programs

As I alluded to previously, we pushed the adoption of these two technologies since the initial set of the CEC, published in 2004. If you don't know what the CEC is you should read one of my previous blogs (Common Engineering Criteria - Consistency and Predictability).

It was obvious to us that adoption of 64-bit in general and Virtualization in particular was not a matter of if, but when. We were surprise how fast hardware caught up with regards to servers. Today it is virtually impossible to purchase new server hardware that is not x64-based.

In our CEC for 2008 we are dialing up the support for 64-bit (x64 specifically) system in the server space. We seen over the last year of so that customers have started starts to move from experimenting with vitalization to actually deploying in their data centers, although not in vast numbers initially.

We are assuming that Virtualization and 64-bit (in particular x64) will be mainstream by 2009. And I'm suggesting that the former will push the latter.

Huh?

Let me expand on that. With Windows Virtualization for Longhorn server (codename Viridian) we are introducing a new generation of Virtualization for Windows Server, among other things we taking advantage of the hardware support for Virtualization that AMD and Intel are providing with the their new generation of x64-bit processors (codename VT and Pacifica, respectively). This basically means that the Virtualization software no longer will have to do the heavy lifting of pretending that the OS inside it is running directly on hardware. Remember that Intel's x86 processors provide several levels of protection : Ring 0 through 3. x86 based OS, such as Windows run typically run in ring 0, with applications and most services running in Ring 1 -3. Both processors will provide new Virtualization extensions to allow an the Virtualization to run at a higher level than 0 (with better protection and higher priority that both ring 2 and ring 0), whilst providing the capability of allowing OS's to run in guest partitions on top of it in as though they were running in Ring 0. If this makes your brain hurt, think of it as if the hypervizor runs in ring -1.

In Windows Server "Longhorn" this means that we can provide a very thin OS (referred to as the Hypervizor), on top of which the actually OS's run. This very thin OS will provide a Master OS that controls the other OS's. Effectively, this will give us better performance as well as better control.

Without going to deep into what Virtualization is going bring us and what inevitable challenges we come across, I believe that our customers would want to use the new Virtualization capabilities we are provide together with Windows Server Longhorn.

However, there's a catch, the new hardware capabilities that I've just described above are only provided on Intel's and AMD's 64 bit processor. This means that in order for our customers to take advantage of these new capabilities, they'll have to move the 64-bit. It's my personal opinion that there's sufficient value in doing so, including the new Virtualization capabilities. Also, bear in mind that even though the hypervizor will run on 64-bit systems, it will support both 64- and 32-bit guests OS's.

Now, even in the longer term, it's unlikely that all applications will run in a virtualized environment, but a significant percentage will. Most likely, there will continue to be a number of applications that have special roles (anti-virus, etc) or requires access to specialized hardware devices, thus preventing these from taking advantage of the Virtualization technologies.

In conclusion, today we mandate that, unless there are specific hardware reasons, all infrastructure server products be capable of running in a virtualized environment (for more details, check the CEC homepage). We also mandate that all infrastructure server products support 64-bit. It's our goal that we will have completed the transition to 64-bit support (x64) of of our infrastructure server software by the end of 2009.

Clearly, there's a bright future for 64-bit systems and Virtualization, now we just need to manage those, but that is a topic for later.

If you wish to give me feedback as to what additional criteria (common features or technologies) we should consider in the years ahead feel free to post comments to this blog.

For more information go to the following site:

http://www.microsoft.com/windowsserversystem/cer/overview.mspx

Windows Home Server Or What Is The Price of Peace of Mind?

BjarneD — Sat, 17 Feb 2007 03:06:22 GMT

Did you already hear about Windows Home Server? Well, maybe not. Let me give you a brief explanation as to what Windows Home Server is and why you want so it!

Windows Home Server (WHS) is a new member of the expanding Windows Server family. It's a product specifically targeting home users with broadband access to the Internet and more than 2 PC's that are networked. WHS is based on Windows Server and is designed to be very, very easy to administer. So much so that using words like administer, manage, and server would give you and home PC users in general the wrong impression. In fact, you should check out the Hewlett-Packerd WHS, it doesn't have a VGA or a keyboard connector, it is clearly design as a No-touch server. And it's SMALL, about the width of a 2.5" harddrive and twice the height of a soda can, even though it will hold up to 4TB (4 drives).

But I'm getting ahead of myself, let me explain why you want it by explaining to you how I am using the beta version of WHS in my house.

My family consists of 4 people (my wife, our 18-year old son, our 3-year old son, and me). Today we have 3 PC's: our oldest son has one, we have a MediaCenter PC in the living room, and my wife and I share one (that is placed in our home office).

A year or so ago, I set up a server using an old PC, bought a serial ATA RAID controller card and 4 250GB hard drives, and installed Windows Server on it. The main purpose was to buy me peace of mind. Backing up the 80GB of digital pictures and documents on our PC's was driving me mad, and worrying that the CD based solution I was using wasn't effective enough!

I set the server up with a boot drive and setup the 4 SATA drives in a RAID 5 configuration to maximize the speed of accessing the data on the server as well as ensuring that I wouldn't loose data.

As the server worked well as a backup solution, and as I had plenty of storage left on the server, I started to make the server the central storage device for everything. It continued to be the backup for all our documents, but it also became our movie server.

At a certain point late last summer, I decided that I needed to upgrade the server as it was starting to show it's age. At that point I started to hear that we were going to build a server product for home use (yeah, initially I thought it was a preposterous idea, too). But as the concept was explained a demonstrated to me, I warmed up the the idea that this would indeed solve some of my problems, without adding new ones.

the two thing that really sold me on the idea was the centralized backup and the expandability of the storage solution in WHS.

The fact that I could install the backup client of each of our PC's, set it up to backup certain things, and know that I would have access to every version of every document and picture on our PC's from a central location, without me doing ANYTHNG, is the one thing that I really, really appreciate about WHS. Plus the fact that the software allows me to do restore of individual files or full system restore. The backup of all the PC's happens at night, every night.

The other feature I liked is the implementation of the storage in WHS. It is based on how IBM's midrange mainframes (AS400) did storage a long time ago.The concept is very simple: You add as many physical drives to the server (SATA, eSATA, USB, FireWire, etc) and you can then add those to the storage pool as either data or server backup. To the users the server now had one, very big drive.

The only place you can see the actual drives is in the administration console. You can ask WHS to "protect" an individual directory/folder by marking it in the console, this will cause WHS to duplicate the content of that folder to a different physical drive. A very simple, and very intuitive solution compared to the RAID5 system that I had previously. Now I can ask the server to protect only the data that needs protecting.

Another couple of feature that I enjoy (although not as much as the as the two first) are:

Remote administration over the Internet and media sharing through Windows Media Connect.

Remote administration allows me to access the server from anyplace on the planet Earth over the Internet in a secure manner. Sometimes when I'm traveling, I wantto check the status of the backup or something else (I know: Geek), and being able to access the server and all our PC's securely over the Internet through it's webpage (and Remote Desktop) is a tremendous asset if something goes haywire when I traveling.

Media sharing is simply enabled by vitue of WHS supporting Windows Media Connect. Once you've enable the service, you can access the content (music, pictures, and video) from any device (or PC) that supports Windows Media Connect. This includes Roku's and D-Link's neat devices as well as Hewlett-Packard's new LCD TV's.

Today, the server is primarily for backup and document share, as well as our movie server. When I'm done with my install it will become the central hub for media, including all our pictures, videos, music, and recorded TV from our MediaCenter. I am considering adding either Windows Extenders, Roku's SoundBridge devices or PC's in other rooms in the house.

As my plans solidifies I'll keep you posted.

Common Engineering Criteria - Consistency and Predictability

BjarneD — Sat, 20 Jan 2007 12:15:02 GMT

Over the past nearly 4 year Microsoft's Servers have been going through a transformation. Many are the times that we have talked about better together, integrated innovation, etc. In 2003, some of our executives decided that now was the time to do something about it.

They decided to start a process - or a program called "Common Engineering Criteria". The whole point was that all server teams would agree on doing certain things across all their products in certain releases.

The simple idea being that our customers and partners could expect a certain level of consistency across all Microsoft Server products within a release year and that we would be very public about what we were going to do and when. Even to the point that we would maintain a public scorecard that listed the status of the individual server products vis-a-vis the common engineering criteria.

It sound really simple, but this needed to work across 20+ products with different target markets, different levels of maturity in the market, different degrees of complexity.

Adding to the complexity was also the fact that computer software aren't developed in weeks, but years. The effort required the various groups within Microsoft to agree on what should be done in all server applications and how up to 2 years in advance.

The first list of Common Engineering Criteria was published in the summer of 2004 at TechEd in the US. This represented the common technologies and features of the 2005 products. this may sound strange but as you may know, Microsoft names the enterprise server products after the year (actually the Microsoft Fiscal Year) in which they ship. Consequently, the list of Common Engineering Criteria announced applies to SQL Server 2005, Live Communications Server 2005, Virtual Server 2005, and Microsoft Operations Manager 2005. Maybe not an impressive list, but a start nonetheless.

In the years since the summer of 2004 we have been adding more server products and more criteria.

It's important to explain a couple of ground rules. As a general rule all server product shipping in a given model year will comply with the criteria for that year in addition to the criteria from the previous years. However, some times there are reasons why a particular product cannot comply with a certain criteria.

We have a process for handling those exceptions and can grant a given product group an exemption for the complying with the criteria if our executives decided that there are good (business and/or technical) reasons why aparticular server product can't comply with a particular criteria. For example, the criteria from 2005 requires that all server products be tested to run inside Microsoft Virtual Server 2005, both in test and in product. Well, as you may have guessed Microsoft Virtual Server cannot run inside Microsoft Virtual Server 2005. The hardware simply will not support it (besides the fact that it would be completely and utterly ridiculous to run Virtual Server inside Virtual Server). Needless to say, Microsoft Virtual Server 2005 was granted an exemption and you can find both exemption as well as the explanation why on the Common Engineering Criteria Website listed below.

We have strict requirements as to when we start disclosing what server product will comply with the criteria and what exemptions may have been granted. As you can see on the website, we begin tracking the individual server products when they ship their first public beta.

Also, core to this process is our wish to be as transparent to our customers as we possibly can as to what we are going to do with our server products, so we up until last year (2006) we published the additional criteria and the new products that would be measured against them every summer at TechEd. Last fall we decided to change that such that we would announce them a full 2 years in advance. So at IT Forum on Barcelona we announced the 2008 criteria following our announcement of the 2007 criteria at TechEd in the summer.

We come a long way, but there plenty work for us ahead. As you can see from the website we now track 10 of our server products (about 50% of the target server products) and the list of criteria is growing year over year. Not only are we adding server products and criteria to the list, we are not growing the number of exemptions at the same pace, which clearly indicates that the initial concept behind the Common Engineering Criteria is working.

If you wish to give me feedback as to what additional criteria (common features or technologies) we should consider in the years ahead feel free to post comments to this blog.

For more information go to the following site:

http://www.microsoft.com/windowsserversystem/cer/overview.mspx