David Ziembicki on Infrastructure Architecture : Cloud Computing

Private Clouds: Believe it or not?

davidzi — Sun, 23 Aug 2009 23:01:01 GMT

Recently there has been some healthy debate around the validity of “private clouds” and whether such a construct is new or just a different name for virtualization and automated provisioning, i.e. a marketecture. In this corner for the anti-Private Cloud sentiment, we have the 2009 Prediction – Rise and Fall of the Private Cloud which argues there is really no such thing as a private cloud and the concept will die quickly as everyone moves to the public cloud. There are some excellent points in this article, I’ll address several below. Take a quick read and come back, I’ll wait… In the other corner, we have Christofer Hoff from Cisco and his response. Finally, Reuven Cohen hits the nail on the head with his post A Public Cloud by Any Other Name is Private which basically states that this is all basically definitional dancing where people argue about concepts without defining any of the underpinning terms.

People’s opinions on this topic seem to correlate most with whether they believe the defining attributes of cloud computing are financial (only paying for capacity utilized, no capex, etc) or whether they believe the defining attributes are technical (shared infrastructure, scale-out architectures, dynamic provisioning). The folks who focus on the financial side tend to believe either there cannot be private clouds because all costs are still incurred by the organization or that there is no way a single organization will be able to drive costs as low as the large cloud providers can with economies of scale.

The folks who see cloud computing as more of an architecture pattern for applications and an infrastructure/operational model tend to believe that the approach is just as relevant for a public cloud provider as it is for a large internal IT organization.

I am firmly in the camp of those who believe private clouds are going to be an important part of IT for at least the next decade. I come to this view using my definition of a cloud which is: an infrastructure architecture, application development model, and operations management discipline that dynamically provide necessary services whenever and wherever they are needed while sharing costs between all users.

Using that definition, all manner of clouds including public, private, hybrid, etc. will exist. Will there be certain economies of scale that a Microsoft or Amazon with hundreds of thousands of servers will be able to achieve that a single business won’t? Of course. But there will also be a degree of customization and agility that private clouds will be able to achieve that large providers won’t.

The reason I believe that private clouds as a concept are something new is that this is the first time that all of IT (infrastructure, development, and operations) are being looked at holistically. This is much more than just being able to sling VMs about the datacenter. This about providing a cost effective infrastructure where code that addresses user needs, be it an app, a VM, or a service can be developed rapidly by using foundational services, deployed near real-time, scale as needed, and then be retired at the end of its useful life.

I’m excited by Microsoft’s opportunities along the full spectrum of the cloud. Azure is a very forward looking vision of the public cloud that I still don’t think most people are grasping yet. Likewise, Microsoft’s traditional on premise solutions are evolving very quickly toward both private cloud and public cloud implementations. To me the most important question that will determine our long term success is how well we are able to provide a seamless continuum between the Azure platform and our Server and Tools solutions as they evolve toward cloud services. I think we are targeting an end game that no one else is really going after from on-premise, through private cloud, to public cloud.

Cloud Computing: Taxes Analogous to Atmospheric Pressure

davidzi — Thu, 06 Aug 2009 16:11:23 GMT

In a blog posting earlier this week, the Azure team announced that they would be moving all Azure applications out of our “USA – Northwest” datacenter. I was fascinated by this given that the stated reason for this move is a change in local tax law which presumably make it less financially attractive to offer the services from that area. Mike Manos published a great blog post on the topic this morning called “The Cloud Politic – How Regulation, Taxes, and National Borders are shaping the infrastructure of the cloud”. Definitely worth reading and considering the implications.

So where will cloud infrastructure form? Consider the real thing in nature and substitute taxes for atmospheric pressure. Below is a paraphrased description from NOAA:

Wind is simply the air in motion … Pressure gradient is the difference in pressure between high and low pressure areas … What happens to the converging winds near a low? … It has to go somewhere so it is forced to rise. As it rises it cools. When air cools it can hold less water vapor so some of the invisible vapor condenses, forming clouds and precipitation … What about the diverging air near a high? … As air warms it can hold more water vapor, which means that clouds will tend to evaporate.

Bottom line, cloud infrastructure will tend to emerge in low tax, low energy cost, high connectivity areas. This much is obvious and has been a key part of data center site selection methodologies as Manos alluded to. To date these have mostly dealt with “where do we plant these multi-hundred million dollar facilities to exist for at least 10 years”. As the move by the Azure team demonstrates however, what runs in these datacenters can be moved around at will. Is it running internal applications and thus maybe not taxable activity? Or is it running a revenue generating activity that may be taxed? If so, does the datacenter in the next state provide a lower tax environment? If yes, move the workload there, and so on.

With an ever growing percentage of computing likely to migrate toward the large cloud providers, small percent differences in the tax rate, cost of power, etc. can have a large impact on the profitability of providing cloud services. You see this today with certain localities actively shaping public policy around attracting datacenter construction.

Over time I think this will lead to several architectural trends. The first is that an ever increasing number of input parameters (tax rate, power cost, bandwidth, etc) will be utilized by cloud infrastructure software to determine where best to run customer workloads. Where today this occurs mostly during site selection, this will rapidly evolve to the point where it is near real-time and workloads will transparently migrate to follow low cost off-peak power, regions with lower taxes, etc. While workloads are easier to move than entire datacenters, even that is very likely to change given the numbers at stake. Most people have heard of Microsoft’s Chicago datacenter where the first floor is comprised of shipping containers and totals hundreds of thousands of servers. This capacity is obviously mobile but requires supporting facility infrastructure which to date is in fixed locations only. If you look at Microsoft’s Gen4 datacenter vision, you’ll see that eventually even most of the supporting infrastructure will be modular and mobile as well.

These trends will make for some very interesting infrastructure architecture challenges. The clouds will form near low pressure areas…

Virtualization and Cloud Computing Real-time Feeds!

davidzi — Wed, 08 Jul 2009 00:26:33 GMT

As mentioned here and in a few other posts, I’ve been using Friendfeed and Twitter quite a bit over the last couple months. I’ve been extremely impressed with Friendfeed in particular. I’ve created two Friendfeed groups that I’ve been posting content to in addition to my main feed. The groups are:

Microsoft Virtualization

Cloud Infrastructure

Their focus is self explanatory but consist of posts, comments, etc. from a variety of sources that I find relevant to each of those topics. The feeds also include posts from the relevant categories from this blog. Please join these groups if you have interest in these areas.

While these feeds are available over on the Friendfeed website, I’m also leveraging a feature they just rolled out around real-time search. If you scroll down the sidebar in my blog, you will see links to two new pages I’ve added:

Virtualization

http://blogs.technet.com/davidzi/pages/virtualization.aspx

Cloud Infrastructure

http://blogs.technet.com/davidzi/pages/cloud-infrastructure.aspx

These pages embed Friendfeed real-time searches scoped to the groups I created and will therefore update in real-time whenever I post or share new content to the group. If you want a wider scope in your results, take out the group: tag and put in any keyword you want such as “virtualization” and you will get updating results each time someone posts something to Friendfeed with that term.

For folks with similar interests, I think these feeds will be valuable as my goal is to highlight the top couple of articles, posts, etc that I come across each day out of the 50 – 100 that I read. Enjoy!

Dynamically Provisioning Customized Virtual Machines with VMM

davidzi — Wed, 01 Jul 2009 02:46:07 GMT

There’s a good technical post over on Chris Adam’s blog about how to dynamically provision customized virtual machines by using System Center Virtual Machine Manager and unattend.xml. The unattend.xml file is used in combination with a sysprep’d image and applies customization (things like computer name, installed roles, etc) that are specified in the XML file. Chris’s post explains how this can be done very easily in VMM.

This post was timely as I have been working on some unattended installations and other automation for a customer I am working with. With all the focus on the back and forth with competitors at the virtualization layer, it almost seems like the workload and configuration inside the VM is “getting no respect”.

In any event, the unattended installation realm can be intimidating at first. There are multiple ways of accomplishing most tasks, there is an enormous amount of things in Windows that can be customized, etc. Microsoft makes a large number of resources available such as the Windows Automated Installation Kit, Microsoft Deployment Toolkit, etc. There are beta updates to these for Win7, R2, etc. that can be found on Bing.com.

For a very detailed treatment on all of these topics, check out the Deploying Vista series over on WindowsNetworking.com Most of the content is the same for Windows 2008 servers as well. This article on Technet is quick and direct step-by-step guide for a basic automated installation. Between the info Chris provided and some of these resources, you’ll be well on your way to dynamic VM provisioning.

Head-to-Head: Workflow Studio vs PowerShell for Automation

davidzi — Sun, 28 Jun 2009 21:07:11 GMT

Here’s an interesting and slightly amusing mock debate between Brandon Shell and Jason Conger on Citrix’s Workflow Studio vs PowerShell for automation. If you aren’t familiar with it, here is the description of what Workflow Studio is:

“Citrix Workflow Studio™ is an infrastructure process automation platform that enables you to transform your datacenter into a dynamic delivery center.”

“Built on top of Windows PowerShell™ and Windows Workflow Foundation, Workflow Studio provides an easy-to-use, graphical interface for workflow composition that virtually eliminates scripting. Workflow Studio acts as the glue across the IT infrastructure allowing administrators to easily tie technology components together via workflows.”

The debate is amusing because in reality both guys understand that each has its place, one is a foundational component of the other, and the combination of the two can be extremely powerful. The core of the “debate” is one’s definition of automation: execution of atomic tasks with as little effort/code as possible (basic PowerShell) or event/workflow driven execution of multiple tasks with associated logic (advanced PowerShell and/or Workflow Studio). The first is an enabler for the latter.

It’s been my opinion since Exchange 2007 and Virtual Machine Manager 2007 committed entirely to PowerShell and with the PowerShell team’s continued focus on simplicity and consistency, that this was the tipping point that was going to enable real automation and orchestration of IT infrastructures. Now with partners (Citrix) and competitors (VMware) alike building on and/or leveraging PowerShell, we’re going to see significant advancements in the state of the art this year.

Threat Modeling Guide for IT Infrastructure

davidzi — Tue, 23 Jun 2009 02:41:07 GMT

Over on the Solution Accelerators Security Blog is a post and link to the IT Infrastructure Threat Modeling Guide.

From the guide:

The IT Infrastructure Threat Modeling Guide provides an easy-to-understand method for developing threat models that can help prioritize investments in IT infrastructure security. This guide describes and considers the extensive methodology that exists for Microsoft Security Development Lifecycle (SDL) threat modeling and uses it to establish a threat modeling process for IT infrastructure.

This is one example of what I think will be a growing trend where the lines between infrastructure and development will be blurred. This is a positive as there are a substantial number of best practices in both disciplines that can be shared. A structured approach to threat modeling is a prime example.

Excellent Data Center Article in the NY Times Magazine

davidzi — Thu, 11 Jun 2009 20:46:00 GMT

The New York Times magazine has a very interesting article by Tom Vanderbilt on datacenters and the infrastructures that power today’s online services. Several Microsoft (and former Microsoft) execs were interviewed including Mike Manos, Debra Chrapaty, Daniel Costello, etc.

The article ends with a very insightful comment by Mike Manos:

“We’re at the beginning of the information utility,” he said. “The past is big monolithic buildings. The future looks more like a substation — the data center represents the information substation of tomorrow.”

Updated: Introducing the Azure Services Platform

davidzi — Wed, 03 Jun 2009 02:24:42 GMT

The main introductory whitepaper to the Azure platform written by David Chappell has been updated. The main updates are around SQL Data Services and the move toward a more relational model and the introduction of something code-named the “Huron” data hub which uses the Microsoft Sync Framework to synchronize multiple databases (SQL, SQL Compact, etc) in a multi-master fashion. There will also be an SDK so that other databases can be synchronized as well. The document is well written and if you really absorb it you can start to see the scope and scale of the Microsoft vision for cloud computing.

Hyper-V and VMM: Scale Up, Out, and to the Cloud

davidzi — Fri, 15 May 2009 00:44:32 GMT

Between MMS and TechEd there have been a lot of announcements on the virtualization and cloud computing front. First, over on the Virtualization Team Blog, Jeff provided the announcement and details around some new capabilities coming in Hyper-V with Windows Server 2008 R2:

64 logical processor support. A 4x improvement over Hyper-V R1 and means that Hyper-V can take advantage of larger scale-up systems with greater amount of compute resources.

Support for up to 384 Concurrently Running Virtual Machines & 512 Virtual Processors PER SERVER. We are increasing the maximum number of concurrently running virtual machines to 384 per server and the maximum number of virtual processors to 512 for the highest virtual machine density on the market.

Processor Compatibility. Processor compatibility allows you to move a virtual machine up and down multiple processor generations from the same vendor. This does not mean you can live migrate between Intel and AMD nodes, just between different generations from the same vendor.

Not to be outdone, the VMM team announced a bunch of new features that will be in their Release Candidate coming out in a few weeks:

Storage Migration
Queuing of Live migrations
Rapid Provisioning
Host compatibility checks
Support for 3rd party CFS
Support for Veritas Volume Manager

Combined, these new features from both teams enable some key scenarios at both the entry level and high end of the spectrum. One of the major advantages of our stack is that it is very approachable from an entry level since it leverages so much of what your administrators already know and beginning with Microsoft Hyper-V Server 2008 R2 SKU, will be available with all of the high end features (Clustering, Live Migration, etc) for free. Within a couple hours a Windows admin can become proficient with the basics of Hyper-V and be up and running (for free!). Within a few days at most, the ability to implement basic clustering, HA, and Quick/Live migration can be achieved. At the high end, very advanced architectures can be implemented including VMM, OpsMgr, deep SAN integration, etc. This is where our technical guidance, solution accelerators, and service offerings come into play.

To see an example both of how this stack is being leveraged by commercial providers as well as an example use case for enterprises wishing to use the cloud as reserve capacity, check out the video below demoing a future version of VMM and how it will integrate private and public cloud capacity seamlessly:

MMS Keynote Streaming Live Now

davidzi — Tue, 28 Apr 2009 19:11:00 GMT

MMS Day 1 Keynote: Bob Kelly, Microsoft corporate vice president, April 28, 2009, 8:30 am PT

Azure Services Training Kit - February Update

davidzi — Sat, 07 Feb 2009 01:32:00 GMT

Following up on yesterday's post, today an updated Azure Services Training Kit was released:

The Azure Services Training Kit includes a comprehensive set of technical content including hands-on labs, presentations, and demos that are designed to help you learn how to use the Azure Services Platform. The February release includes the following updates:

19 demo scripts that walkthrough several of the services
10 presentations covering the entire Azure Services Platform
3 additional hands-on labs for Live Services

This technical content covers services including: Windows Azure, .NET Services, SQL Services, and Live Services.

Download Here

Getting Started with Azure and Microsoft Cloud Computing

davidzi — Fri, 06 Feb 2009 02:22:00 GMT

Here are a couple resources for getting started learning about Microsoft's cloud computing strategy:

"The Azure Services Platform is an internet-scale cloud computing and services platform hosted in Microsoft data centers. The Azure Services Platform provides a range of functionality to build applications that span from consumer web to enterprise scenarios and includes a cloud operating system and a set of developer services."

http://download.microsoft.com/download/e/4/3/e43bb484-3b52-4fa8-a9f9-ec60a32954bc/Azure_Services_Platform.pdf

Getting Started with Microsoft Cloud Computing Tools

http://msdn.microsoft.com/en-us/vstudio/cc972640.aspx

Windows Azure

Windows Azure is the development, hosting, and management environment of the Azure Services Platform, which enables you to run applications at Internet scale while leveraging the skills and tools you use today.

Windows Azure Tools for Microsoft Visual Studio

Windows Azure Tools for Microsoft Visual Studio extend Visual Studio to enable the creation, building, debugging, running, and packaging of scalable services on Windows Azure.

Live Framework

The Live Framework is the uniform way for programming Live Services from a variety of platforms, programming languages, applications and devices. With the Live Framework, you can easily build and deploy applications in the cloud that sync across multiple devices.