The Windows HPC Team Blog

"Your guide to all things Windows HPC"

The Windows HPC Team Blog

  • Dryad Beta Program Starting

    The HPC team is starting up a new beta program right now, read on for a description and sign-up instructions. Dryad , DSC , and DryadLINQ are a set of technologies that support data-intensive computing applications that run on a Windows HPC Server...
  • Announcing the HPC Pack 2008 R2 Service Pack 4 and Windows Azure HPC Scheduler updates!

    As part of the spring WIndows Azure release, I'm pleased to announce that the HPC team has also released a set of updates: Service Pack 4 for the HPC Pack 2008 R2 family of software Our first update to the Windows Azure HPC Scheduler development...
  • Making a Clean Sweep with Windows HPC Server 2008

    Parameter Sweeps are one of the most common types of jobs that get run on HPC clusters, and we've done some work in Windows HPC Server 2008 to make them easier (and faster) than ever. Today I'll dig in a little on what's different and how to take advantage...
  • Using Subscriptions in PowerShell Scripts

    The majority of Azure PowerShell cmdlets interact with Azure Subscriptions, vital for changing or deploying VM's to the subscription. For those customers who have multiple accounts it is essential to ensure the correct one is selected before issuing...
  • HPC Pack 2012 SP1 Available

    I’m pleased announce that Service Pack 1 for HPC Pack 2012 is available for download . Our focus for SP1 is Azure Burst scale and robustness. A principal of the cloud is to design for failure. We’ve learned a lot from working with customers...
  • HPC Pack SOA Tutorial V: Diagnose a SOA Service

    It’s not an easy job to write an HPC application with complex algorithms, but it’s even more difficult to troubleshoot the application. This tutorial is to introduce how to diagnose the SOA application. Get SOA logs In HPC Pack 2012...
  • How to Submit a Job

    I was asked today where there was a quick explanation of how to submit a job from the command line, and I realized that I didn't have a really good answer. So I figured I'd do a blog post (first in a while, I know!) on how to do this. Starting Simple...
  • Why Windows Azure

    I spent last week meeting with customers and partners about Windows Azure. Some of them are working with us and pushing the limits, and others are evaluating Azure. Here’s one perspective on “ Why Windows Azure? ” from Dave Fellows...
  • Authentication Failure error on Windows HPC caused by port conflict

    I recently ran into an issue where all attempts to run any cluster command from the command line resulted in an authentication failure. We were able to connect to the cluster from the GUI and powershell however all attempts to connect to the cluster from...
  • Microsoft iSCSI Software Target 3.3 for Windows Server 2008 R2 available for public download

    Hey HPC admins, since some of you are using iSCSI in your clusters here is some information that you may find interesting. It is copied from Jose Baretto's blog . Introduction For the last few years, I’ve been blogging about the Microsoft...
  • Enabling tracing for HPC SOA applications

    When helping our customers troubleshoot HPC SOA applications and cluster infrastructure, we realized that SOA trace is a very powerful tool when physical or remote logon is not available to the cluster. (Which happens a lot given that HPC is always a...
  • REST API docs on MSDN

    I know there were a bunch of folks waiting on this, so I'm happy to say the REST API documentation for the HPC Pack 2008 R2 SP3 release is available. Windows HPC Server 2008 R2 with Service Pack 2 (SP2) provides access to the HPC Job Scheduler Service...
  • DNS Suffix vs. Active Directory Domain for HPC cluster (Part 2)

    In an earlier post , I described an approach for resolving names when the connection specific DNS suffix did not match the Active Directory domain name. Recently, I realized that there is a much simpler solution. The Default ComputeNode Template which...
  • Dryad and DryadLINQ on HPC Server

    Microsoft Research has an interesting project called Dryad which is investigating programming models for distributed data-parallel problems. If you've heard some of the hype around map/reduce programming or the Hadoop framework, you might be familiar...
  • Headnode reports itself as Unreachable

    I find a lot of people are starting to build demonstration clusters on a small scale with some sort of minimal ‘enterprise’ network. In my case the enterprise network is my home router and the private network is a little 5 port GigE switch. To make...
  • Announcing LINQ to HPC Beta 2

    We’re pleased to announce the availability of LINQ to HPC Beta 2. LINQ to HPC enables a new class of data intensive applications for Windows HPC Server by providing a sophisticated distributed runtime and associated programming model for large...
  • Are Actuarial clusters becoming a real possibility?

    In the past couple of years I've learned just enough about how computational modeling is used in Actuarial science to begin to understand the real possibilities. In a nutshell, I've found the big three applications are general capital model for purposes...
  • Updating SOA service for HPC Pack 2012

    If you are running service oriented architecture (SOA) services on an HPC Pack 2008 R2 cluster, the 2012 release of HPC Pack requires the SOA services to be compiled with .NET Framework 4 or a later version. If you have any SOA services compiled with...
  • HPC Server 2008 MPI Diagnostic Fails on Eager Message No Business Card Error

    An HPC Server 2008 user reported that his cluster was up and running and that all nodes could ping each other over all networks but the built-in MPI diagnostic was failing with an uninformative message "Failed To Run". He had a topology number three...
  • Creating a 'Service Pack integrated' installation point

    If you are only deploying a few new clusters across your network, then applying the latest HPC Pack service pack to each head node prior to deploying its compute nodes is a pretty simple workflow. You install your head node in your favorite way (either...
  • Preview of Windows Azure Scheduler and the HPC Pack 2008 R2 Service Pack 3 releases now available

    Microsoft's High Performance Computing team has just made our 'release candidate' for two products available: The HPC Pack 2008 R2 Service Pack 3 and the Windows Azure Scheduler SDK . The HPC Pack service pack is an update to the same Windows HPC cluster...
  • 'Dryad' becomes 'LINQ to HPC' !

    A few weeks ago we announced the beta release of Dryad , a capability for big data running on Windows HPC Server 2008 R2 and Microsoft HPC Pack 2008 R2-based clusters with Service Pack 2. There's now a white paper by David Chappell that explains the...
  • HPC Visual Studio Command Line Compilation from Powershell

    I admit to an almost perverse fondness for command line environments. So I decided to jump onto PowerShell as my default command line environment because its way more cool than the cmd shell and even a nerd with a penchant for undead languages sometimes...
  • Run Batch Workload on a Mixed Infrastructure (Windows Azure Worker Nodes & On-Premise HPC Server 2008 R2 Compute Nodes)

    With the introduction of SP1 of HPC Server 2008 R2 it is possible to run workload on Windows Azure. If you want to be able to off-burst your batch application (= extending the infrastructure from classic on-premise servers to cloud based Azure worker...
  • Windows HPC Server 2008 Technical Library - New Topics Published

    The following new topics were published to the Windows HPC Server 2008 Technical Library : · Windows HPC Server 2008 Service Pack 1 Release Notes ( http://technet.microsoft.com/en-us/library/ee221139(WS.10).aspx ) · Security in Windows HPC...