The Microsoft HPC & Azure Batch Team Blog

The blog for the Big Compute team in Microsoft Azure, working on HPC & Azure Batch services and technologies

The Microsoft HPC & Azure Batch Team Blog

  • HPC Pack 2008 R2 and the Windows HPC Server 2008 R2 Suite have been released!

    On behalf of the Microsoft High Performance Computing team I am pleased to announce that the HPC Pack 2008 R2, Windows Server 2008 R2 HPC Edition, and Windows HPC Server 2008 R2 Suite have hit their 'RTM' (Release to Manufacturing) milestone! This...
  • Announcing the release of HPC Pack 2012

    Announcing the immediate availability of the next major version of Windows HPC software: HPC Pack 2012 The fourth 'major version' of the HPC software brings improved performance and reliability to the HPC platform, simplifies the installation experience...
  • How to use C shell and Korn shell to manage a Windows HPC Server cluster?

    (On behalf of Christina Carter ) Did you know you can use the familiar C shell and Korn shell under SUA (Subsystem for UNIX-based Applications) to call our PowerShell commands? If you have Windows Server 2003 R2, Windows Server 2008 or Windows Vista...
  • Microsoft acquires GreenButton

    Microsoft announced today that we have acquired GreenButton. We’ve been big fans of GreenButton’s Cloud Fabric service built on Microsoft Azure, and the end-to-end user experience they have built. I’m excited to welcome them to Azure...
  • The Beta release of MS-MPI v5 is now available

    We are happy to announce today the Beta release of the newest version of Microsoft MPI (MS-MPI). MS-MPI v5 Beta is the pre-release version for the successor to HPC Pack 2012 R2 MS-MPI Redistributable Package (v4.2.4400, released on 1/14/2014). You...
  • Using Azure PowerShell to Manage Azure Batch Account

    Azure Batch is a new Azure platform service that provides job scheduling and large-scale resource management for developing and delivering Big Compute applications native in the cloud. For more Azure Batch information, see our announcement and documentation...
  • Docs Available for Using A8 and A9 Instances

    Want to try the new A8 and A9 instances for your workloads? Check out this Quick Start topic in the Azure MSDN Library for an overview of the steps to deploy these new compute intensive instances with HPC Pack 2012 R2. If you want more detailed steps...
  • Announcing the MSMPI Debugger Extension Beta

    Update: The MSMPI Debugger Extension is now shipped as part of HPC Pack 2012 SP1 Toolpack. You can get to the download page from the MSMPI landing page http://msdn.microsoft.com/en-us/library/bb524831(v=vs.85).aspx The MSMPI Debugger Extension...
  • Automating HPC Cluster Deployments in Azure IaaS: Part III - Auto Grow and Shrink Azure Nodes and IaaS VMs

    Author: Yutong Sun Date: December 2, 2014 HPC Pack 2012 R2 supports Azure Nodes, aka PaaS worker role instances, bursting from both On-Premise head node and IaaS VM head node. It also supports IaaS VM compute nodes adding to the IaaS VM head node...
  • HPC Server 2008 MPI Diagnostic Fails on Eager Message No Business Card Error

    An HPC Server 2008 user reported that his cluster was up and running and that all nodes could ping each other over all networks but the built-in MPI diagnostic was failing with an uninformative message "Failed To Run". He had a topology number three...
  • Using Subscriptions in PowerShell Scripts

    The majority of Azure PowerShell cmdlets interact with Azure Subscriptions, vital for changing or deploying VM's to the subscription. For those customers who have multiple accounts it is essential to ensure the correct one is selected before issuing...
  • DNS Suffix vs. Active Directory Domain for HPC cluster

    A few months ago, I was asked a question about how to assign a connection specific DNS Suffix to a NIC which was different from the Active Directory Domain. For example, the AD Domain was contoso.com , but they wanted to be able to assign a DNS suffix...
  • HPC Pack 2012 SP1 Available

    I’m pleased announce that Service Pack 1 for HPC Pack 2012 is available for download . Our focus for SP1 is Azure Burst scale and robustness. A principal of the cloud is to design for failure. We’ve learned a lot from working with customers...
  • Automating HPC Cluster Deployments in Azure IaaS: Part II - Azure VM nodes management

    Author: Yongjun Tian Date: December 2, 2014 This tutorial shows you how to do Azure IaaS node management in HPC IaaS cluster on Azure. With Add-HpcIaaSNode.ps1 and Remove-HpcIaaSNode.ps1, user could easily expand or shrink the number of IaaS...
  • Dryad Beta Program Starting

    The HPC team is starting up a new beta program right now, read on for a description and sign-up instructions. Dryad , DSC , and DryadLINQ are a set of technologies that support data-intensive computing applications that run on a Windows HPC Server...
  • Announcing the HPC Pack 2012 Beta Program

    I am pleased to announce the start of the HPC Pack 2012 Beta Program! The 4th major version of our HPC software line following the Compute Cluster Pack, HPC Pack 2008, and HPC Pack 2008 R2 releases, the HPC Pack 2012 release brings a batch of new functionality...
  • Announcing the HPC Pack 2008 R2 Service Pack 4 and Windows Azure HPC Scheduler updates!

    As part of the spring WIndows Azure release, I'm pleased to announce that the HPC team has also released a set of updates: Service Pack 4 for the HPC Pack 2008 R2 family of software Our first update to the Windows Azure HPC Scheduler development...
  • How to compile and run a simple MS-MPI program

    Describes how to configure Visual Studio projects for MS-MPI applications, as well as how to compile and link from the command line.

  • Why Windows Azure

    I spent last week meeting with customers and partners about Windows Azure. Some of them are working with us and pushing the limits, and others are evaluating Azure. Here’s one perspective on “ Why Windows Azure? ” from Dave Fellows...
  • Making a Clean Sweep with Windows HPC Server 2008

    Parameter Sweeps are one of the most common types of jobs that get run on HPC clusters, and we've done some work in Windows HPC Server 2008 to make them easier (and faster) than ever. Today I'll dig in a little on what's different and how to take advantage...
  • How to Submit a Job

    I was asked today where there was a quick explanation of how to submit a job from the command line, and I realized that I didn't have a really good answer. So I figured I'd do a blog post (first in a while, I know!) on how to do this. Starting Simple...
  • Enabling tracing for HPC SOA applications

    When helping our customers troubleshoot HPC SOA applications and cluster infrastructure, we realized that SOA trace is a very powerful tool when physical or remote logon is not available to the cluster. (Which happens a lot given that HPC is always a...
  • REST API docs on MSDN

    I know there were a bunch of folks waiting on this, so I'm happy to say the REST API documentation for the HPC Pack 2008 R2 SP3 release is available. Windows HPC Server 2008 R2 with Service Pack 2 (SP2) provides access to the HPC Job Scheduler Service...
  • Authentication Failure error on Windows HPC caused by port conflict

    I recently ran into an issue where all attempts to run any cluster command from the command line resulted in an authentication failure. We were able to connect to the cluster from the GUI and powershell however all attempts to connect to the cluster from...
  • Azure Batch Explorer Sample Walkthrough

    Azure Batch Explorer Sample Walkthrough What is the Batch Explorer? Batch Explorer is a GUI sample application that allows browsing and updating of all major elements within an Azure Batch account. For example, it shows jobs and tasks, pools and...