LINQ to HPC
LINQ to HPC and the Distributed Storage Catalog (DSC) help developers write programs that use cluster-based computing to manipulate and analyze very large data sets. LINQ to HPC and the DSC include services that run on a Windows® High Performance Computing (HPC) cluster or in a Windows Azure Scheduler deployment in Windows Azure, as well as client-side features that are invoked by applications.
Important
This will be the final preview of LINQ to HPC and we do not plan to move forward with a production release. In line with our announcement in October at the PASS conference, we will focus our effort on bringing Apache Hadoop to both Windows Server and Windows Azure. For more information, see Microsoft to develop Hadoop distributions for Windows Server and Azure and Microsoft Expands Data Platform to Help Customers Manage the ‘New Currency of the Cloud’.
LINQ to HPC, and the DSC support data-intensive computing for many types of applications, such as data mining, image processing, and scientific computing. Where possible, LINQ to HPC co-locates a subset of the data, and the computational logic that processes that data, on the same computer. This proximity is known as data locality. With data locality, you can scale up data-intensive applications by adding more computers to the cluster. With a large enough cluster, you can use LINQ to HPC to store petabytes of data and execute queries across terabyte-sized data sets.
In This Section
| Topic | Description |
|---|---|
Overview of LINQ to HPC and the Distributed Storage Catalog (Beta 2) |
Discusses the components that make up the LINQ to HPC system, and gives an overview of how a LINQ to HPC query executes |
Includes the requirements and resources to help you set up your development environment and the steps to add nodes to the DSC. |
|
Describes how to use the code samples that are included in the SDK download. |
|
Focuses on the client-side components that developers use to create LINQ to HPC applications |