It’s been a year since we announced AWS Parallel Computing Service (PCS). In a way this is the third generation of Slurm-based HPC orchestrators that we’ve brought to you. We’ve learned much from helping customers deploy serious production workloads on AWS ParallelCluster, which itself grew from the foundations layed by CfnCluster – the open-source project [...]

When Internet egress is blocked by default inside your cloud environment, what external sites and destinations need to be allowed for AWS Parallelcluster?

AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud. - aws/aws-parallelcluster

Stop finding out about HPC cluster problems from frustrated users. This post walks through some basic experiments with a Terraform-based approach to proactive AWS ParallelCluster monitoring, using Clo...

Discover more about what's new at AWS with AWS ParallelCluster 3.16 adds an on-node diagnostics tool

AWS ParallelCluster 3.14 is now generally available. This release includes P6e-GB200 and P6-B200 instance types, prioritized allocation strategies for optimized instance placement, and NICE DCV support for Amazon Linux 2023. Other features included in this release are support for chef-client log visibility in instance console inside the instance's system log and Amazon Linux 2023 with kernel 6.12. To get started using P6e-GB200 instances with ParallelCluster, follow the tutorial in the ParallelCluster User Guide - https://docs.aws.amazon.com/parallelcluster/latest/ug/support-nvidia-imex-p6e-gb200-instance.html. For more details on the release, review the AWS ParallelCluster 3.14.0 https://github.com/aws/aws-parallelcluster/releases/tag/v3.14.0. ParallelCluster is a fully-supported and maintained open-source cluster management tool that enables R&D customers and their IT administrators to operate high-performance computing (HPC) clusters on AWS. ParallelCluster is designed to automatically and securely provision cloud resources into elastically-scaling HPC clusters capable of running scientific and engineering workloads at scale on AWS. ParallelCluster is available at no additional charge in the AWS Regions listed https://docs.aws.amazon.com/parallelcluster/latest/ug/supported-regions.html, and you pay only for the AWS resources needed to run your applications. To learn more about launching HPC clusters on AWS, visit the ParallelCluster https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials-v3.html. To start using ParallelCluster, see the installation instructions for ParallelCluster https://docs.aws.amazon.com/parallelcluster/latest/ug/install-pcui-v3.html and https://docs.aws.amazon.com/parallelcluster/latest/ug/install-v3-parallelcluster.html.

AWS ParallelCluster 3.14 is now generally available. This release includes P6e-GB200 and P6-B200 instance types, prioritized allocation strategies for optimized instance placement, and NICE DCV support for Amazon Linux 2023. Other features included in this release are support for chef-client log visibility in instance console inside the instance's system log and Amazon Linux 2023 with kernel 6.12. To get started using P6e-GB200 instances with ParallelCluster, follow the tutorial in the ParallelCluster User Guide - Using Amazon EC2 P6e-GB200 UltraServers in AWS ParallelCluster. For more details on the release, review the AWS ParallelCluster 3.14.0 release notes. ParallelCluster is a fully-supported and maintained open-source cluster management tool that enables R&D customers and their IT administrators to operate high-performance computing (HPC) clusters on AWS. ParallelCluster is designed to automatically and securely provision cloud resources into elastically-scaling HPC clusters capable of running scientific and engineering workloads at scale on AWS. ParallelCluster is available at no additional charge in the AWS Regions listed here, and you pay only for the AWS resources needed to run your applications. To learn more about launching HPC clusters on AWS, visit the ParallelCluster User Guide. To start using ParallelCluster, see the installation instructions for ParallelCluster UI and CLI.

AWS ParallelCluster 3.16 is now generally available with a new on-node diagnostics tool, cluster stability improvements, and an updated HPC and AI/ML software stack. pcluster-diag is a diagnostics tool built into the ParallelCluster AMIs that lets you run diagnostic checks on any cluster node with a single command, and get a structured report that makes it easier to identify issues. This release also hardens the cluster lifecycle with more resilient cluster creation, updates, and image builds. The software stack is refreshed, with updated NVIDIA driver, CUDA, EFA installer, and Slurm versions. To get started with pcluster-diag, see https://docs.aws.amazon.com/parallelcluster/latest/ug/troubleshooting-v3-pcluster-diag.html. For more details, review the AWS ParallelCluster 3.16.0 https://github.com/aws/aws-parallelcluster/releases/tag/v3.16.0. AWS ParallelCluster is an open-source cluster management tool that makes it possible for R&D customers and IT administrators to operate high-performance computing (HPC) clusters on AWS. ParallelCluster is designed to automatically and securely provision cloud resources into elastically-scaling HPC clusters capable of running scientific and engineering workloads at scale on AWS. ParallelCluster is available at no additional charge in the AWS Regions listed https://docs.aws.amazon.com/parallelcluster/latest/ug/supported-regions.html, and you pay only for the AWS resources needed to run your applications. To learn more about launching HPC clusters on AWS, visit the ParallelCluster https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials-v3.html. To start using ParallelCluster, see the installation instructions for ParallelCluster https://docs.aws.amazon.com/parallelcluster/latest/ug/install-pcui-v3.html and https://docs.aws.amazon.com/parallelcluster/latest/ug/install-v3-parallelcluster.html.

AWS ParallelCluster 3.12 is now generally available. This release makes it possible to include Lustre and NVIDIA software components in ParallelCluster custom images. Now, you can include ParallelCluster's recommended Nvidia drivers and CUDA libraries in custom images. This update also makes the Lustre client optional to account for scenarios where you may opt for alternative storage solutions. To enable these optional software components when creating custom images, configure the NvidiaSoftware and the LustreClient parameters in the build image configuration file when using the build-image command. For more details on the release, review the AWS ParallelCluster 3.12.0 release notes. AWS ParallelCluster is a fully-supported and maintained open-source cluster management tool that enables R&D customers and their IT administrators to operate high-performance computing (HPC) clusters on AWS. AWS ParallelCluster is designed to automatically and securely provision cloud resources into elastically-scaling HPC clusters capable of running scientific, engineering, and machine-learning (ML/AI) workloads at scale on AWS. AWS ParallelCluster is available at no additional charge in the AWS Regions listed here, and you pay only for the AWS resources needed to run your applications. To learn more about launching HPC clusters on AWS, visit the AWS ParallelCluster User Guide. To start using ParallelCluster, see the installation instructions for ParallelCluster UI and CLI.

Proteros is a leader in structure-based drug discovery solutions, and supports pharmaceutical, biotechnological, and academic clients with advanced technologies like Cryogenic Electron Microscopy…

Proteros is a leader in structure-based drug discovery solutions, and supports pharmaceutical, biotechnological, and academic clients with advanced technologies like Cryogenic Electron Microscopy…

Proteros is a leader in structure-based drug discovery solutions, and supports pharmaceutical, biotechnological, and academic clients with advanced technologies like Cryogenic Electron Microscopy (Cryo-EM) and Protein Crystallography (PX). In this blog post, we’ll explore how Proteros implemented an HPC solution that scales with their scientific ambitions. We’ll talk about how they started with a secure [...]