Open Menu Close Menu

Storage

Lustre 2.1 Adds Progressive File Layouts, Project Quota Support

Lustre 2.1 was quietly released last week, adding several new features to the open source filesystem for high-performance computing environments.

Lustre, which has its roots in a project out of Carnegie Mellon University, is a parallel file system designed to handle petabytes of data, with throughput in the hundreds of gigabits per second, and to scale to thousands of clients.

The latest release adds support for progressive file layouts, which allows "file layouts to automatically adjust as size of files grow thus optimizing performance for diverse workloads" by letting administrators "set a specific progressive layout for new files created in the filesystem, and users ... specify progressive layouts on their own files for their specific needs," according to Lustre.

Other new features include:

  • Support for project quotas (in addition to user and group quotas);
  • Support for Lustre Networking (LNet) "to utilize multiple network interfaces on a node in parallel";
  • Improved snapshot capabilities; and
  • NRS Delay Policy, which "simulates high server load as a way of validating the resilience of Lustre under load."

Complete details about the new release can be found on the Lustre wiki. The next major release, 2.11, is expected in January 2018.

About the Author

David Nagel is the former editorial director of 1105 Media's Education Group and editor-in-chief of THE Journal, STEAM Universe, and Spaces4Learning. A 30-year publishing veteran, Nagel has led or contributed to dozens of technology, art, marketing, media, and business publications.

He can be reached at [email protected]. You can also connect with him on LinkedIn at https://www.linkedin.com/in/davidrnagel/ .


comments powered by Disqus