Lustre 2.1 Adds Progressive File Layouts, Project Quota Support

Lustre 2.1 was quietly released last week, adding several new features to the open source filesystem for high-performance computing environments.

Lustre, which has its roots in a project out of Carnegie Mellon University, is a parallel file system designed to handle petabytes of data, with throughput in the hundreds of gigabits per second, and to scale to thousands of clients.

The latest release adds support for progressive file layouts, which allows "file layouts to automatically adjust as size of files grow thus optimizing performance for diverse workloads" by letting administrators "set a specific progressive layout for new files created in the filesystem, and users ... specify progressive layouts on their own files for their specific needs," according to Lustre.

Other new features include:

  • Support for project quotas (in addition to user and group quotas);
  • Support for Lustre Networking (LNet) "to utilize multiple network interfaces on a node in parallel";
  • Improved snapshot capabilities; and
  • NRS Delay Policy, which "simulates high server load as a way of validating the resilience of Lustre under load."

Complete details about the new release can be found on the Lustre wiki. The next major release, 2.11, is expected in January 2018.

About the Author

David Nagel is the former editorial director of 1105 Media's Education Group and editor-in-chief of THE Journal, STEAM Universe, and Spaces4Learning. A 30-year publishing veteran, Nagel has led or contributed to dozens of technology, art, marketing, media, and business publications.

He can be reached at [email protected]. You can also connect with him on LinkedIn at https://www.linkedin.com/in/davidrnagel/ .


Featured

  • digital data protection and cyber security

    White House Launches New AI Security Framework

    President Donald Trump has issued a new executive order aimed at maintaining United States AI leadership while addressing the security risks posed by increasingly powerful AI systems.

  • workshop participants discuss sustainability in open science and research

    Open Source: Advancing Our Digital Commons

    IT leaders are recognizing the benefits of a return to open strategies. CT asked Jack Suess, VP of IT and CIO at UMBC, for his views on returning to the digital commons of open source.

  • Student classroom scene with diverse learners attentively engaging in lecture, using laptops

    The AI Literacy Gap No One Expected

    While Gen Z may be advanced at generating quick outputs or using free LLMs for surface-level tasks, they need to develop critical thinking, communication, and analysis skills.

  • Digital Network of User Profiles and Data Connections

    Microsoft, RSA Make Identity Security Push in the Age of AI

    Two of the bigger authentication announcements to come out of the recent RSA Conference both point in the same direction: Organizations need a more flexible, unified approach to identity security, especially as AI agents start acting alongside human workers.