Lustre 2.1 Adds Progressive File Layouts, Project Quota Support

Lustre 2.1 was quietly released last week, adding several new features to the open source filesystem for high-performance computing environments.

Lustre, which has its roots in a project out of Carnegie Mellon University, is a parallel file system designed to handle petabytes of data, with throughput in the hundreds of gigabits per second, and to scale to thousands of clients.

The latest release adds support for progressive file layouts, which allows "file layouts to automatically adjust as size of files grow thus optimizing performance for diverse workloads" by letting administrators "set a specific progressive layout for new files created in the filesystem, and users ... specify progressive layouts on their own files for their specific needs," according to Lustre.

Other new features include:

  • Support for project quotas (in addition to user and group quotas);
  • Support for Lustre Networking (LNet) "to utilize multiple network interfaces on a node in parallel";
  • Improved snapshot capabilities; and
  • NRS Delay Policy, which "simulates high server load as a way of validating the resilience of Lustre under load."

Complete details about the new release can be found on the Lustre wiki. The next major release, 2.11, is expected in January 2018.

About the Author

David Nagel is the former editorial director of 1105 Media's Education Group and editor-in-chief of THE Journal, STEAM Universe, and Spaces4Learning. A 30-year publishing veteran, Nagel has led or contributed to dozens of technology, art, marketing, media, and business publications.

He can be reached at [email protected]. You can also connect with him on LinkedIn at https://www.linkedin.com/in/davidrnagel/ .


Featured

  • closeup of hands using smart phone

    Learning Continuity Built into the LMS Withstands Cloud or Cybersecurity Interruptions

    When your institution's administrative or instructional capabilities face disruption from natural, technical, or malicious events, what measures does your LMS offer to provide a "business as usual" operating and learning environment? Instructure's Ryan Lufkin comments on the LMS and learning continuity.

  • digital brain with network connections

    Microsoft Moving to Internally Developed AI Models in Office Apps

    Microsoft is reportedly using its own in-house artificial intelligence models to handle some workloads in Excel and Outlook, offering new evidence that the company is moving its AI strategy beyond model development and into large-scale cost reduction.

  • businessman holding tablet with holographic AI icons

    Google Moves AI Agents into the Mainstream

    At its recent I/O developer conference, Google presented artificial intelligence agents not as a distant research project, but as a product strategy spanning Search, personal assistants, productivity software, developer tools, and smart glasses.

  • artificial intelligence on laptop

    OpenAI to Combine AI Products into Desktop 'Superapp'

    OpenAI is reportedly developing a desktop application that would combine several of its emerging AI products into a single platform, according to reports, marking the latest step in the company's effort to transform ChatGPT from a standalone chatbot into a broader productivity and automation environment.