About Loafre

 

The Lustre Online Active File Replication (or Loafre) tool is a high-performance, dynamic, advanced file system management and replication tool for Lustre 2 file systems.


Goals

Loafre works to bring the promise of the Lustre 2 changelog feature to fruition by constantly monitoring file system activity and then acting on those changes.

With this, Loafre can help to solve the problems associated with high performance computing file systems. These include but are not limited to

  • Ease of use, friendly web-based configuration
  • Cross platform compatible (if the platform supports Lustre Client it can support Loafre services)
  • Scanning file system meta data for various operations (find / locate updatedb / quota usage) etc. can be extremely slow
  • Immediate¬†or delayed replication and backup of critical file system paths
  • Replication of all or select parts of the file system to one or more sources
    • Replication of only certain events (MKDIR CREATE, etc)
  • Core platform to provide additional functionality such as directory based soft quota support and other nifty features

Features and functionality

Loafre currently supports the following feature set:

  • Scalable architecture designed to run on multiple nodes at the same time
  • Actively monitors changes in near real time on Lustre 2 file systems
  • Multiple monitor nodes can be run against a single file system
    • A single monitor node can monitor multiple file systems
  • Full and near real time meta data tracking
  • Replication and Backup services
  • Always on intelligent service daemon
  • Highly customizable
  • Logging
  • MySQL Database access
  • Definable replication rules
    • Advanced Scheduling
    • Definable, advanced match rules
    • Actions to take
      • Utilize multiple `worker’ nodes
      • Remote copy, Remote delete, Remote move, Remote chmod
        • All commands are customizable and fully definable
    • Multiple definable exclude lists with:
      • Directory path
      • Wild card
      • Regular expression
  • Web interface
    • User access
      • Definable authentication schema
    • File System configuration
    • Replication rule configuration
      • Exclude Lists configuration
    • Statistical graphing via RRDTool
    • Log file monitor
    • File system activity monitor