Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
PowerScale OneFS Job Engine
Executive summary Job Engine Multiple jobs processing Job exclusion sets
Introduction to job exclusion sets
Restriping exclusion set
Marking exclusion set
Non-exclusion jobs
Job Engine management Job Engine orchestration and job processing File system protection and management Job Engine monitoring and reporting Job Engine best practices and considerations Conclusion

Restriping exclusion set

Restriping exclusion set

  • OneFS protects data by writing file blocks across multiple drives on different nodes. In the OneFS lexicon, this process is known as restriping. The Job Engine defines a restripe exclusion set that contains jobs that involve file system management, protection, and on-disk layout. The restripe exclusion set contains the following jobs:

    • AutoBalance
    • AutoBalanceLin
    • FlexProtect
    • FlexProtectLin
    • MediaScan
    • MultiScan
    • SetProtectPlus
    • ShadowStoreProtect
    • SmartPools
    • Upgrade

    The restriping exclusion set is per phase instead of per job, helping to more efficiently parallelize restripe jobs when they do not need to lock down resources.

    Restriping jobs block each other only when the current phase might perform restriping. This is most evident with MultiScan, whose final phase only sweeps rather than restripes. Similarly, MediaScan, which rarely ever restripes, can typically run to completion without contending with other restriping jobs.

    In the following example, the two restripe jobs, MediaScan and AutoBalanceLin, are both running their respective first job phases. ShadowStoreProtect, also a restriping job, is in a Waiting state, blocked by AutoBalanceLin.

    Running and queued jobs:

    ID    Type               State       Impact  Pri  Phase  Running Time

    ----------------------------------------------------------------------

    26850 AutoBalanceLin     Running     Low     4    1/3    20d 18h 19m 

    26910 ShadowStoreProtect Waiting     Low     6    1/1    -           

    28133 MediaScan          Running     Low     8    1/8    1d 15h 37m  

    ----------------------------------------------------------------------

    MediaScan restripes in phases 3 and 5 of the job, and only if there are disk errors (ECCs) that require data reprotection. If MediaScan reaches phase 3 with ECCs, it will pause until AutoBalanceLin is no longer running. If MediaScan's priority was in the 1 through 3 range, it would cause AutoBalanceLin to pause instead.

    If two jobs happen to reach their restriping phases simultaneously and the jobs have different priorities, the higher-priority job (the priority value closer to 1) will continue to run, and the other job will pause. If the two jobs have the same priority, the job that is already in its restriping phase will continue to run, and the job that is newly entering its restriping phase will pause.