{% include "tracking.html" %} {% include "header.html"%}

Victor. Automatic site cleaning

Victor is a fully automated, popularity-based site cleaning agent. On a daily basis, Victor scans the Tier2s for full group-site associations and tries to find unpopular, old blocks that can be deleted by the group or site administrators.

Workflow

1. Getting storage space information

Victor focuses on the cleaning of T2 wan_stores with a granularity of physicsgroup-site association. Victor does not attempt to clean the local space.

Storage division

The information sources are: Cleaning is triggered when a group reaches 90% of its pledged resources on a site and Victor will try to suggest unpopular replicas to free up space up to 70% of the pledge. The thresholds are configurable and could be changed.

2. Getting the unpopular replicas

A PhEDEX-Popularity API provides the group’s blocks on a site (with cdate, #file accesses, cpu time, size…). The blocks are sorted from oldest to newest and the following filters are applied:

The definition of popularity metrics can be tuned during validation. At the moment Popularity accounts CRAB file accesses only.

3. Deletion of blocks

No automatic actions are carried out for the moment. The decisions – blocks to clean for groups that exceed the pledge - are published on this web interface. The web interface provides a “shopping cart“ system where the group responsibles can select blocks in a copy&pastable way. Then the group responsibles will request the deletion of blocks to PheDEX themselves.

Victor: Automatic site cleaning