Instructions For Running the JetMET Validation Utility

The release validation utility is used to compare a target release against a reference release. Many Jet and MET related distributions produced and used for the comparison. The results are written to subdirectories corresponding to the different jet reconstuction algorithms and can be viewed using a web browser.
  1. Create a release area
      scramv1 project -n CMSSW_3_3_6_val CMSSW CMSSW_3_3_6
      cd CMSSW_3_3_6_val/src
      eval `scramv1 runtime -csh`
      cmscvsroot CMSSW
    

  2. Check out and build the JetMet release validation package

       cvs co -r V04-02-08 Validation/RecoJets
       scramv1 b
    

  3. Specify the dataset

    Edit the file

       Validation/RecoJets/analysis/alljets_validation_cfg.py
    
    and include the data files you would like to run over.

  4. Run the job

    Execute the following commands:

       cd Validation/RecoJets/analysis
       cmsRun allJets_validation_cfg.py
       # cmsRun allJets_validation_before_330pre4_cfg.py (if 330 and before pre4)
    

    This will produce a output root file containing histograms of various distributions used to validate the release.

    In order to compare distributions from two different releases you have to run over a reference sample and a target sample to produce two sets of root file.

  5. Run the validation.sh script

    The script will produce gif files comparing the reference distribution with the target distribution.

    The script will prompt you to enter the name of the root files you want to compare and the name of the directory where the plots should be written to. This directory name is also used for the title in the histograms.

  6. Open the index.html file (located in the new directory) in a web browser
      firefox index.html
    
    Now you can view at all the plots.

Example

The alljets_validation_cfg.py runs per default over the
  
sample.
  cmsRun alljets_validation_cfg.py
The histogramms are written to the root file:
  QCD_80_120_STARTUP_V7_v2.root

To generate the comparison plots run the script:

  ./validation.sh
The prompt shows:
  This script produces all the histograms and plots...
  Enter the REFERNCE.root file, the NEW.root file, the directory name/histo title and the normalization ([REFERNCE.root] [NEW.root] [title] [normalization])
With [normalization] one can chose a normalization from the number of entries in the histogramm (write y) or the number of events (write nothing). The normalization is set per default to the number of events.
For a test compare the file to itself, and save the files in a directory called testdir
  QCD_80_120_STARTUP_V7_v2.root QCD_80_120_STARTUP_V7_v2.root testdir
or
  QCD_80_120_STARTUP_V7_v2.root QCD_80_120_STARTUP_V7_v2.root testdir y

The plots can be examined in a browser by executing:

  firefox testdir/index.html