Execution Time4.11s

Test: tutorial-tmva-TMVACrossValidation (Passed)
Build: master-x86_64-centos7-clang100-opt-no-rt-cxxmodules (olsnba08.cern.ch) on 2019-11-14 01:39:53
Repository revision: 32b17abcda23e44b64218a42d0ca69cb30cda7e0

Test Timing: Passed
Processors1

Show Command Line
Display graphs:

Test output
Processing /data/sftnight/workspace/root-benchmark-no-rt-cxxmodules/BUILDTYPE/Release/COMPILER/clang_gcc62/LABEL/performance-sandy-cc7/root/tutorials/tmva/TMVACrossValidation.C...
create data set info dataset
DataSetInfo              : [dataset] : Added class "Signal"
                         : Add Tree  of type Signal with 1000 events
DataSetInfo              : [dataset] : Added class "Background"
                         : Add Tree  of type Background with 1000 events
<HEADER> Factory                  : You are running ROOT Version: 6.19/01, May 29, 2019
                         : 
                         : _/_/_/_/_/ _|      _|  _|      _|    _|_|   
                         :    _/      _|_|  _|_|  _|      _|  _|    _| 
                         :   _/       _|  _|  _|  _|      _|  _|_|_|_| 
                         :  _/        _|      _|    _|  _|    _|    _| 
                         : _/         _|      _|      _|      _|    _| 
                         : 
                         : ___________TMVA Version 4.2.1, Feb 5, 2015
                         : 
                         : Building event vectors for type 2 Signal
                         : Dataset[dataset] :  create input formulas for tree 
                         : Building event vectors for type 2 Background
                         : Dataset[dataset] :  create input formulas for tree 
<HEADER> DataSetFactory           : [dataset] : Number of events in input trees
                         : 
                         : 
                         : Number of training and testing events
                         : ---------------------------------------------------------------------------
                         : Signal     -- training events            : 999
                         : Signal     -- testing events             : 1
                         : Signal     -- training and testing events: 1000
                         : Background -- training events            : 999
                         : Background -- testing events             : 1
                         : Background -- training and testing events: 1000
                         : 
<HEADER> DataSetInfo              : Correlation matrix (Signal):
                         : ------------------------
                         :                x       y
                         :       x:  +1.000  +0.073
                         :       y:  +0.073  +1.000
                         : ------------------------
<HEADER> DataSetInfo              : Correlation matrix (Background):
                         : ------------------------
                         :                x       y
                         :       x:  +1.000  +0.023
                         :       y:  +0.023  +1.000
                         : ------------------------
<HEADER> DataSetFactory           : [dataset] :  
                         : 
                         : 
                         : 
                         : ========================================
                         : Processing folds for method BDTG
                         : ========================================
                         : 
<HEADER> Factory                  : Booking method: BDTG_fold1
                         : 
<HEADER> BDTG_fold1               : #events: (reweighted) sig: 499.5 bkg: 499.5
                         : #events: (unweighted) sig: 496 bkg: 503
                         : Training 100 Decision Trees ... patience please
                         : Elapsed time for training with 999 events: 0.0942 sec         
<HEADER> BDTG_fold1               : [dataset] : Evaluation of BDTG_fold1 on training sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.0049 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_BDTG_fold1.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_BDTG_fold1.class.C
<HEADER> Factory                  : Test all methods
<HEADER> Factory                  : Test method: BDTG_fold1 for Classification performance
                         : 
<HEADER> BDTG_fold1               : [dataset] : Evaluation of BDTG_fold1 on testing sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.00559 sec       
<HEADER> Factory                  : Evaluate all methods
<HEADER> Factory                  : Evaluate classifier: BDTG_fold1
                         : 
<HEADER> BDTG_fold1               : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
                         : 
                         : Evaluation results ranked by best signal efficiency and purity (area)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet       MVA                       
                         : Name:         Method:          ROC-integ
                         : dataset       BDTG_fold1     : 0.969
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
                         : Testing efficiency compared to training efficiency (overtraining check)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet              MVA              Signal efficiency: from test sample (from training sample) 
                         : Name:                Method:          @B=0.01             @B=0.10            @B=0.30   
                         : -------------------------------------------------------------------------------------------------------------------
                         : dataset              BDTG_fold1     : 0.588 (0.666)       0.926 (0.930)      0.976 (0.976)
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
<HEADER> Factory                  : Thank you for using TMVA!
                         : For citation information, please visit: http://tmva.sf.net/citeTMVA.html
<HEADER> Factory                  : Booking method: BDTG_fold2
                         : 
<HEADER> BDTG_fold2               : #events: (reweighted) sig: 499.5 bkg: 499.5
                         : #events: (unweighted) sig: 503 bkg: 496
                         : Training 100 Decision Trees ... patience please
                         : Elapsed time for training with 999 events: 0.0926 sec         
<HEADER> BDTG_fold2               : [dataset] : Evaluation of BDTG_fold2 on training sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.00486 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_BDTG_fold2.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_BDTG_fold2.class.C
<HEADER> Factory                  : Test all methods
<HEADER> Factory                  : Test method: BDTG_fold2 for Classification performance
                         : 
<HEADER> BDTG_fold2               : [dataset] : Evaluation of BDTG_fold2 on testing sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.00481 sec       
<HEADER> Factory                  : Evaluate all methods
<HEADER> Factory                  : Evaluate classifier: BDTG_fold2
                         : 
<HEADER> BDTG_fold2               : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
                         : 
                         : Evaluation results ranked by best signal efficiency and purity (area)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet       MVA                       
                         : Name:         Method:          ROC-integ
                         : dataset       BDTG_fold2     : 0.966
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
                         : Testing efficiency compared to training efficiency (overtraining check)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet              MVA              Signal efficiency: from test sample (from training sample) 
                         : Name:                Method:          @B=0.01             @B=0.10            @B=0.30   
                         : -------------------------------------------------------------------------------------------------------------------
                         : dataset              BDTG_fold2     : 0.612 (0.693)       0.922 (0.932)      0.975 (0.977)
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
<HEADER> Factory                  : Thank you for using TMVA!
                         : For citation information, please visit: http://tmva.sf.net/citeTMVA.html
<HEADER> Factory                  : Booking method: BDTG
                         : 
                         : Reading weightfile: dataset/weights/TMVACrossValidation_BDTG_fold1.weights.xml
                         : Reading weight file: dataset/weights/TMVACrossValidation_BDTG_fold1.weights.xml
                         : Reading weightfile: dataset/weights/TMVACrossValidation_BDTG_fold2.weights.xml
                         : Reading weight file: dataset/weights/TMVACrossValidation_BDTG_fold2.weights.xml
                         : 
                         : 
                         : ========================================
                         : Processing folds for method Fisher
                         : ========================================
                         : 
<HEADER> Factory                  : Booking method: Fisher_fold1
                         : 
<HEADER> Fisher_fold1             : Results for Fisher coefficients:
                         : -----------------------
                         : Variable:  Coefficient:
                         : -----------------------
                         :        x:       +0.505
                         :        y:       +0.430
                         : (offset):       +0.006
                         : -----------------------
                         : Elapsed time for training with 999 events: 0.00167 sec         
<HEADER> Fisher_fold1             : [dataset] : Evaluation of Fisher_fold1 on training sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.000128 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_Fisher_fold1.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_Fisher_fold1.class.C
<HEADER> Factory                  : Test all methods
<HEADER> Factory                  : Test method: Fisher_fold1 for Classification performance
                         : 
<HEADER> Fisher_fold1             : [dataset] : Evaluation of Fisher_fold1 on testing sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.000226 sec       
<HEADER> Factory                  : Evaluate all methods
<HEADER> Factory                  : Evaluate classifier: Fisher_fold1
                         : 
<HEADER> Fisher_fold1             : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
                         : 
                         : Evaluation results ranked by best signal efficiency and purity (area)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet       MVA                       
                         : Name:         Method:          ROC-integ
                         : dataset       Fisher_fold1   : 0.970
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
                         : Testing efficiency compared to training efficiency (overtraining check)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet              MVA              Signal efficiency: from test sample (from training sample) 
                         : Name:                Method:          @B=0.01             @B=0.10            @B=0.30   
                         : -------------------------------------------------------------------------------------------------------------------
                         : dataset              Fisher_fold1   : 0.638 (0.675)       0.929 (0.921)      0.978 (0.978)
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
<HEADER> Factory                  : Thank you for using TMVA!
                         : For citation information, please visit: http://tmva.sf.net/citeTMVA.html
<HEADER> Factory                  : Booking method: Fisher_fold2
                         : 
<HEADER> Fisher_fold2             : Results for Fisher coefficients:
                         : -----------------------
                         : Variable:  Coefficient:
                         : -----------------------
                         :        x:       +0.446
                         :        y:       +0.479
                         : (offset):       +0.011
                         : -----------------------
                         : Elapsed time for training with 999 events: 0.000816 sec         
<HEADER> Fisher_fold2             : [dataset] : Evaluation of Fisher_fold2 on training sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.000146 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_Fisher_fold2.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_Fisher_fold2.class.C
<HEADER> Factory                  : Test all methods
<HEADER> Factory                  : Test method: Fisher_fold2 for Classification performance
                         : 
<HEADER> Fisher_fold2             : [dataset] : Evaluation of Fisher_fold2 on testing sample (999 events)
                         : Elapsed time for evaluation of 999 events: 0.000258 sec       
<HEADER> Factory                  : Evaluate all methods
<HEADER> Factory                  : Evaluate classifier: Fisher_fold2
                         : 
<HEADER> Fisher_fold2             : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
                         : 
                         : Evaluation results ranked by best signal efficiency and purity (area)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet       MVA                       
                         : Name:         Method:          ROC-integ
                         : dataset       Fisher_fold2   : 0.971
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
                         : Testing efficiency compared to training efficiency (overtraining check)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet              MVA              Signal efficiency: from test sample (from training sample) 
                         : Name:                Method:          @B=0.01             @B=0.10            @B=0.30   
                         : -------------------------------------------------------------------------------------------------------------------
                         : dataset              Fisher_fold2   : 0.655 (0.645)       0.918 (0.921)      0.982 (0.981)
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
<HEADER> Factory                  : Thank you for using TMVA!
                         : For citation information, please visit: http://tmva.sf.net/citeTMVA.html
<HEADER> Factory                  : Booking method: Fisher
                         : 
                         : Reading weightfile: dataset/weights/TMVACrossValidation_Fisher_fold1.weights.xml
                         : Reading weight file: dataset/weights/TMVACrossValidation_Fisher_fold1.weights.xml
                         : Reading weightfile: dataset/weights/TMVACrossValidation_Fisher_fold2.weights.xml
                         : Reading weight file: dataset/weights/TMVACrossValidation_Fisher_fold2.weights.xml
                         : 
                         : 
                         : ========================================
                         : Folds processed for all methods, evaluating.
                         : ========================================
                         : 
<HEADER> Factory                  : [dataset] : Create Transformation "I" with events from all classes.
                         : 
<HEADER>                          : Transformation, Variable selection : 
                         : Input : variable 'x' <---> Output : variable 'x'
                         : Input : variable 'y' <---> Output : variable 'y'
<HEADER> TFHandler_Factory        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :        x:  -0.014734     1.4061   [    -4.1075     4.0969 ]
                         :        y: -0.0050703     1.4200   [    -4.8520     4.0761 ]
                         : -----------------------------------------------------------
                         : Ranking input variables (method unspecific)...
<HEADER> IdTransformation         : Ranking result (top variable is best ranked)
                         : --------------------------
                         : Rank : Variable  : Separation
                         : --------------------------
                         :    1 : x         : 5.452e-01
                         :    2 : y         : 5.244e-01
                         : --------------------------
                         : Elapsed time for training with 1998 events: 8.11e-06 sec         
<HEADER> BDTG                     : [dataset] : Evaluation of BDTG on training sample (1998 events)
                         : Elapsed time for evaluation of 1998 events: 0.00985 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_BDTG.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_BDTG.class.C
<WARNING> <WARNING>                : MakeClassSpecificHeader not implemented for CrossValidation
<WARNING> <WARNING>                : MakeClassSpecific not implemented for CrossValidation
                         : Elapsed time for training with 1998 events: 6.91e-06 sec         
<HEADER> Fisher                   : [dataset] : Evaluation of Fisher on training sample (1998 events)
                         : Elapsed time for evaluation of 1998 events: 0.00119 sec       
                         : Creating xml weight file: dataset/weights/TMVACrossValidation_Fisher.weights.xml
                         : Creating standalone class: dataset/weights/TMVACrossValidation_Fisher.class.C
<WARNING> <WARNING>                : MakeClassSpecificHeader not implemented for CrossValidation
<WARNING> <WARNING>                : MakeClassSpecific not implemented for CrossValidation
<HEADER> Factory                  : Test all methods
<HEADER> Factory                  : Test method: BDTG for Classification performance
                         : 
<HEADER> BDTG                     : [dataset] : Evaluation of BDTG on testing sample (1998 events)
                         : Elapsed time for evaluation of 1998 events: 0.00961 sec       
<HEADER> Factory                  : Test method: Fisher for Classification performance
                         : 
<HEADER> Fisher                   : [dataset] : Evaluation of Fisher on testing sample (1998 events)
                         : Elapsed time for evaluation of 1998 events: 0.0011 sec       
<HEADER> Factory                  : Evaluate all methods
<HEADER> Factory                  : Evaluate classifier: BDTG
                         : 
<HEADER> BDTG                     : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
<HEADER> TFHandler_BDTG           : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :        x:  -0.014734     1.4061   [    -4.1075     4.0969 ]
                         :        y: -0.0050703     1.4200   [    -4.8520     4.0761 ]
                         : -----------------------------------------------------------
<HEADER> Factory                  : Evaluate classifier: Fisher
                         : 
<HEADER> Fisher                   : [dataset] : Loop over test events and fill histograms with classifier response...
                         : 
<HEADER> TFHandler_Fisher         : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :        x:  -0.014734     1.4061   [    -4.1075     4.0969 ]
                         :        y: -0.0050703     1.4200   [    -4.8520     4.0761 ]
                         : -----------------------------------------------------------
                         : 
                         : Evaluation results ranked by best signal efficiency and purity (area)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet       MVA                       
                         : Name:         Method:          ROC-integ
                         : dataset       Fisher         : 0.971
                         : dataset       BDTG           : 0.967
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
                         : Testing efficiency compared to training efficiency (overtraining check)
                         : -------------------------------------------------------------------------------------------------------------------
                         : DataSet              MVA              Signal efficiency: from test sample (from training sample) 
                         : Name:                Method:          @B=0.01             @B=0.10            @B=0.30   
                         : -------------------------------------------------------------------------------------------------------------------
                         : dataset              Fisher         : 0.645 (0.645)       0.924 (0.924)      0.979 (0.979)
                         : dataset              BDTG           : 0.600 (0.600)       0.923 (0.923)      0.974 (0.974)
                         : -------------------------------------------------------------------------------------------------------------------
                         : 
<HEADER> Dataset:dataset          : Created tree 'TestTree' with 1998 events
                         : 
<HEADER> Dataset:dataset          : Created tree 'TrainTree' with 1998 events
                         : 
<HEADER> Factory                  : Thank you for using TMVA!
                         : For citation information, please visit: http://tmva.sf.net/citeTMVA.html
                         : Evaluation done.
Summary for method BDT
	Fold 0: ROC int: 0.968758, BkgEff@SigEff=0.3: 0.976
	Fold 1: ROC int: 0.965505, BkgEff@SigEff=0.3: 0.975
Summary for method Fisher
	Fold 0: ROC int: 0.970423, BkgEff@SigEff=0.3: 0.978
	Fold 1: ROC int: 0.97145, BkgEff@SigEff=0.3: 0.982
==> Wrote root file: TMVA.root
==> TMVACrossValidation is done!
(int) 0