Execution Time89.94s

Test: tutorial-tmva-TMVAMulticlass (Passed)
Build: master-x86_64-mac1013-clang100 (macphsft16.dyndns.cern.ch) on 2020-05-26 23:54:42

Test Timing: Passed
Processors1

Show Command Line
Display graphs:

Test output
Processing /build/night/LABEL/mac1013/SPEC/cxx14/V/master/root/tutorials/tmva/TMVAMulticlass.C...

==> Start TMVAMulticlass
[TFile::Cp] Total 0.12 MB	|>...................| 0.00 % [0.0 MB/s][TFile::Cp] Total 0.12 MB	|====================| 100.00 % [9.6 MB/s]
Info in <TFile::OpenFromCache>: using local cache copy of http://root.cern.ch/files/tmva_multiclass_example.root [./files/tmva_multiclass_example.root]
--- TMVAMulticlass: Using input file: ./files/tmva_multiclass_example.root
DataSetInfo              : [dataset] : Added class "Signal"
                         : Add Tree TreeS of type Signal with 2000 events
DataSetInfo              : [dataset] : Added class "bg0"
                         : Add Tree TreeB0 of type bg0 with 2000 events
DataSetInfo              : [dataset] : Added class "bg1"
                         : Add Tree TreeB1 of type bg1 with 2000 events
DataSetInfo              : [dataset] : Added class "bg2"
                         : Add Tree TreeB2 of type bg2 with 2000 events
                         : Dataset[dataset] : Class index : 0  name : Signal
                         : Dataset[dataset] : Class index : 1  name : bg0
                         : Dataset[dataset] : Class index : 2  name : bg1
                         : Dataset[dataset] : Class index : 3  name : bg2
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mBDTG[NON-XML-CHAR-0x1B][0m
                         : 
                         : the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
                         : --> change to new default NegWeightTreatment=Pray
                         : Building event vectors for type 2 Signal
                         : Dataset[dataset] :  create input formulas for tree TreeS
                         : Building event vectors for type 2 bg0
                         : Dataset[dataset] :  create input formulas for tree TreeB0
                         : Building event vectors for type 2 bg1
                         : Dataset[dataset] :  create input formulas for tree TreeB1
                         : Building event vectors for type 2 bg2
                         : Dataset[dataset] :  create input formulas for tree TreeB2
DataSetFactory           : [dataset] : Number of events in input trees
                         : 
                         : 
                         : 
                         : 
                         : Number of training and testing events
                         : ---------------------------------------------------------------------------
                         : Signal -- training events            : 1000
                         : Signal -- testing events             : 1000
                         : Signal -- training and testing events: 2000
                         : bg0    -- training events            : 1000
                         : bg0    -- testing events             : 1000
                         : bg0    -- training and testing events: 2000
                         : bg1    -- training events            : 1000
                         : bg1    -- testing events             : 1000
                         : bg1    -- training and testing events: 2000
                         : bg2    -- training events            : 1000
                         : bg2    -- testing events             : 1000
                         : bg2    -- training and testing events: 2000
                         : 
DataSetInfo              : Correlation matrix (Signal):
                         : ----------------------------------------
                         :             var1    var2    var3    var4
                         :    var1:  +1.000  +0.380  +0.585  +0.822
                         :    var2:  +0.380  +1.000  +0.724  +0.734
                         :    var3:  +0.585  +0.724  +1.000  +0.852
                         :    var4:  +0.822  +0.734  +0.852  +1.000
                         : ----------------------------------------
DataSetInfo              : Correlation matrix (bg0):
                         : ----------------------------------------
                         :             var1    var2    var3    var4
                         :    var1:  +1.000  +0.420  +0.614  +0.846
                         :    var2:  +0.420  +1.000  +0.702  +0.738
                         :    var3:  +0.614  +0.702  +1.000  +0.847
                         :    var4:  +0.846  +0.738  +0.847  +1.000
                         : ----------------------------------------
DataSetInfo              : Correlation matrix (bg1):
                         : ----------------------------------------
                         :             var1    var2    var3    var4
                         :    var1:  +1.000  +0.387  +0.603  +0.834
                         :    var2:  +0.387  +1.000  +0.698  +0.727
                         :    var3:  +0.603  +0.698  +1.000  +0.844
                         :    var4:  +0.834  +0.727  +0.844  +1.000
                         : ----------------------------------------
DataSetInfo              : Correlation matrix (bg2):
                         : ----------------------------------------
                         :             var1    var2    var3    var4
                         :    var1:  +1.000  -0.648  +0.043  +0.022
                         :    var2:  -0.648  +1.000  -0.013  -0.032
                         :    var3:  +0.043  -0.013  +1.000  -0.060
                         :    var4:  +0.022  -0.032  -0.060  +1.000
                         : ----------------------------------------
DataSetFactory           : [dataset] :  
                         : 
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mMLP[NON-XML-CHAR-0x1B][0m
                         : 
MLP                      : Building Network. 
                         : Initializing weights
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mPDEFoam[NON-XML-CHAR-0x1B][0m
                         : 
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mDL_CPU[NON-XML-CHAR-0x1B][0m
                         : 
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=CROSSENTROPY:VarTransform=N:WeightInitialization=XAVIERUNIFORM:Architecture=GPU:Layout=TANH|100,TANH|50,TANH|10,LINEAR:TrainingStrategy=Optimizer=ADAM,LearningRate=1e-3,TestRepetitions=1,ConvergenceSteps=10,BatchSize=100"
                         : The following options are set:
                         : - By User:
                         :     <none>
                         : - Default:
                         :     Boost_num: "0" [Number of times the classifier will be boosted]
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=CROSSENTROPY:VarTransform=N:WeightInitialization=XAVIERUNIFORM:Architecture=GPU:Layout=TANH|100,TANH|50,TANH|10,LINEAR:TrainingStrategy=Optimizer=ADAM,LearningRate=1e-3,TestRepetitions=1,ConvergenceSteps=10,BatchSize=100"
                         : The following options are set:
                         : - By User:
                         :     V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
                         :     VarTransform: "N" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
                         :     H: "False" [Print method-specific help message]
                         :     Layout: "TANH|100,TANH|50,TANH|10,LINEAR" [Layout of the network.]
                         :     ErrorStrategy: "CROSSENTROPY" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
                         :     WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
                         :     Architecture: "GPU" [Which architecture to perform the training on.]
                         :     TrainingStrategy: "Optimizer=ADAM,LearningRate=1e-3,TestRepetitions=1,ConvergenceSteps=10,BatchSize=100" [Defines the training strategies.]
                         : - Default:
                         :     VerbosityLevel: "Default" [Verbosity level]
                         :     CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
                         :     IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
                         :     InputLayout: "0|0|0" [The Layout of the input]
                         :     BatchLayout: "0|0|0" [The Layout of the batch]
                         :     RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
                         :     ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DL_CPU                   : [dataset] : Create Transformation "N" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
[NON-XML-CHAR-0x1B][31m<ERROR>                         : CUDA backend not enabled. Please make sure you have CUDA installed and it was successfully detected by CMAKE by using -Dtmva-gpu=On  [NON-XML-CHAR-0x1B][0m
                         : Will now use instead the CPU architecture !
                         : Will now use the CPU architecture with BLAS and IMT support !
Factory                  : [NON-XML-CHAR-0x1B][1mTrain all methods[NON-XML-CHAR-0x1B][0m
Factory                  : [dataset] : Create Transformation "I" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
Factory                  : [dataset] : Create Transformation "D" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
Factory                  : [dataset] : Create Transformation "P" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
Factory                  : [dataset] : Create Transformation "G" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
Factory                  : [dataset] : Create Transformation "D" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'var1' <---> Output : variable 'var1'
                         : Input : variable 'var2' <---> Output : variable 'var2'
                         : Input : variable 'var3' <---> Output : variable 'var3'
                         : Input : variable 'var4' <---> Output : variable 'var4'
TFHandler_Factory        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.053071     1.0218   [    -4.0592     3.1808 ]
                         :     var2:    0.32106     1.0454   [    -3.6891     3.7877 ]
                         :     var3:   0.099841     1.1199   [    -3.6296     4.5640 ]
                         :     var4:  -0.075551     1.2695   [    -4.8486     4.3625 ]
                         : -----------------------------------------------------------
                         : Preparing the Decorrelation transformation...
TFHandler_Factory        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.091374     1.0000   [    -3.5847     3.0621 ]
                         :     var2:    0.37000     1.0000   [    -3.3625     3.0904 ]
                         :     var3:   0.048757     1.0000   [    -2.8997     3.3213 ]
                         :     var4:   -0.20193     1.0000   [    -3.0052     2.6116 ]
                         : -----------------------------------------------------------
                         : Preparing the Principle Component (PCA) transformation...
TFHandler_Factory        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1: 2.5287e-10     1.8075   [    -7.2627     6.6994 ]
                         :     var2:-1.1328e-10    0.89941   [    -3.1772     2.6437 ]
                         :     var3: 3.5745e-11    0.74260   [    -2.6363     2.1877 ]
                         :     var4: 1.7011e-11    0.61261   [    -1.6206     2.2041 ]
                         : -----------------------------------------------------------
                         : Preparing the Gaussian transformation...
                         : Preparing the Decorrelation transformation...
TFHandler_Factory        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.011817     1.0000   [    -2.5290     6.2783 ]
                         :     var2:  0.0095132     1.0000   [    -2.6646     3.9638 ]
                         :     var3:  0.0087874     1.0000   [    -2.9830     5.5935 ]
                         :     var4:  0.0066995     1.0000   [    -3.0325     5.6848 ]
                         : -----------------------------------------------------------
                         : Ranking input variables (method unspecific)...
Factory                  : Train method: BDTG for Multiclass classification
                         : 
                         : Training 1000 Decision Trees ... patience please
0%, time left: unknown
6%, time left: 11 sec
12%, time left: 10 sec
18%, time left: 10 sec
25%, time left: 9 sec
31%, time left: 8 sec
37%, time left: 7 sec
43%, time left: 7 sec
50%, time left: 6 sec
56%, time left: 5 sec
62%, time left: 4 sec
68%, time left: 4 sec
75%, time left: 3 sec
81%, time left: 2 sec
87%, time left: 1 sec
93%, time left: 0 sec
                         : Elapsed time for training with 4000 events: 13.6 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Multiclass evaluation of BDTG on training sample
0%, time left: unknown
6%, time left: 3 sec
12%, time left: 3 sec
18%, time left: 3 sec
25%, time left: 2 sec
31%, time left: 2 sec
37%, time left: 2 sec
43%, time left: 2 sec
50%, time left: 1 sec
56%, time left: 1 sec
62%, time left: 1 sec
68%, time left: 1 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 3.53 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_BDTG.weights.xml[NON-XML-CHAR-0x1B][0m
                         : Creating standalone class: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_BDTG.class.C[NON-XML-CHAR-0x1B][0m
                         : TMVAMulticlass.root:/dataset/Method_BDT/BDTG
Factory                  : Training finished
                         : 
Factory                  : Train method: MLP for Multiclass classification
                         : 
                         : Training Network
                         : 
0%, time left: unknown
6%, time left: 44 sec
12%, time left: 41 sec
18%, time left: 38 sec
25%, time left: 35 sec
31%, time left: 32 sec
37%, time left: 29 sec
43%, time left: 26 sec
50%, time left: 23 sec
56%, time left: 20 sec
62%, time left: 17 sec
68%, time left: 14 sec
75%, time left: 11 sec
81%, time left: 8 sec
87%, time left: 5 sec
93%, time left: 2 sec
                         : Elapsed time for training with 4000 events: 47.1 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Multiclass evaluation of MLP on training sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.0518 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_MLP.weights.xml[NON-XML-CHAR-0x1B][0m
                         : Creating standalone class: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_MLP.class.C[NON-XML-CHAR-0x1B][0m
                         : Write special histos to file: TMVAMulticlass.root:/dataset/Method_MLP/MLP
Factory                  : Training finished
                         : 
Factory                  : Train method: PDEFoam for Multiclass classification
                         : 
                         : Build up multiclass foam 0
0%, time left: unknown
7%, time left: 7 sec
12%, time left: 9 sec
                         : Elapsed time: 1.64 sec                                 
                         : Build up multiclass foam 1
0%, time left: unknown
7%, time left: 8 sec
12%, time left: 8 sec
                         : Elapsed time: 1.77 sec                                 
                         : Build up multiclass foam 2
0%, time left: unknown
7%, time left: 8 sec
12%, time left: 8 sec
                         : Elapsed time: 1.78 sec                                 
                         : Build up multiclass foam 3
0%, time left: unknown
7%, time left: 7 sec
                         : Elapsed time: 1.22 sec                                 
                         : Elapsed time for training with 4000 events: 6.84 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Multiclass evaluation of PDEFoam on training sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.319 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_PDEFoam.weights.xml[NON-XML-CHAR-0x1B][0m
                         : writing foam MultiClassFoam0 to file
                         : writing foam MultiClassFoam1 to file
                         : writing foam MultiClassFoam2 to file
                         : writing foam MultiClassFoam3 to file
                         : Foams written to file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_PDEFoam.weights_foams.root[NON-XML-CHAR-0x1B][0m
                         : Creating standalone class: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_PDEFoam.class.C[NON-XML-CHAR-0x1B][0m
Factory                  : Training finished
                         : 
Factory                  : Train method: DL_CPU for Multiclass classification
                         : 
TFHandler_DL_CPU         : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:    0.13599    0.28227   [    -1.0000     1.0000 ]
                         :     var2:   0.072683    0.27964   [    -1.0000     1.0000 ]
                         :     var3:  -0.089671    0.27335   [    -1.0000     1.0000 ]
                         :     var4:   0.036363    0.27565   [    -1.0000     1.0000 ]
                         : -----------------------------------------------------------
                         : Start of deep neural network training on CPU using MT,  nthreads = 1
                         : 
TFHandler_DL_CPU         : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:    0.13599    0.28227   [    -1.0000     1.0000 ]
                         :     var2:   0.072683    0.27964   [    -1.0000     1.0000 ]
                         :     var3:  -0.089671    0.27335   [    -1.0000     1.0000 ]
                         :     var4:   0.036363    0.27565   [    -1.0000     1.0000 ]
                         : -----------------------------------------------------------
                         : *****   Deep Learning Network *****
DEEP NEURAL NETWORK:   Depth = 4  Input = ( 1, 1, 4 )  Batch size = 100  Loss function = C
	Layer 0	 DENSE Layer: 	 ( Input =     4 , Width =   100 ) 	Output = (  1 ,   100 ,   100 ) 	 Activation Function = Tanh
	Layer 1	 DENSE Layer: 	 ( Input =   100 , Width =    50 ) 	Output = (  1 ,   100 ,    50 ) 	 Activation Function = Tanh
	Layer 2	 DENSE Layer: 	 ( Input =    50 , Width =    10 ) 	Output = (  1 ,   100 ,    10 ) 	 Activation Function = Tanh
	Layer 3	 DENSE Layer: 	 ( Input =    10 , Width =     4 ) 	Output = (  1 ,   100 ,     4 ) 	 Activation Function = Identity
                         : Using 3200 events for training and 800 for testing
                         : Compute initial loss  on the validation data 
                         : Training phase 1 of 1:  Optimizer ADAM Learning rate = 0.001 regularization 0 minimum error = 0.69339
                         : --------------------------------------------------------------
                         :      Epoch |   Train Err.   Val. Err.  t(s)/epoch   t(s)/Loss   nEvents/s Conv. Steps
                         : --------------------------------------------------------------
                         :    Start epoch iteration ...
                         :          1 Minimum Test error found - save the configuration 
                         :          1 |     0.590396    0.528747    0.047424    0.004731     74953.7           0
                         :          2 Minimum Test error found - save the configuration 
                         :          2 |     0.500172    0.486214    0.047799    0.006183     76893.5           0
                         :          3 Minimum Test error found - save the configuration 
                         :          3 |     0.461721    0.456739    0.049681    0.005151     71861.7           0
                         :          4 Minimum Test error found - save the configuration 
                         :          4 |     0.435019    0.435602    0.054002    0.004707     64915.3           0
                         :          5 Minimum Test error found - save the configuration 
                         :          5 |     0.415021    0.417757    0.042229    0.004721     85315.1           0
                         :          6 Minimum Test error found - save the configuration 
                         :          6 |     0.399315    0.404079    0.046999    0.004658     75576.9           0
                         :          7 Minimum Test error found - save the configuration 
                         :          7 |     0.386241    0.393226    0.047186    0.004723     75359.7           0
                         :          8 Minimum Test error found - save the configuration 
                         :          8 |     0.375015    0.384858     0.04895    0.004709     72331.1           0
                         :          9 Minimum Test error found - save the configuration 
                         :          9 |     0.366042    0.378253    0.049581     0.00467       71252           0
                         :         10 Minimum Test error found - save the configuration 
                         :         10 |      0.35868    0.372578    0.046889    0.004753     75944.6           0
                         :         11 Minimum Test error found - save the configuration 
                         :         11 |      0.35211    0.367987    0.047379    0.004648     74887.1           0
                         :         12 Minimum Test error found - save the configuration 
                         :         12 |     0.345469    0.363106    0.046644    0.004653     76206.8           0
                         :         13 Minimum Test error found - save the configuration 
                         :         13 |     0.339747    0.357905    0.046515    0.004687     76503.8           0
                         :         14 Minimum Test error found - save the configuration 
                         :         14 |     0.334732    0.354531    0.046569    0.004643       76325           0
                         :         15 Minimum Test error found - save the configuration 
                         :         15 |     0.330666    0.349292    0.046638    0.004748     76390.5           0
                         :         16 Minimum Test error found - save the configuration 
                         :         16 |     0.325204    0.344188    0.047061    0.004721     75578.6           0
                         :         17 Minimum Test error found - save the configuration 
                         :         17 |     0.320425    0.340131    0.046769    0.004685     76038.4           0
                         :         18 Minimum Test error found - save the configuration 
                         :         18 |     0.315331    0.336483    0.047066    0.004677     75491.3           0
                         :         19 Minimum Test error found - save the configuration 
                         :         19 |     0.310842    0.331038    0.047231    0.004725     75283.5           0
                         :         20 Minimum Test error found - save the configuration 
                         :         20 |     0.307166    0.327518    0.046763    0.004698     76072.7           0
                         :         21 Minimum Test error found - save the configuration 
                         :         21 |     0.303155    0.324582    0.046854    0.004673     75863.5           0
                         :         22 Minimum Test error found - save the configuration 
                         :         22 |     0.297452    0.318928    0.046489    0.004676     76531.2           0
                         :         23 Minimum Test error found - save the configuration 
                         :         23 |     0.293821    0.313344    0.047271    0.004795     75336.7           0
                         :         24 Minimum Test error found - save the configuration 
                         :         24 |     0.288769    0.308208    0.050986    0.004611     69002.7           0
                         :         25 Minimum Test error found - save the configuration 
                         :         25 |     0.285288    0.303162    0.041002    0.004613     87938.7           0
                         :         26 Minimum Test error found - save the configuration 
                         :         26 |      0.28027    0.299714    0.046362    0.004517     76472.7           0
                         :         27 Minimum Test error found - save the configuration 
                         :         27 |     0.277087    0.297443    0.047251    0.004414     74701.8           0
                         :         28 Minimum Test error found - save the configuration 
                         :         28 |     0.273977    0.295578    0.044338    0.004411     80146.3           0
                         :         29 Minimum Test error found - save the configuration 
                         :         29 |     0.270626    0.294637    0.047525    0.004529     74425.5           0
                         :         30 Minimum Test error found - save the configuration 
                         :         30 |     0.267945    0.289816    0.046681     0.00457     75989.6           0
                         :         31 |     0.266508    0.290872    0.050945    0.004186       68436           1
                         :         32 Minimum Test error found - save the configuration 
                         :         32 |     0.264059    0.288325    0.043164    0.004818     83450.7           0
                         :         33 Minimum Test error found - save the configuration 
                         :         33 |     0.262395     0.28621    0.046778    0.004756     76150.6           0
                         :         34 Minimum Test error found - save the configuration 
                         :         34 |     0.259577    0.283559    0.046729    0.004777     76277.7           0
                         :         35 |     0.257952    0.285009    0.048408    0.004448     72793.4           1
                         :         36 Minimum Test error found - save the configuration 
                         :         36 |     0.256546    0.282011    0.046344    0.004744     76923.1           0
                         :         37 Minimum Test error found - save the configuration 
                         :         37 |     0.255969    0.281019    0.046752    0.004745     76177.8           0
                         :         38 Minimum Test error found - save the configuration 
                         :         38 |     0.254233    0.280245    0.046513    0.004739     76602.7           0
                         :         39 |     0.254335    0.284391     0.04654    0.004425     75982.4           1
                         :         40 |     0.253472    0.281379    0.046748    0.004477       75702           2
                         :         41 Minimum Test error found - save the configuration 
                         :         41 |     0.250689    0.277702     0.04672    0.004763     76268.6           0
                         :         42 |     0.249915    0.278419    0.051044     0.00447     68707.9           1
                         :         43 Minimum Test error found - save the configuration 
                         :         43 |     0.249718    0.275943    0.046774    0.004698     76052.9           0
                         :         44 Minimum Test error found - save the configuration 
                         :         44 |     0.247125    0.275192    0.047127    0.004744       75502           0
                         :         45 Minimum Test error found - save the configuration 
                         :         45 |     0.246499    0.274769    0.047275    0.004732       75218           0
                         :         46 |     0.245541    0.279139     0.04226    0.003483     82523.1           1
                         :         47 Minimum Test error found - save the configuration 
                         :         47 |     0.246448    0.273985    0.047097    0.004711     75496.6           0
                         :         48 Minimum Test error found - save the configuration 
                         :         48 |     0.243515    0.269678    0.047692    0.004728       74481           0
                         :         49 Minimum Test error found - save the configuration 
                         :         49 |      0.24256    0.269134    0.051795    0.004723       67981           0
                         :         50 |     0.240133    0.269636    0.046634     0.00446     75876.1           1
                         :         51 |     0.240585    0.269327    0.046773     0.00445       75609           2
                         :         52 Minimum Test error found - save the configuration 
                         :         52 |     0.238976    0.266736    0.046786     0.00469     76016.7           0
                         :         53 Minimum Test error found - save the configuration 
                         :         53 |     0.237274      0.2657     0.04667    0.004743     76323.1           0
                         :         54 Minimum Test error found - save the configuration 
                         :         54 |     0.236921    0.265655    0.047498    0.004724     74811.8           0
                         :         55 |     0.237772    0.267058    0.046887    0.004503     75500.2           1
                         :         56 |     0.235827    0.268197    0.046436    0.004439     76195.9           2
                         :         57 Minimum Test error found - save the configuration 
                         :         57 |     0.235578    0.265546    0.046872    0.004678     75840.2           0
                         :         58 Minimum Test error found - save the configuration 
                         :         58 |     0.235347    0.265316    0.046739    0.004674     76072.7           0
                         :         59 Minimum Test error found - save the configuration 
                         :         59 |     0.232578    0.264551    0.062644    0.004682     55208.6           0
                         :         60 Minimum Test error found - save the configuration 
                         :         60 |     0.235107    0.261851    0.047269    0.004934     75587.6           0
                         :         61 Minimum Test error found - save the configuration 
                         :         61 |      0.23171     0.26183    0.047783     0.00474     74344.3           0
                         :         62 |     0.230104    0.262063    0.044463    0.005624     82391.4           1
                         :         63 |     0.229405    0.264284    0.044209    0.004192       79966           2
                         :         64 Minimum Test error found - save the configuration 
                         :         64 |     0.229717    0.259505    0.043998    0.004454     80922.5           0
                         :         65 |      0.22919    0.260709    0.050325     0.00427     69482.1           1
                         :         66 Minimum Test error found - save the configuration 
                         :         66 |     0.228429    0.258059    0.044251    0.004505     80511.2           0
                         :         67 |     0.227472    0.258506    0.045542    0.005266     79451.8           1
                         :         68 |      0.22715    0.261026    0.044325    0.004208     79766.7           2
                         :         69 |     0.225984     0.25825    0.044239    0.004303     80128.2           3
                         :         70 Minimum Test error found - save the configuration 
                         :         70 |     0.225402    0.258016    0.044459    0.004562     80206.5           0
                         :         71 Minimum Test error found - save the configuration 
                         :         71 |     0.224752    0.257514     0.04678    0.004664     75980.6           0
                         :         72 |     0.224164    0.259212     0.04667    0.004438     75771.9           1
                         :         73 Minimum Test error found - save the configuration 
                         :         73 |     0.224948    0.257198    0.049682    0.004741     71204.5           0
                         :         74 |     0.222918    0.258232    0.048166    0.004472     73236.6           1
                         :         75 Minimum Test error found - save the configuration 
                         :         75 |     0.222917    0.255908    0.047156     0.00477     75496.6           0
                         :         76 Minimum Test error found - save the configuration 
                         :         76 |     0.222166     0.25571    0.046431    0.004705     76690.8           0
                         :         77 |     0.221946     0.26183    0.047285     0.00451     74810.1           1
                         :         78 Minimum Test error found - save the configuration 
                         :         78 |     0.221079    0.254217     0.04867    0.004669     72725.6           0
                         :         79 |     0.220187    0.254688    0.057793    0.004543     60093.9           1
                         :         80 |     0.220742    0.256124    0.061305    0.004468     56301.4           2
                         :         81 |     0.219774    0.254634    0.047638    0.004626     74397.8           3
                         :         82 Minimum Test error found - save the configuration 
                         :         82 |     0.219344    0.253674    0.061362    0.004808     56583.1           0
                         :         83 Minimum Test error found - save the configuration 
                         :         83 |      0.21905    0.252797    0.051193    0.006034     70860.7           0
                         :         84 |     0.218391    0.253081    0.047911    0.004431     73597.1           1
                         :         85 |     0.217758    0.253554    0.048556    0.004922     73337.3           2
                         :         86 Minimum Test error found - save the configuration 
                         :         86 |     0.217309    0.252152    0.049468    0.004801     71641.3           0
                         :         87 |     0.216876    0.252336    0.046308    0.004813     77117.7           1
                         :         88 Minimum Test error found - save the configuration 
                         :         88 |     0.215381    0.251687    0.047178    0.004683       75303           0
                         :         89 |     0.214973      0.2519    0.046854    0.004499     75551.9           1
                         :         90 |     0.214303    0.254131    0.046768    0.004466     75646.5           2
                         :         91 Minimum Test error found - save the configuration 
                         :         91 |     0.214171    0.250741    0.046205    0.004679     77060.2           0
                         :         92 |      0.21429    0.254429    0.047111    0.004493     75085.6           1
                         :         93 |     0.213151    0.251051    0.048435    0.004804     73342.3           2
                         :         94 Minimum Test error found - save the configuration 
                         :         94 |     0.212632    0.250728    0.061662    0.004739     56216.3           0
                         :         95 |     0.212831    0.253973     0.04613    0.004403       76689           1
                         :         96 |     0.211822    0.250801    0.046136    0.004494     76845.5           2
                         :         97 |     0.212606     0.25161    0.047056    0.004523     75235.7           3
                         :         98 Minimum Test error found - save the configuration 
                         :         98 |     0.211424    0.248999    0.057356    0.007512     64200.3           0
                         :         99 |     0.211106    0.250062    0.047167     0.00454     75069.8           1
                         :        100 Minimum Test error found - save the configuration 
                         :        100 |     0.210941    0.248516    0.047699     0.00472       74455           0
                         :        101 |     0.209651    0.252727    0.046593    0.004439     75912.1           1
                         :        102 |     0.209402    0.253667    0.047696    0.004516     74108.4           2
                         :        103 |     0.208924    0.248723     0.04828    0.005806     75340.2           3
                         :        104 |     0.209338    0.252685    0.046563    0.004426     75942.8           4
                         :        105 |     0.209449    0.250707    0.046735    0.004489     75746.8           5
                         :        106 |     0.208103    0.249135    0.046443    0.004421     76150.6           6
                         :        107 |     0.208405    0.249833    0.045369    0.004384     78077.3           7
                         :        108 |     0.207499    0.249022      0.0457    0.004489     77649.2           8
                         :        109 Minimum Test error found - save the configuration 
                         :        109 |      0.20659    0.247799    0.049312     0.00467     71681.4           0
                         :        110 |     0.206728    0.249029    0.047743    0.004488     73979.9           1
                         :        111 |      0.20592    0.250194    0.046459    0.004457     76186.8           2
                         :        112 Minimum Test error found - save the configuration 
                         :        112 |     0.207121    0.247235    0.047395    0.004787     75103.3           0
                         :        113 |     0.204579    0.247461    0.046387    0.004439     76284.9           1
                         :        114 |     0.204522    0.253451    0.046515    0.004413     76005.9           2
                         :        115 |     0.204726    0.247577    0.046716    0.004518       75833           3
                         :        116 |     0.204005    0.248516    0.047001     0.00399     74399.6           4
                         :        117 |     0.204919    0.248712    0.047075    0.004479     75124.4           5
                         :        118 |     0.204184     0.25152    0.047184    0.004473     74922.2           6
                         :        119 |     0.205446    0.250499    0.046216    0.003087       74196           7
                         :        120 |     0.202267     0.25012    0.041688    0.004878     86932.9           8
                         :        121 Minimum Test error found - save the configuration 
                         :        121 |     0.201969    0.246907    0.044058    0.004677     81257.5           0
                         :        122 |     0.202233    0.247366    0.044659    0.004225     79141.3           1
                         :        123 |     0.201378    0.248948    0.044131    0.004226     80190.5           2
                         :        124 |     0.201271    0.249798    0.044244    0.004231       79974           3
                         :        125 |     0.200939    0.250953    0.044232    0.004248       80032           4
                         :        126 |     0.202131    0.249851    0.042101    0.004244     84528.6           5
                         :        127 Minimum Test error found - save the configuration 
                         :        127 |     0.199513    0.246329    0.045993     0.00541     78850.8           0
                         :        128 |     0.199906    0.249066    0.044525    0.004199     79353.3           1
                         :        129 |     0.198592    0.247411    0.045978    0.004459     77073.1           2
                         :        130 |     0.200419    0.247219     0.04679    0.004707     76040.2           3
                         :        131 |     0.198656    0.251286    0.046865    0.004478     75494.8           4
                         :        132 |     0.199273    0.249493    0.046772    0.004472     75650.1           5
                         :        133 Minimum Test error found - save the configuration 
                         :        133 |     0.198566    0.245972    0.046771     0.00466     75989.6           0
                         :        134 |     0.198349    0.247338    0.047042    0.004552     75311.8           1
                         :        135 |     0.198732    0.246035    0.046749    0.004427     75610.8           2
                         :        136 |     0.198803     0.24689    0.043839    0.002598     77592.7           3
                         :        137 |     0.197435    0.246595    0.042333    0.004618     84846.9           4
                         :        138 |     0.198178    0.247642    0.045826    0.003542     75678.7           5
                         :        139 |     0.196993    0.251924    0.044047    0.003474     78870.2           6
                         :        140 |     0.196274    0.246014    0.047289    0.004471     74734.9           7
                         :        141 Minimum Test error found - save the configuration 
                         :        141 |     0.196153    0.245205    0.046829    0.004696       75950           0
                         :        142 |     0.195915    0.247692    0.051173    0.004406     68424.3           1
                         :        143 |     0.195688    0.248793    0.049942    0.004456     70351.3           2
                         :        144 |     0.196598    0.246707    0.051338    0.004738     68669.5           3
                         :        145 Minimum Test error found - save the configuration 
                         :        145 |     0.195874    0.243708    0.044008     0.00463     81263.6           0
                         :        146 |     0.195289    0.245258    0.048295    0.004796     73564.9           1
                         :        147 |     0.195507    0.247108    0.054313    0.004455     64182.3           2
                         :        148 |     0.195182    0.249983    0.039557    0.004229     90579.7           3
                         :        149 |     0.195441    0.248802     0.04664    0.004465     75874.3           4
                         :        150 |     0.193971     0.24601    0.046198    0.004407     76571.5           5
                         :        151 |     0.193234    0.247371    0.046167    0.004421     76654.1           6
                         :        152 |      0.19478    0.244813     0.04614    0.004409     76681.6           7
                         :        153 |     0.194109    0.246421    0.045553    0.004467     77885.4           8
                         :        154 |     0.194289    0.245915     0.04944    0.004426       71089           9
                         :        155 |     0.192783    0.247376     0.04678     0.00452     75721.7          10
                         :        156 |     0.192761    0.246168    0.046985    0.004483     75290.6          11
                         : 
                         : Elapsed time for training with 4000 events: 7.44 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Multiclass evaluation of DL_CPU on training sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.16 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_DL_CPU.weights.xml[NON-XML-CHAR-0x1B][0m
                         : Creating standalone class: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_DL_CPU.class.C[NON-XML-CHAR-0x1B][0m
Factory                  : Training finished
                         : 
                         : Ranking input variables (method specific)...
BDTG                     : Ranking result (top variable is best ranked)
                         : --------------------------------------
                         : Rank : Variable  : Variable Importance
                         : --------------------------------------
                         :    1 : var4      : 3.064e-01
                         :    2 : var1      : 2.536e-01
                         :    3 : var2      : 2.445e-01
                         :    4 : var3      : 1.955e-01
                         : --------------------------------------
MLP                      : Ranking result (top variable is best ranked)
                         : -----------------------------
                         : Rank : Variable  : Importance
                         : -----------------------------
                         :    1 : var4      : 4.629e+01
                         :    2 : var1      : 3.016e+01
                         :    3 : var2      : 1.063e+01
                         :    4 : var3      : 9.260e+00
                         : -----------------------------
PDEFoam                  : Ranking result (top variable is best ranked)
                         : --------------------------------------
                         : Rank : Variable  : Variable Importance
                         : --------------------------------------
                         :    1 : var4      : 2.742e-01
                         :    2 : var1      : 2.693e-01
                         :    3 : var2      : 2.394e-01
                         :    4 : var3      : 2.171e-01
                         : --------------------------------------
                         : No variable ranking supplied by classifier: DL_CPU
TH1.Print Name  = TrainingHistory_DL_CPU_trainingError, Entries= 0, Total sum= 37.8683
TH1.Print Name  = TrainingHistory_DL_CPU_valError, Entries= 0, Total sum= 43.1449
Factory                  : === Destroy and recreate all methods via weight files for testing ===
                         : 
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_BDTG.weights.xml[NON-XML-CHAR-0x1B][0m
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_MLP.weights.xml[NON-XML-CHAR-0x1B][0m
MLP                      : Building Network. 
                         : Initializing weights
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_PDEFoam.weights.xml[NON-XML-CHAR-0x1B][0m
                         : Read foams from file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_PDEFoam.weights_foams.root[NON-XML-CHAR-0x1B][0m
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVAMulticlass_DL_CPU.weights.xml[NON-XML-CHAR-0x1B][0m
Factory                  : [NON-XML-CHAR-0x1B][1mTest all methods[NON-XML-CHAR-0x1B][0m
Factory                  : Test method: BDTG for Multiclass classification performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Multiclass evaluation of BDTG on testing sample
0%, time left: unknown
6%, time left: 2 sec
12%, time left: 2 sec
18%, time left: 2 sec
25%, time left: 1 sec
31%, time left: 1 sec
37%, time left: 1 sec
43%, time left: 1 sec
50%, time left: 1 sec
56%, time left: 1 sec
62%, time left: 1 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 2.81 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
Factory                  : Test method: MLP for Multiclass classification performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Multiclass evaluation of MLP on testing sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.0501 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
Factory                  : Test method: PDEFoam for Multiclass classification performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Multiclass evaluation of PDEFoam on testing sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.322 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
Factory                  : Test method: DL_CPU for Multiclass classification performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Multiclass evaluation of DL_CPU on testing sample
0%, time left: unknown
6%, time left: 0 sec
12%, time left: 0 sec
18%, time left: 0 sec
25%, time left: 0 sec
31%, time left: 0 sec
37%, time left: 0 sec
43%, time left: 0 sec
50%, time left: 0 sec
56%, time left: 0 sec
62%, time left: 0 sec
68%, time left: 0 sec
75%, time left: 0 sec
81%, time left: 0 sec
87%, time left: 0 sec
93%, time left: 0 sec
                         : Dataset[dataset] : Elapsed time for evaluation of 4000 events: 0.145 sec       
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
Factory                  : [NON-XML-CHAR-0x1B][1mEvaluate all methods[NON-XML-CHAR-0x1B][0m
                         : Evaluate multiclass classification method: BDTG
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
TFHandler_BDTG           : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.064729     1.0033   [    -3.5287     3.5808 ]
                         :     var2:    0.30913     1.0653   [    -3.6952     3.7877 ]
                         :     var3:    0.13661     1.1250   [    -4.5727     4.5640 ]
                         :     var4:  -0.073582     1.2723   [    -4.8486     5.0412 ]
                         : -----------------------------------------------------------
                         : Evaluate multiclass classification method: MLP
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
TFHandler_MLP            : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.064729     1.0033   [    -3.5287     3.5808 ]
                         :     var2:    0.30913     1.0653   [    -3.6952     3.7877 ]
                         :     var3:    0.13661     1.1250   [    -4.5727     4.5640 ]
                         :     var4:  -0.073582     1.2723   [    -4.8486     5.0412 ]
                         : -----------------------------------------------------------
                         : Evaluate multiclass classification method: PDEFoam
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
TFHandler_PDEFoam        : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:   0.064729     1.0033   [    -3.5287     3.5808 ]
                         :     var2:    0.30913     1.0653   [    -3.6952     3.7877 ]
                         :     var3:    0.13661     1.1250   [    -4.5727     4.5640 ]
                         :     var4:  -0.073582     1.2723   [    -4.8486     5.0412 ]
                         : -----------------------------------------------------------
                         : Evaluate multiclass classification method: DL_CPU
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
                         : Creating multiclass response histograms...
                         : Creating multiclass performance histograms...
TFHandler_DL_CPU         : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:    0.13921    0.27715   [   -0.85348     1.1105 ]
                         :     var2:   0.069492    0.28497   [    -1.0016     1.0000 ]
                         :     var3:  -0.080695    0.27461   [    -1.2302     1.0000 ]
                         :     var4:   0.036790    0.27626   [    -1.0000     1.1474 ]
                         : -----------------------------------------------------------
TFHandler_DL_CPU         : Variable        Mean        RMS   [        Min        Max ]
                         : -----------------------------------------------------------
                         :     var1:    0.13921    0.27715   [   -0.85348     1.1105 ]
                         :     var2:   0.069492    0.28497   [    -1.0016     1.0000 ]
                         :     var3:  -0.080695    0.27461   [    -1.2302     1.0000 ]
                         :     var4:   0.036790    0.27626   [    -1.0000     1.1474 ]
                         : -----------------------------------------------------------
                         : 
                         : 1-vs-rest performance metrics per class
                         : -------------------------------------------------------------------------------------------------------
                         : 
                         : Considers the listed class as signal and the other classes
                         : as background, reporting the resulting binary performance.
                         : A score of 0.820 (0.850) means 0.820 was acheived on the
                         : test set and 0.850 on the training set.
                         : 
                         : Dataset        MVA Method     ROC AUC        Sig eff@B=0.01 Sig eff@B=0.10 Sig eff@B=0.30 
                         : Name:          / Class:       test  (train)  test  (train)  test  (train)  test  (train)  
                         : 
                         : dataset        BDTG           
                         : ------------------------------
                         :                Signal         0.966 (0.981)  0.486 (0.659)  0.910 (0.955)  0.994 (0.996)  
                         :                bg0            0.905 (0.932)  0.252 (0.325)  0.716 (0.801)  0.908 (0.955)  
                         :                bg1            0.951 (0.955)  0.463 (0.465)  0.850 (0.845)  0.970 (0.979)  
                         :                bg2            0.977 (0.984)  0.598 (0.709)  0.945 (0.971)  0.996 (0.998)  
                         : 
                         : dataset        MLP            
                         : ------------------------------
                         :                Signal         0.975 (0.980)  0.607 (0.674)  0.930 (0.955)  0.996 (0.997)  
                         :                bg0            0.931 (0.940)  0.336 (0.332)  0.778 (0.806)  0.955 (0.967)  
                         :                bg1            0.968 (0.966)  0.523 (0.513)  0.909 (0.897)  0.992 (0.983)  
                         :                bg2            0.982 (0.987)  0.678 (0.732)  0.959 (0.975)  0.997 (1.000)  
                         : 
                         : dataset        PDEFoam        
                         : ------------------------------
                         :                Signal         0.907 (0.926)  0.236 (0.304)  0.700 (0.762)  0.943 (0.943)  
                         :                bg0            0.830 (0.851)  0.139 (0.109)  0.540 (0.587)  0.817 (0.841)  
                         :                bg1            0.896 (0.899)  0.291 (0.295)  0.660 (0.671)  0.910 (0.907)  
                         :                bg2            0.964 (0.971)  0.379 (0.451)  0.892 (0.912)  0.999 (1.000)  
                         : 
                         : dataset        DL_CPU         
                         : ------------------------------
                         :                Signal         0.972 (0.978)  0.605 (0.656)  0.936 (0.945)  0.986 (0.996)  
                         :                bg0            0.922 (0.937)  0.292 (0.337)  0.767 (0.794)  0.944 (0.956)  
                         :                bg1            0.964 (0.963)  0.516 (0.521)  0.890 (0.889)  0.985 (0.978)  
                         :                bg2            0.977 (0.982)  0.656 (0.710)  0.929 (0.947)  0.999 (0.999)  
                         : 
                         : -------------------------------------------------------------------------------------------------------
                         : 
                         : 
                         : Confusion matrices for all methods
                         : -------------------------------------------...
The rest of the test output was removed since it exceeds the threshold of 64000 bytes.