Execution Time10.90s

Test: TMVA-DNN-Regression-Cpu (Passed)
Build: PR-4857-x86_64-centos7-gcc48-opt (olhswep22.cern.ch) on 2020-01-24 14:35:31

Test Timing: Passed
Processors1

Show Command Line
Display graphs:

Test output
create data set info dataset
DataSetInfo              : [dataset] : Added class "Regression"
                         : Add Tree  of type Regression with 50000 events
                         : Dataset[dataset] : Class index : 0  name : Regression
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mDL_MultiRegCPU[NON-XML-CHAR-0x1B][0m
                         : 
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=SUMOFSQUARES:WeightInitialization=XAVIERUNIFORM:InputLayout=1|1|2:BatchLayout=128|1|2:Layout=RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0:Architecture=CPU"
                         : The following options are set:
                         : - By User:
                         :     <none>
                         : - Default:
                         :     Boost_num: "0" [Number of times the classifier will be boosted]
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=SUMOFSQUARES:WeightInitialization=XAVIERUNIFORM:InputLayout=1|1|2:BatchLayout=128|1|2:Layout=RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0:Architecture=CPU"
                         : The following options are set:
                         : - By User:
                         :     V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
                         :     H: "False" [Print method-specific help message]
                         :     InputLayout: "1|1|2" [The Layout of the input]
                         :     BatchLayout: "128|1|2" [The Layout of the batch]
                         :     Layout: "RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR" [Layout of the network.]
                         :     ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
                         :     WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
                         :     Architecture: "CPU" [Which architecture to perform the training on.]
                         :     TrainingStrategy: "LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0" [Defines the training strategies.]
                         : - Default:
                         :     VerbosityLevel: "Default" [Verbosity level]
                         :     VarTransform: "None" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
                         :     CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
                         :     IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
                         :     RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
                         :     ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
                         : Will now use the CPU architecture !
Factory                  : [NON-XML-CHAR-0x1B][1mTrain all methods[NON-XML-CHAR-0x1B][0m
                         : Building event vectors for type 2 Regression
                         : Dataset[dataset] :  create input formulas for tree 
DataSetFactory           : [dataset] : Number of events in input trees
                         : 
                         : Number of training and testing events
                         : ---------------------------------------------------------------------------
                         : Regression -- training events            : 40000
                         : Regression -- testing events             : 10000
                         : Regression -- training and testing events: 50000
                         : 
DataSetInfo              : Correlation matrix (Regression):
                         : ---------------------------
                         :           uniform1 uniform2
                         : uniform1:   +1.000   +0.011
                         : uniform2:   +0.011   +1.000
                         : ---------------------------
DataSetFactory           : [dataset] :  
                         : 
Factory                  : [dataset] : Create Transformation "I" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'uniform1' <---> Output : variable 'uniform1'
                         : Input : variable 'uniform2' <---> Output : variable 'uniform2'
TFHandler_Factory        :    Variable           Mean           RMS   [        Min           Max ]
                         : --------------------------------------------------------------------------
                         :    uniform1:      0.49917      0.28960   [   1.4620e-05      0.99998 ]
                         :    uniform2:      0.50047      0.28796   [   4.3085e-05       1.0000 ]
                         : uniform_add:      0.99964      0.41055   [    0.0045895       1.9946 ]
                         : uniform_sub:   -0.0012975      0.40624   [     -0.99825      0.99686 ]
                         : --------------------------------------------------------------------------
                         : Ranking input variables (method unspecific)...
Factory                  : Train method: DL_MultiRegCPU for Regression
                         : 
                         : Start of deep neural network training on CPU using (for ROOT-IMT) nthreads = 1
                         : 
                         : *****   Deep Learning Network *****
DEEP NEURAL NETWORK:   Depth = 3  Input = ( 1, 1, 2 )  Batch size = 128  Loss function = R
	Layer 0	 RESHAPE Layer 	 Input = ( 1 , 1 , 2 ) 	Output = ( 1 , 128 , 2 ) 
	Layer 1	 DENSE Layer: 	 ( Input =     2 , Width =     2 ) 	Output = (  1 ,   128 ,     2 ) 	 Activation Function = Sigmoid
	Layer 2	 DENSE Layer: 	 ( Input =     2 , Width =     2 ) 	Output = (  1 ,   128 ,     2 ) 	 Activation Function = Identity
                         : Using 32000 events for training and 8000 for testing
                         : Compute initial loss  on the validation data 
                         : Training phase 1 of 1:  Optimizer ADAM Learning rate = 0.001 regularization 0 minimum error = 1.63438
                         : --------------------------------------------------------------
                         :      Epoch |   Train Err.   Val. Err.  t(s)/epoch   t(s)/Loss   nEvents/s Conv. Steps
                         : --------------------------------------------------------------
                         :    Start epoch iteration ...
                         :         10 Minimum Test error found - save the configuration 
                         :         10 |     0.225236    0.217434   0.0852405  0.00434607      377332           0
                         :         20 Minimum Test error found - save the configuration 
                         :         20 |     0.133613    0.132539   0.0501052  0.00438114      644290           0
                         :         30 Minimum Test error found - save the configuration 
                         :         30 |     0.101611   0.0998318   0.0358546  0.00432972      903402           0
                         :         40 Minimum Test error found - save the configuration 
                         :         40 |    0.0638533   0.0616687   0.0508953    0.016883      650314           0
                         :         50 Minimum Test error found - save the configuration 
                         :         50 |    0.0206317   0.0187875   0.0569921   0.0166072      578334           0
                         :         60 Minimum Test error found - save the configuration 
                         :         60 |    0.0015023  0.00130804   0.0586121  0.00417241      549877           0
                         :         70 Minimum Test error found - save the configuration 
                         :         70 |  0.000364089 0.000346624    0.057649   0.0053227      560257           0
                         :         80 Minimum Test error found - save the configuration 
                         :         80 |  0.000225054 0.000219896   0.0386105  0.00758661      845401           0
                         :         90 Minimum Test error found - save the configuration 
                         :         90 |  0.000196847 0.000193622   0.0578343  0.00394827      557108           0
                         :        100 Minimum Test error found - save the configuration 
                         :        100 |  0.000173564 0.000169812   0.0608673   0.0162106      540118           0
                         : 
                         : Elapsed time for training with 40000 events: 5.58 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Evaluation of DL_MultiRegCPU on training sample
                         : Dataset[dataset] : Elapsed time for evaluation of 40000 events: 0.48 sec       
                         : Create variable histograms
                         : Create regression target histograms
                         : Create regression average deviation
                         : Results created
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVARegression_DL_MultiRegCPU.weights.xml[NON-XML-CHAR-0x1B][0m
Factory                  : Training finished
                         : 
TH1.Print Name  = TrainingHistory_DL_MultiRegCPU_trainingError, Entries= 0, Total sum= 0.547407
TH1.Print Name  = TrainingHistory_DL_MultiRegCPU_valError, Entries= 0, Total sum= 0.5325
Factory                  : === Destroy and recreate all methods via weight files for testing ===
                         : 
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVARegression_DL_MultiRegCPU.weights.xml[NON-XML-CHAR-0x1B][0m
Factory                  : [NON-XML-CHAR-0x1B][1mTest all methods[NON-XML-CHAR-0x1B][0m
Factory                  : Test method: DL_MultiRegCPU for Regression performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Evaluation of DL_MultiRegCPU on testing sample
                         : Dataset[dataset] : Elapsed time for evaluation of 10000 events: 0.0887 sec       
                         : Create variable histograms
                         : Create regression target histograms
                         : Create regression average deviation
                         : Results created
Factory                  : [NON-XML-CHAR-0x1B][1mEvaluate all methods[NON-XML-CHAR-0x1B][0m
                         : Evaluate regression method: DL_MultiRegCPU
                         : TestRegression (testing)
                         : Calculate regression for all events
                         : Elapsed time for evaluation of 10000 events: 0.0874 sec       
                         : TestRegression (training)
                         : Calculate regression for all events
                         : Elapsed time for evaluation of 40000 events: 0.359 sec       
TFHandler_DL_MultiRegCPU :    Variable           Mean           RMS   [        Min           Max ]
                         : --------------------------------------------------------------------------
                         :    uniform1:      0.49959      0.28878   [   1.7200e-05      0.99987 ]
                         :    uniform2:      0.49348      0.28799   [   4.1931e-05      0.99975 ]
                         : uniform_add:      0.99307      0.40864   [     0.018889       1.9816 ]
                         : uniform_sub:    0.0061078      0.40704   [     -0.98505      0.98005 ]
                         : --------------------------------------------------------------------------
                         : 
                         : Evaluation results ranked by smallest RMS on test sample:
                         : ("Bias" quotes the mean deviation of the regression from true target.
                         :  "MutInf" is the "Mutual Information" between regression and target.
                         :  Indicated by "_T" are the corresponding "truncated" quantities ob-
                         :  tained when removing events deviating more than 2sigma from average.)
                         : --------------------------------------------------------------------------------------------------
                         : --------------------------------------------------------------------------------------------------
                         : dataset              DL_MultiRegCPU : 0.000820 0.000606   0.0131   0.0119  |  3.122  3.117
                         : --------------------------------------------------------------------------------------------------
                         : 
                         : Evaluation results ranked by smallest RMS on training sample:
                         : (overtraining check)
                         : --------------------------------------------------------------------------------------------------
                         : DataSet Name:         MVA Method:        <Bias>   <Bias_T>    RMS    RMS_T  |  MutInf MutInf_T
                         : --------------------------------------------------------------------------------------------------
                         : dataset              DL_MultiRegCPU : 0.000831 0.000650   0.0133   0.0119  |  3.104  3.105
                         : --------------------------------------------------------------------------------------------------
                         : 
Dataset:dataset          : Created tree 'TestTree' with 10000 events
                         : 
Dataset:dataset          : Created tree 'TrainTree' with 40000 events
                         : 
Factory                  : [NON-XML-CHAR-0x1B][1mThank you for using TMVA![NON-XML-CHAR-0x1B][0m
                         : [NON-XML-CHAR-0x1B][1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html[NON-XML-CHAR-0x1B][0m
==> Wrote root file: TMVA_DNN_MultiRegression.root
==> TMVARegression is done!
Info in <TCanvas::MakeDefCanvas>:  created default TCanvas with name c1
Info in <TCanvas::Print>: pdf file DL_MultiRegCPU.pdf has been created
< Deviation target 1> = 0.000819978 +/- 0.000131433
< Deviation target 2> = 2.28115e-05 +/- 0.000128472