Execution Time4.09s

Test: TMVA-DNN-Regression-Cpu (Passed)
Build: PR-4841-x86_64-mac1014-clang100-opt (macphsft17.dyndns.cern.ch) on 2020-01-22 22:38:32

Test Timing: Passed
Processors1

Show Command Line
Display graphs:

Test output
create data set info dataset
DataSetInfo              : [dataset] : Added class "Regression"
                         : Add Tree  of type Regression with 50000 events
                         : Dataset[dataset] : Class index : 0  name : Regression
Factory                  : Booking method: [NON-XML-CHAR-0x1B][1mDL_MultiRegCPU[NON-XML-CHAR-0x1B][0m
                         : 
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=SUMOFSQUARES:WeightInitialization=XAVIERUNIFORM:InputLayout=1|1|2:BatchLayout=128|1|2:Layout=RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0:Architecture=CPU"
                         : The following options are set:
                         : - By User:
                         :     <none>
                         : - Default:
                         :     Boost_num: "0" [Number of times the classifier will be boosted]
                         : Parsing option string: 
                         : ... "!H:V:ErrorStrategy=SUMOFSQUARES:WeightInitialization=XAVIERUNIFORM:InputLayout=1|1|2:BatchLayout=128|1|2:Layout=RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0:Architecture=CPU"
                         : The following options are set:
                         : - By User:
                         :     V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
                         :     H: "False" [Print method-specific help message]
                         :     InputLayout: "1|1|2" [The Layout of the input]
                         :     BatchLayout: "128|1|2" [The Layout of the batch]
                         :     Layout: "RESHAPE|1|1|2|FLAT,DENSE|2|SIGMOID,DENSE|2|LINEAR" [Layout of the network.]
                         :     ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
                         :     WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
                         :     Architecture: "CPU" [Which architecture to perform the training on.]
                         :     TrainingStrategy: "LearningRate=1e-3,Momentum=0.0,Repetitions=10,ConvergenceSteps=10,BatchSize=128,TestRepetitions=10,MaxEpochs=100WeightDecay=0,Regularization=None,Optimizer=ADAM,DropConfig=0.0+0.0+0.0+0.0" [Defines the training strategies.]
                         : - Default:
                         :     VerbosityLevel: "Default" [Verbosity level]
                         :     VarTransform: "None" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
                         :     CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
                         :     IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
                         :     RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
                         :     ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
                         : Will now use the CPU architecture !
Factory                  : [NON-XML-CHAR-0x1B][1mTrain all methods[NON-XML-CHAR-0x1B][0m
                         : Building event vectors for type 2 Regression
                         : Dataset[dataset] :  create input formulas for tree 
DataSetFactory           : [dataset] : Number of events in input trees
                         : 
                         : Number of training and testing events
                         : ---------------------------------------------------------------------------
                         : Regression -- training events            : 40000
                         : Regression -- testing events             : 10000
                         : Regression -- training and testing events: 50000
                         : 
DataSetInfo              : Correlation matrix (Regression):
                         : ---------------------------
                         :           uniform1 uniform2
                         : uniform1:   +1.000   +0.008
                         : uniform2:   +0.008   +1.000
                         : ---------------------------
DataSetFactory           : [dataset] :  
                         : 
Factory                  : [dataset] : Create Transformation "I" with events from all classes.
                         : 
                         : Transformation, Variable selection : 
                         : Input : variable 'uniform1' <---> Output : variable 'uniform1'
                         : Input : variable 'uniform2' <---> Output : variable 'uniform2'
TFHandler_Factory        :    Variable           Mean           RMS   [        Min           Max ]
                         : --------------------------------------------------------------------------
                         :    uniform1:      0.49811      0.28935   [   1.4620e-05      0.99992 ]
                         :    uniform2:      0.49807      0.28768   [   4.3085e-05       1.0000 ]
                         : uniform_add:      0.99618      0.40960   [    0.0045895       1.9946 ]
                         : uniform_sub:   4.1453e-05      0.40644   [     -0.99825      0.99686 ]
                         : --------------------------------------------------------------------------
                         : Ranking input variables (method unspecific)...
Factory                  : Train method: DL_MultiRegCPU for Regression
                         : 
                         : Start of deep neural network training on CPU using (for ROOT-IMT) nthreads = 1
                         : 
                         : *****   Deep Learning Network *****
DEEP NEURAL NETWORK:   Depth = 3  Input = ( 1, 1, 2 )  Batch size = 128  Loss function = R
	Layer 0	 RESHAPE Layer 	 Input = ( 1 , 1 , 2 ) 	Output = ( 1 , 128 , 2 ) 
	Layer 1	 DENSE Layer: 	 ( Input =     2 , Width =     2 ) 	Output = (  1 ,   128 ,     2 ) 	 Activation Function = Sigmoid
	Layer 2	 DENSE Layer: 	 ( Input =     2 , Width =     2 ) 	Output = (  1 ,   128 ,     2 ) 	 Activation Function = Identity
                         : Using 32000 events for training and 8000 for testing
                         : Compute initial loss  on the validation data 
                         : Training phase 1 of 1:  Optimizer ADAM Learning rate = 0.001 regularization 0 minimum error = 0.966292
                         : --------------------------------------------------------------
                         :      Epoch |   Train Err.   Val. Err.  t(s)/epoch   t(s)/Loss   nEvents/s Conv. Steps
                         : --------------------------------------------------------------
                         :    Start epoch iteration ...
                         :         10 Minimum Test error found - save the configuration 
                         :         10 |    0.0941857   0.0932138   0.0217046    0.002693 1.49286e+06           0
                         :         20 Minimum Test error found - save the configuration 
                         :         20 |    0.0683728   0.0668271   0.0219162    0.003619 1.48462e+06           0
                         :         30 Minimum Test error found - save the configuration 
                         :         30 |    0.0325631   0.0308934   0.0240197     0.00281 1.34801e+06           0
                         :         40 Minimum Test error found - save the configuration 
                         :         40 |    0.0062158  0.00551699   0.0256525    0.002465 1.25954e+06           0
                         :         50 Minimum Test error found - save the configuration 
                         :         50 |  0.000665487 0.000647606   0.0210492    0.002591 1.53919e+06           0
                         :         60 Minimum Test error found - save the configuration 
                         :         60 |  0.000443119 0.000446228   0.0215597    0.002458 1.50137e+06           0
                         :         70 Minimum Test error found - save the configuration 
                         :         70 |  0.000349216  0.00035151   0.0195955    0.002602   1.655e+06           0
                         :         80 Minimum Test error found - save the configuration 
                         :         80 |  0.000274218 0.000275417   0.0192931    0.002308 1.67871e+06           0
                         :         90 Minimum Test error found - save the configuration 
                         :         90 |  0.000220862 0.000221881   0.0180002    0.002365 1.80143e+06           0
                         :        100 Minimum Test error found - save the configuration 
                         :        100 |  0.000183242 0.000183861   0.0180537    0.002325 1.79561e+06           0
                         : 
                         : Elapsed time for training with 40000 events: 2.12 sec         
                         : Dataset[dataset] : Create results for training
                         : Dataset[dataset] : Evaluation of DL_MultiRegCPU on training sample
                         : Dataset[dataset] : Elapsed time for evaluation of 40000 events: 0.262 sec       
                         : Create variable histograms
                         : Create regression target histograms
                         : Create regression average deviation
                         : Results created
                         : Creating xml weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVARegression_DL_MultiRegCPU.weights.xml[NON-XML-CHAR-0x1B][0m
Factory                  : Training finished
                         : 
TH1.Print Name  = TrainingHistory_DL_MultiRegCPU_trainingError, Entries= 0, Total sum= 0.203474
TH1.Print Name  = TrainingHistory_DL_MultiRegCPU_valError, Entries= 0, Total sum= 0.198578
Factory                  : === Destroy and recreate all methods via weight files for testing ===
                         : 
                         : Reading weight file: [NON-XML-CHAR-0x1B][0;36mdataset/weights/TMVARegression_DL_MultiRegCPU.weights.xml[NON-XML-CHAR-0x1B][0m
Factory                  : [NON-XML-CHAR-0x1B][1mTest all methods[NON-XML-CHAR-0x1B][0m
Factory                  : Test method: DL_MultiRegCPU for Regression performance
                         : 
                         : Dataset[dataset] : Create results for testing
                         : Dataset[dataset] : Evaluation of DL_MultiRegCPU on testing sample
                         : Dataset[dataset] : Elapsed time for evaluation of 10000 events: 0.0634 sec       
                         : Create variable histograms
                         : Create regression target histograms
                         : Create regression average deviation
                         : Results created
Factory                  : [NON-XML-CHAR-0x1B][1mEvaluate all methods[NON-XML-CHAR-0x1B][0m
                         : Evaluate regression method: DL_MultiRegCPU
                         : TestRegression (testing)
                         : Calculate regression for all events
                         : Elapsed time for evaluation of 10000 events: 0.0584 sec       
                         : TestRegression (training)
                         : Calculate regression for all events
                         : Elapsed time for evaluation of 40000 events: 0.258 sec       
TFHandler_DL_MultiRegCPU :    Variable           Mean           RMS   [        Min           Max ]
                         : --------------------------------------------------------------------------
                         :    uniform1:      0.50383      0.28976   [   0.00035527      0.99998 ]
                         :    uniform2:      0.50308      0.28913   [   4.1931e-05      0.99987 ]
                         : uniform_add:       1.0069      0.41237   [     0.017353       1.9861 ]
                         : uniform_sub:   0.00075203      0.40628   [     -0.98883      0.98947 ]
                         : --------------------------------------------------------------------------
                         : 
                         : Evaluation results ranked by smallest RMS on test sample:
                         : ("Bias" quotes the mean deviation of the regression from true target.
                         :  "MutInf" is the "Mutual Information" between regression and target.
                         :  Indicated by "_T" are the corresponding "truncated" quantities ob-
                         :  tained when removing events deviating more than 2sigma from average.)
                         : --------------------------------------------------------------------------------------------------
                         : --------------------------------------------------------------------------------------------------
                         : dataset              DL_MultiRegCPU :-2.23e-05-5.53e-05   0.0144   0.0124  |  3.044  3.113
                         : --------------------------------------------------------------------------------------------------
                         : 
                         : Evaluation results ranked by smallest RMS on training sample:
                         : (overtraining check)
                         : --------------------------------------------------------------------------------------------------
                         : DataSet Name:         MVA Method:        <Bias>   <Bias_T>    RMS    RMS_T  |  MutInf MutInf_T
                         : --------------------------------------------------------------------------------------------------
                         : dataset              DL_MultiRegCPU :-8.02e-05-0.000211   0.0144   0.0124  |  3.041  3.109
                         : --------------------------------------------------------------------------------------------------
                         : 
Dataset:dataset          : Created tree 'TestTree' with 10000 events
                         : 
Dataset:dataset          : Created tree 'TrainTree' with 40000 events
                         : 
Factory                  : [NON-XML-CHAR-0x1B][1mThank you for using TMVA![NON-XML-CHAR-0x1B][0m
                         : [NON-XML-CHAR-0x1B][1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html[NON-XML-CHAR-0x1B][0m
==> Wrote root file: TMVA_DNN_MultiRegression.root
==> TMVARegression is done!
Info in <TCanvas::MakeDefCanvas>:  created default TCanvas with name c1
Info in <TCanvas::Print>: pdf file DL_MultiRegCPU.pdf has been created
< Deviation target 1> = -2.22502e-05 +/- 0.000143914
< Deviation target 2> = -7.78291e-05 +/- 0.000123857