justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.165@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.165@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:20
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:26:30
From worker nodeHostnameb9p10p9366.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:10:53
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2.root
JobscriptExit code0
Real time1h (4015s)
CPU time1h (3992s = 99%)
Outputting started2024-11-23 00:17:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2.root
Finished2024-11-23 00:26:30
Saved logsjustin-logs:301452.165-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ilure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:17:43 CET run: 6400858 subRun: 1 event: 35800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:17:43 CET run: 6400858 subRun: 1 event: 35800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:17:43 CET run: 6400858 subRun: 1 event: 35800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:17:43 CET run: 6400858 subRun: 1 event: 35800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:17:44 CET run: 6400858 subRun: 1 event: 35800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 39, 39, 33
minwire 0: 544
minwire 1: 2149
minwire 2: 398
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 14, 213
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.993932, 0.000667822, 0.00540063, 
Output 1: 0.908172, 0.0846684, 0.00590831, 0.00125151, 
Output 2: 0.997386, 0.00261426, 

267
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 673!
23-Nov-2024 01:17:48 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2_reco_data_2024-11-22T_231100Z.root"
23-Nov-2024 01:17:48 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/0b/2e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.5719        38.0313       864.293       9.7192        101.41         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0175852     0.0402946     0.0985086     0.0411545     0.011219        100    
reco:linecluster:LineCluster                           0.100176       1.05716       64.2363      0.182055       6.45337        100    
reco:trajcluster:TrajCluster                           0.0475675       1.459        60.9318      0.0593166      6.79881        100    
reco:pandora:StandardPandora                           0.0733453      3.11881       84.7438       1.25051       9.10221        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000169292   0.00758411     0.153088     0.00124186     0.0205902       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000232653    0.0119724     0.340893     0.00317637     0.0354385       100    
reco:pandoracalo:Calorimetry                          0.000124542    0.0371796      1.19451     0.000874595    0.145927        100    
reco:pandorapid:Chi2ParticleID                         3.809e-05    0.000198441   0.00279986    0.000131647   0.000294753      100    
reco:trkshowersplit:TrackShowerHits                   7.2251e-05     0.0437602      1.46857     0.000766139    0.170384        100    
reco:pmtrack:PMAlgTrackMaker                          0.00123474      4.64751       166.54       0.191408       18.4588        100    
reco:pmtrackcalo:Calorimetry                          6.9771e-05     0.0151036     0.531147     0.000960651    0.0623072       100    
reco:pmtrackpid:Chi2ParticleID                         2.957e-05    0.000321153   0.00325755    0.000145917   0.000491095      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000238523     3.62952        70.94       0.255114       10.8862        100    
reco:pmtrajfitcalo:Calorimetry                        6.8321e-05     0.0350886      1.10163     0.00121217     0.135887        100    
reco:pmtrajfitpid:Chi2ParticleID                       2.801e-05    0.000200987   0.00119729    0.000147927   0.000189089      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00100119      4.62929       139.317      0.234998       16.3455        100    
reco:pmtracktccalo:Calorimetry                         6.705e-05    0.00857032     0.223763     0.000971576    0.0292131       100    
reco:pmtracktcpid:Chi2ParticleID                       2.641e-05    0.000308407    0.0032768    0.000152766   0.000461622      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000149781     2.36298       59.1367      0.270489       7.14206        100    
reco:pmtrajfittccalo:Calorimetry                       6.305e-05     0.0241376     0.785349      0.0013101     0.0929945       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.739e-05    0.000427173   0.00382145    0.000171772   0.000706013      100    
reco:blurredcluster:BlurredClustering                 0.000128031     1.09508       8.53651      0.639443       1.44994        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000147152     12.3846       197.538       2.75719       27.0293        100    
reco:emshower:EMShower                                0.000185352    0.0334033     0.443764     0.00610604     0.0611279       100    
reco:cvnmap:CVNMapper                                  2.853e-05     0.0130728     0.0461313     0.0137604    0.00911164       100    
reco:cvneva:CVNEvaluator                              1.8161e-05     0.762829       1.18281       0.94734      0.413826        100    
reco:energyrecnumu:EnergyReco                         0.000354374    0.0323457     0.627098     0.00422339     0.0955333       100    
reco:energyrecnue:EnergyReco                          0.000133812    0.002411      0.0589119    0.000446966   0.00690064       100    
reco:energyrecnc:EnergyReco                           0.00154309    0.00476483     0.0622766    0.00296211    0.00719119       100    
reco:energyrecnumurange:EnergyReco                    0.000160921    0.0290137     0.616501     0.00246535     0.0921655       100    
reco:energyrecnumumcs:EnergyReco                      0.00111563     0.0294709     0.648397     0.00335699     0.088396        100    
reco:opdec:Deconvolution                               0.084853      0.280708      0.468143      0.283907      0.0764959       100    
reco:ophitspe:OpHitFinderDeco                          0.142194       1.95567       3.88537       1.86236      0.782996        100    
reco:opflash:OpFlashFinder                            0.000172292   0.00167588    0.00455298    0.00158619    0.000697978      100    
reco:rns:RandomNumberSaver                             2.925e-05    4.71168e-05   0.000326573   4.1686e-05    3.08878e-05      100    
reco:anglereconue:NuAngularReco                       0.000178313   0.00180061     0.0327905    0.000506092   0.00469828       100    
reco:anglereconumu:NuAngularReco                      8.1061e-05    0.00162396     0.0432012    0.000250978   0.00556931       100    
reco:anglereconuepfps:NuAngularReco                   0.000120912   0.00169205     0.0333934    0.000400705   0.00474555       100    
reco:anglereconumupfps:NuAngularReco                  9.1351e-05    0.00165727     0.0414108    0.000327639   0.00535352       100    
[art]:TriggerResults:TriggerResultInserter             7.87e-06     1.51857e-05   7.5311e-05    1.3615e-05    8.22495e-06      100    
end_path:out1:RootOutput                               3.35e-06     9.45857e-06   2.9371e-05     8.625e-06    3.64205e-06      100    
end_path:out1:RootOutput(write)                        0.0111877     0.267873       1.37199      0.245076      0.194162        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21877.1 MB
  Peak resident set size usage (VmHWM): 2444.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2_reco_2024-11-22T_231100Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_357_20231202T080237Z_gen_g4_detsim_hitreco__20240507T210158Z_reco2_reco_data_2024-11-22T_231100Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:31:10 UTC       justIN version: 01.01.09