justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301444.52@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301444.52@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:18:03
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2024-11-23 00:26:26
From worker nodeHostnamecn007.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:46:54
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2.root
JobscriptExit code0
Real time1h (4630s)
CPU time1h (4118s = 88%)
Outputting started2024-11-23 00:04:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2.root
Finished2024-11-23 00:26:26
Saved logsjustin-logs:301444.52-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:28 GMT run: 50538503 subRun: 1 event: 2100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:28 GMT run: 50538503 subRun: 1 event: 2100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:28 GMT run: 50538503 subRun: 1 event: 2100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:28 GMT run: 50538503 subRun: 1 event: 2100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:29 GMT run: 50538503 subRun: 1 event: 2100
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:29 GMT run: 50538503 subRun: 1 event: 2100
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:29 GMT run: 50538503 subRun: 1 event: 2100
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 602, 1116, 544
minwire 0: 1820
minwire 1: 35
minwire 2: 1567
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.015539, 0.00706409, 0.977397, 
Output 1: 0.141946, 0.189636, 0.164475, 0.503943, 
Output 2: 0.344053, 0.655947, 

563
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1794!
23-Nov-2024 00:04:03 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2_reco_data_2024-11-22T_224658Z.root"
23-Nov-2024 00:04:03 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/47/99/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.2041        42.9519       770.606       10.9938       116.792        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0021419     0.221222       1.68146      0.126033       0.27717        100    
reco:linecluster:LineCluster                           0.0222569      1.87966       59.1002      0.0583247      6.92745        100    
reco:trajcluster:TrajCluster                          0.00403207      2.02937       66.9369      0.0171207      8.69295        100    
reco:pandora:StandardPandora                            1.13531       4.72974       105.983       1.36183       15.3263        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000112874   0.00858444      0.19462     0.00127878     0.0259582       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000151718   0.00932431     0.0791044    0.00213851     0.0169748       100    
reco:pandoracalo:Calorimetry                          8.9335e-05     0.0537491      1.56485     0.000684459    0.236067        100    
reco:pandorapid:Chi2ParticleID                        3.3541e-05    0.000145559   0.00101957    0.000109677   0.000138626      100    
reco:trkshowersplit:TrackShowerHits                   0.000105292    0.0340797      1.02801     0.000565127    0.136969        100    
reco:pmtrack:PMAlgTrackMaker                          0.00102295      3.33815       92.4692      0.135044       12.7392        100    
reco:pmtrackcalo:Calorimetry                          7.5242e-05     0.0169007     0.521588     0.000717546    0.0691173       100    
reco:pmtrackpid:Chi2ParticleID                        2.9243e-05    0.000276324   0.00353452    0.000122956   0.000552866      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000186674     3.50584       81.2888      0.225847       13.0879        100    
reco:pmtrajfitcalo:Calorimetry                        5.4897e-05     0.0557637      1.65175     0.00107802     0.241308        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.5108e-05    0.00016727    0.000963236   0.000121739   0.000170974      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000935735     3.64432       95.657       0.156521       13.5954        100    
reco:pmtracktccalo:Calorimetry                         7.319e-05    0.00962664     0.315492     0.000696223    0.0366245       100    
reco:pmtracktcpid:Chi2ParticleID                      2.6973e-05    0.000256551   0.00350845    0.00012331    0.000464424      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000175227     1.94034       57.9727      0.171433       6.92316        100    
reco:pmtrajfittccalo:Calorimetry                      5.4607e-05     0.0299614      1.11032     0.000905324    0.131246        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.4487e-05    0.000348235    0.0049951    0.000128335   0.000712113      100    
reco:blurredcluster:BlurredClustering                 0.00680863     0.949499       7.52663      0.430044       1.4555         100    
reco:emtrkmichelid:EmTrackMichelId                     0.290001       16.3289       272.849       2.77261       41.5987        100    
reco:emshower:EMShower                                0.000224393    0.0211107     0.215245     0.00276544     0.0387144       100    
reco:cvnmap:CVNMapper                                 2.1066e-05     0.0121822     0.0458586     0.0133555    0.00985188       100    
reco:cvneva:CVNEvaluator                              1.5062e-05     0.595061       1.29818      0.802098      0.419707        100    
reco:energyrecnumu:EnergyReco                         0.000254378    0.0394831      1.03344     0.00507076     0.132785        100    
reco:energyrecnue:EnergyReco                          0.000129969   0.00266379     0.0576775    0.000494339   0.00772619       100    
reco:energyrecnc:EnergyReco                           0.00172516    0.00443859     0.0657281    0.00208208    0.00839861       100    
reco:energyrecnumurange:EnergyReco                    0.000212906    0.0373895      1.04317     0.00202556     0.133457        100    
reco:energyrecnumumcs:EnergyReco                      0.00134304     0.0390811      1.09998     0.00270042     0.139043        100    
reco:opdec:Deconvolution                               0.0149371     0.709974       7.06553      0.207702       1.16397        100    
reco:ophitspe:OpHitFinderDeco                          0.133139       2.47729       7.71693       2.3143        1.30007        100    
reco:opflash:OpFlashFinder                            0.000218187   0.00124763    0.00402613    0.00117813    0.000633919      100    
reco:rns:RandomNumberSaver                            1.6603e-05    2.78929e-05   0.000239534   2.31755e-05   2.24248e-05      100    
reco:anglereconue:NuAngularReco                       0.000132056   0.00226619     0.0559027    0.000296801   0.00779842       100    
reco:anglereconumu:NuAngularReco                      5.9993e-05    0.00202678     0.0504618    0.000171763   0.00733516       100    
reco:anglereconuepfps:NuAngularReco                   9.8646e-05    0.00210978     0.0481761    0.000264578   0.00720567       100    
reco:anglereconumupfps:NuAngularReco                  8.2449e-05    0.00207848      0.04851     0.000225454   0.00721738       100    
[art]:TriggerResults:TriggerResultInserter             8.192e-06    1.13391e-05   3.5074e-05    1.04495e-05   3.46199e-06      100    
end_path:out1:RootOutput                               2.144e-06    3.71365e-06   1.2186e-05    3.0285e-06    1.63378e-06      100    
end_path:out1:RootOutput(write)                        0.0116262      0.21559       1.28014      0.193677      0.208255        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 17105.9 MB
  Peak resident set size usage (VmHWM): 2459.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2_reco_2024-11-22T_224658Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_20_20231201T170009Z_gen_g4_detsim_hitreco__20240507T191412Z_reco2_reco_data_2024-11-22T_224658Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 18:03:51 UTC       justIN version: 01.01.09