justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108551.186@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108551.186@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:16:35
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:35
From worker nodeHostnamedune001-2993932.0-lcg2665.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:36:07
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2.root
JobscriptExit code0
Real time43m (2587s)
CPU time1h (3639s = 140%)
Outputting started2024-11-23 00:19:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2.root
Finished2024-11-23 00:26:35
Saved logsjustin-logs:108551.186-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:03 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:03 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:03 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:03 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:03 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:19:04 UTC run: 50607041 subRun: 1 event: 71400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 262, 106, 110
minwire 0: 285
minwire 1: 2358
minwire 2: 206
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00466622, 0.000487659, 0.994846, 
Output 1: 0.222651, 0.74812, 0.0278735, 0.00135578, 
Output 2: 0.994987, 0.005013, 

368
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1038!
23-Nov-2024 00:19:13 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2_reco_data_2024-11-22T_233612Z.root"
23-Nov-2024 00:19:13 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/a2/ff/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.318846       24.3115       299.874       11.8558       38.1459        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0247227     0.0862338     0.312895      0.0718088      0.05334        100    
reco:linecluster:LineCluster                           0.0225016     0.297782       2.18839      0.225404      0.306034        100    
reco:trajcluster:TrajCluster                          0.00294822     0.406008       8.76063      0.0858192      1.11954        100    
reco:pandora:StandardPandora                           0.0349691      2.46635       69.5787       1.54244       6.80699        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000124333   0.00525565     0.090806     0.00188178     0.0106774       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000168888    0.0103647     0.0591573    0.00419996     0.0142378       100    
reco:pandoracalo:Calorimetry                          0.00010107     0.0158532     0.511389     0.00151304     0.0559902       100    
reco:pandorapid:Chi2ParticleID                        3.8362e-05    0.000194081   0.00159425    0.000149036   0.000179392      100    
reco:trkshowersplit:TrackShowerHits                   8.6522e-05     0.0173221     0.347231     0.00106475     0.049721        100    
reco:pmtrack:PMAlgTrackMaker                          0.00108375      1.80884       26.5991      0.317436       4.10402        100    
reco:pmtrackcalo:Calorimetry                          6.9421e-05    0.00708674     0.213644     0.00114013     0.0229381       100    
reco:pmtrackpid:Chi2ParticleID                        2.7743e-05    0.000325287   0.00232356    0.000184402   0.000399282      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000162025     1.8314        30.1723      0.449607       4.16019        100    
reco:pmtrajfitcalo:Calorimetry                         6.396e-05     0.0152018     0.435231     0.00192411     0.0491396       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.6179e-05    0.000214661    0.0007774    0.000186065   0.000129628      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000884421     1.89565       37.8588      0.440141       4.65814        100    
reco:pmtracktccalo:Calorimetry                        6.6996e-05    0.00464865     0.092025     0.00121061     0.0106143       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7351e-05    0.00028573     0.0012963    0.000189626   0.000269207      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000151775     1.2597        9.67586      0.339216       2.10883        100    
reco:pmtrajfittccalo:Calorimetry                      6.2407e-05    0.00944773     0.187581     0.00152498     0.024318        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.4797e-05    0.000386632   0.00259085    0.000212038   0.000484394      100    
reco:blurredcluster:BlurredClustering                 0.000241324     1.08233       7.92062      0.590311       1.4015         100    
reco:emtrkmichelid:EmTrackMichelId                    0.000161714     9.0927        100.555       3.44415       14.9289        100    
reco:emshower:EMShower                                0.000241804    0.0252781     0.293515     0.00757204     0.0408976       100    
reco:cvnmap:CVNMapper                                 2.1711e-05    0.00948641     0.0457502    0.00638419    0.00900569       100    
reco:cvneva:CVNEvaluator                              1.7102e-05     0.972616       1.55508       1.24728      0.529547        100    
reco:energyrecnumu:EnergyReco                         0.00032959     0.0233638     0.349566     0.00542459     0.0571903       100    
reco:energyrecnue:EnergyReco                          0.00013344    0.00152361     0.0148149    0.000707134   0.00225182       100    
reco:energyrecnc:EnergyReco                           0.00161594    0.00428593     0.0167958    0.00354946    0.00247978       100    
reco:energyrecnumurange:EnergyReco                    0.000166262    0.0206806     0.338992      0.0035009     0.0538318       100    
reco:energyrecnumumcs:EnergyReco                      0.00135044     0.0220232     0.335029     0.00429461     0.0511765       100    
reco:opdec:Deconvolution                               0.0180632     0.308669      0.698991      0.316241      0.124637        100    
reco:ophitspe:OpHitFinderDeco                          0.115915       2.33116       4.49725       2.32924       1.03844        100    
reco:opflash:OpFlashFinder                            0.000290506    0.0016152    0.00490041    0.00152295    0.000789108      100    
reco:rns:RandomNumberSaver                            1.7482e-05    3.83269e-05   0.00036195    3.3062e-05    3.42988e-05      100    
reco:anglereconue:NuAngularReco                       0.000178105   0.00103688     0.0116092    0.000485547   0.00154284       100    
reco:anglereconumu:NuAngularReco                      8.6933e-05    0.000808785    0.0110624    0.000302579   0.00145803       100    
reco:anglereconuepfps:NuAngularReco                   0.00013835    0.000964859    0.0110964    0.000429557   0.00146934       100    
reco:anglereconumupfps:NuAngularReco                  0.000113182   0.000876739    0.0109988    0.00038897    0.00144949       100    
[art]:TriggerResults:TriggerResultInserter            1.0028e-05    1.64842e-05   6.4811e-05    1.4973e-05    7.03665e-06      100    
end_path:out1:RootOutput                               2.866e-06    5.63701e-06    3.159e-05    4.7635e-06    3.56994e-06      100    
end_path:out1:RootOutput(write)                        0.0213078     0.271238       0.66586      0.288165      0.145581        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39270.2 MB
  Peak resident set size usage (VmHWM): 2054.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2_reco_2024-11-22T_233612Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_713_20231207T044529Z_gen_g4_detsim_hitreco__20240510T060002Z_reco2_reco_data_2024-11-22T_233612Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:25:48 UTC       justIN version: 01.01.09