Jobsub ID 108517.33@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 108517.33@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 22:34:24 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce03 |
| Last heartbeat | 2024-11-22 23:44:28 |
| From worker node | Hostname | cn013.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 22:39:41 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3717s) |
| CPU time | 59m (3597s = 96%) |
| Outputting started | 2024-11-22 23:41:39 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2.root
|
| Finished | 2024-11-22 23:44:28 |
| Saved logs | justin-logs:108517.33-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
--------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfit@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfit@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:41:33 GMT run: 50640579 subRun: 1 event: 43300
Comparing two wires in the same plane: return failure
%MSG
316
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 817!
22-Nov-2024 23:41:37 GMT Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2_reco_data_2024-11-22T_223945Z.root"
22-Nov-2024 23:41:37 GMT Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/5a/b2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.114322 35.572 732.947 10.4682 95.5011 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00310875 0.0421366 0.731886 0.0188429 0.0855141 100
reco:linecluster:LineCluster 0.00497018 0.876125 63.7846 0.0418878 6.35081 100
reco:trajcluster:TrajCluster 0.00409253 1.84082 109.372 0.0167859 11.5831 100
reco:pandora:StandardPandora 0.0231968 2.82416 71.8141 1.3827 8.0324 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000139328 0.00692686 0.167481 0.00131497 0.0203205 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000168069 0.0167349 0.5134 0.00223918 0.056843 100
reco:pandoracalo:Calorimetry 9.3573e-05 0.0268511 1.00246 0.00064782 0.123375 100
reco:pandorapid:Chi2ParticleID 3.468e-05 0.000153541 0.00140918 0.000114422 0.000165496 100
reco:trkshowersplit:TrackShowerHits 9.1448e-05 0.0223635 0.855214 0.000473845 0.10493 100
reco:pmtrack:PMAlgTrackMaker 0.00111817 2.31077 81.6834 0.113166 9.19181 100
reco:pmtrackcalo:Calorimetry 8.555e-05 0.0130289 0.542697 0.000637832 0.0593003 100
reco:pmtrackpid:Chi2ParticleID 3.1426e-05 0.000268281 0.0038447 0.000118033 0.000498549 100
reco:pmtrajfit:PMAlgTrajFitter 0.000199724 3.58467 158.179 0.205366 18.2332 100
reco:pmtrajfitcalo:Calorimetry 6.4982e-05 0.0281866 0.998762 0.000880418 0.125043 100
reco:pmtrajfitpid:Chi2ParticleID 2.5841e-05 0.000174056 0.000931749 0.000128383 0.000143907 100
reco:pmtracktc:PMAlgTrackMaker 0.000976498 2.72126 96.3108 0.107589 11.0602 100
reco:pmtracktccalo:Calorimetry 6.8847e-05 0.00912719 0.174406 0.000758034 0.0277173 100
reco:pmtracktcpid:Chi2ParticleID 2.6951e-05 0.000248532 0.00215182 0.00012786 0.000334261 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000160227 1.41027 28.4626 0.229561 3.79179 100
reco:pmtrajfittccalo:Calorimetry 5.8989e-05 0.0184169 0.583308 0.000954127 0.0776676 100
reco:pmtrajfittcpid:Chi2ParticleID 2.4676e-05 0.000337903 0.00425861 0.000133037 0.000631681 100
reco:blurredcluster:BlurredClustering 9.2073e-05 1.3279 9.56086 0.80164 1.65425 100
reco:emtrkmichelid:EmTrackMichelId 0.000133295 15.0432 203.011 3.22114 32.1557 100
reco:emshower:EMShower 0.000223411 0.019279 0.120191 0.00420127 0.0279504 100
reco:cvnmap:CVNMapper 1.976e-05 0.0151188 0.0506101 0.0147561 0.010381 100
reco:cvneva:CVNEvaluator 1.5702e-05 0.694067 1.38258 0.832798 0.398835 100
reco:energyrecnumu:EnergyReco 0.000243529 0.0364229 0.839923 0.00488186 0.119098 100
reco:energyrecnue:EnergyReco 0.000118529 0.00227965 0.052071 0.000467896 0.0064603 100
reco:energyrecnc:EnergyReco 0.00177946 0.0040295 0.0538149 0.00213418 0.00652102 100
reco:energyrecnumurange:EnergyReco 0.000209932 0.0325462 0.818131 0.00210286 0.116012 100
reco:energyrecnumumcs:EnergyReco 0.00171309 0.033482 0.786499 0.00296767 0.113491 100
reco:opdec:Deconvolution 0.00798787 0.216156 0.826498 0.182333 0.127892 100
reco:ophitspe:OpHitFinderDeco 0.0250455 2.1565 5.93372 2.09152 1.02583 100
reco:opflash:OpFlashFinder 0.000138247 0.00131722 0.00394063 0.00123186 0.000595571 100
reco:rns:RandomNumberSaver 1.8145e-05 3.1238e-05 0.000283965 2.80655e-05 2.64888e-05 100
reco:anglereconue:NuAngularReco 0.000148357 0.00180381 0.0447351 0.000348348 0.00551461 100
reco:anglereconumu:NuAngularReco 6.587e-05 0.00155196 0.0437837 0.000189688 0.00537092 100
reco:anglereconuepfps:NuAngularReco 0.000107632 0.00166874 0.044256 0.000274085 0.00542313 100
reco:anglereconumupfps:NuAngularReco 8.931e-05 0.0016299 0.0439546 0.000251028 0.00541829 100
[art]:TriggerResults:TriggerResultInserter 8.746e-06 1.2531e-05 4.5668e-05 1.1999e-05 4.3328e-06 100
end_path:out1:RootOutput 2.282e-06 4.10451e-06 1.3873e-05 3.1495e-06 2.08011e-06 100
end_path:out1:RootOutput(write) 0.007951 0.228069 0.919623 0.219117 0.159332 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 17023.3 MB
Peak resident set size usage (VmHWM): 2377.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2_reco_2024-11-22T_223945Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_432_20231207T204516Z_gen_g4_detsim_hitreco__20240510T052632Z_reco2_reco_data_2024-11-22T_223945Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
