Jobsub ID 108551.71@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 108551.71@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:16:35 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2024-11-23 00:13:28 |
| From worker node | Hostname | dune001-2995124.0-lcg2706.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:33:27 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1887s) |
| CPU time | 33m (2007s = 106%) |
| Outputting started | 2024-11-23 00:04:54 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2.root
|
| Finished | 2024-11-23 00:13:28 |
| Saved logs | justin-logs:108551.71-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
rn failure
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:04:05 UTC run: 6419587 subRun: 1 event: 109300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2265, 3320, 2670
minwire 0: 482
minwire 1: 279
minwire 2: 303
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.0763453, 0.0486462, 0.875009,
Output 1: 0.305762, 0.38672, 0.239204, 0.0683149,
Output 2: 0.220041, 0.779959,
805
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3147!
23-Nov-2024 00:04:53 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2_reco_data_2024-11-22T_233331Z.root"
23-Nov-2024 00:04:53 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ea/ca/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.345392 17.55 218.226 9.43569 27.2991 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00133435 0.128844 0.760457 0.107248 0.101592 100
reco:linecluster:LineCluster 0.0424246 0.362685 4.08989 0.264815 0.458484 100
reco:trajcluster:TrajCluster 0.00176899 0.399188 13.0921 0.11851 1.42546 100
reco:pandora:StandardPandora 0.0956984 1.58637 13.126 1.32334 1.34495 100
reco:pandoraTrack:LArPandoraTrackCreation 0.00011958 0.00449835 0.0747734 0.00163547 0.00887657 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000154573 0.0105201 0.224143 0.00345425 0.0279798 100
reco:pandoracalo:Calorimetry 8.7462e-05 0.00967517 0.216116 0.0012996 0.0293204 100
reco:pandorapid:Chi2ParticleID 3.4742e-05 0.000150145 0.000817563 0.000128529 0.000108624 100
reco:trkshowersplit:TrackShowerHits 5.5674e-05 0.0127236 0.433054 0.000914639 0.0485002 100
reco:pmtrack:PMAlgTrackMaker 0.000964935 1.35497 24.6957 0.255161 3.67915 100
reco:pmtrackcalo:Calorimetry 4.8783e-05 0.00673761 0.306855 0.00114207 0.031119 100
reco:pmtrackpid:Chi2ParticleID 2.0331e-05 0.000240701 0.0029119 0.000146731 0.000340646 100
reco:pmtrajfit:PMAlgTrajFitter 0.000179701 1.09389 20.2069 0.211159 2.47819 100
reco:pmtrajfitcalo:Calorimetry 4.4948e-05 0.00872677 0.23197 0.00150519 0.0265766 100
reco:pmtrajfitpid:Chi2ParticleID 1.973e-05 0.000163526 0.00077608 0.00013959 0.000110413 100
reco:pmtracktc:PMAlgTrackMaker 0.00088206 1.38441 30.2556 0.19079 3.79326 100
reco:pmtracktccalo:Calorimetry 4.9124e-05 0.004084 0.115239 0.000967614 0.0132193 100
reco:pmtracktcpid:Chi2ParticleID 1.9219e-05 0.000205763 0.00161713 0.000148879 0.000215969 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000114953 0.940875 17.6291 0.251494 2.12445 100
reco:pmtrajfittccalo:Calorimetry 4.3155e-05 0.00733446 0.237983 0.00104342 0.0254541 100
reco:pmtrajfittcpid:Chi2ParticleID 1.7286e-05 0.000270359 0.00222529 0.000146316 0.000323367 100
reco:blurredcluster:BlurredClustering 0.00026537 0.978138 5.53809 0.570424 1.24016 100
reco:emtrkmichelid:EmTrackMichelId 8.3756e-05 6.68844 85.7518 2.64947 11.4978 100
reco:emshower:EMShower 0.000126791 0.0167215 0.0992348 0.00378749 0.0239247 100
reco:cvnmap:CVNMapper 1.6635e-05 0.00676641 0.029519 0.00400473 0.00760517 100
reco:cvneva:CVNEvaluator 1.6174e-05 0.496701 1.03619 0.569117 0.308133 100
reco:energyrecnumu:EnergyReco 0.000329026 0.0146009 0.344755 0.00626018 0.0364111 100
reco:energyrecnue:EnergyReco 9.5223e-05 0.0012393 0.02345 0.000487235 0.00265264 100
reco:energyrecnc:EnergyReco 0.00128543 0.00299503 0.0254953 0.00240738 0.00278787 100
reco:energyrecnumurange:EnergyReco 0.000169575 0.0112089 0.344227 0.00152333 0.036483 100
reco:energyrecnumumcs:EnergyReco 0.000941669 0.0122826 0.340462 0.00298207 0.0359204 100
reco:opdec:Deconvolution 0.0313381 0.323052 0.838725 0.312037 0.143892 100
reco:ophitspe:OpHitFinderDeco 0.0761252 1.47807 3.18065 1.43463 0.651812 100
reco:opflash:OpFlashFinder 0.000117357 0.00129498 0.0051864 0.0011536 0.000703717 100
reco:rns:RandomNumberSaver 1.8969e-05 3.41324e-05 0.000375766 2.72205e-05 3.67439e-05 100
reco:anglereconue:NuAngularReco 0.000152881 0.00108009 0.0204699 0.000365857 0.00233199 100
reco:anglereconumu:NuAngularReco 5.0466e-05 0.000820329 0.0196647 0.000180737 0.00223716 100
reco:anglereconuepfps:NuAngularReco 0.000101252 0.000975522 0.0198029 0.000310288 0.00226158 100
reco:anglereconumupfps:NuAngularReco 6.8904e-05 0.000881444 0.0196373 0.000244974 0.00225462 100
[art]:TriggerResults:TriggerResultInserter 8.884e-06 1.31493e-05 5.4803e-05 1.1993e-05 5.22337e-06 100
end_path:out1:RootOutput 3.285e-06 4.91125e-06 3.3401e-05 4.3965e-06 3.00085e-06 100
end_path:out1:RootOutput(write) 0.010032 0.196249 0.685963 0.200438 0.121911 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40278.6 MB
Peak resident set size usage (VmHWM): 2494.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2_reco_2024-11-22T_233331Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1092_20231204T011058Z_gen_g4_detsim_hitreco__20240509T202501Z_reco2_reco_data_2024-11-22T_233331Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
