Jobsub ID 301491.183@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 301491.183@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:09:00 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2024-11-22 23:51:03 |
| From worker node | Hostname | dune001-3353877.0-lcg2720.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:24:04 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 26m (1597s) |
| CPU time | 29m (1774s = 111%) |
| Outputting started | 2024-11-22 23:50:41 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2.root
|
| Finished | 2024-11-22 23:51:03 |
| Saved logs | justin-logs:301491.183-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:50:05 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 22-Nov-2024 23:50:37 UTC run: 74494003 subRun: 1 event: 90900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2802, 2466, 1853
minwire 0: 829
minwire 1: 1560
minwire 2: 485
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.0900065, 0.839183, 0.0708103,
Output 1: 0.202539, 0.486141, 0.188203, 0.123117,
Output 2: 0.470232, 0.529768,
807
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3075!
22-Nov-2024 23:50:41 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2_reco_data_2024-11-22T_232408Z.root"
22-Nov-2024 23:50:41 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/46/b8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 1.61783 14.8255 114.52 8.01427 20.0491 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00115609 0.0983684 0.404432 0.0758064 0.0680334 100
reco:linecluster:LineCluster 0.0280647 0.265272 2.81669 0.219428 0.288892 100
reco:trajcluster:TrajCluster 0.00573855 0.263904 4.91819 0.0910744 0.656941 100
reco:pandora:StandardPandora 0.891484 1.42027 7.86703 1.21132 0.878146 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000121904 0.00390113 0.0449162 0.0014741 0.00672907 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000169085 0.0112108 0.385623 0.00241414 0.0405426 100
reco:pandoracalo:Calorimetry 8.7352e-05 0.00780295 0.159171 0.00104726 0.0210259 100
reco:pandorapid:Chi2ParticleID 3.0556e-05 0.000136039 0.000643219 0.000117898 8.5385e-05 100
reco:trkshowersplit:TrackShowerHits 9.2439e-05 0.00855039 0.178969 0.000754262 0.0253452 100
reco:pmtrack:PMAlgTrackMaker 0.000956713 1.02857 12.7701 0.222022 2.18228 100
reco:pmtrackcalo:Calorimetry 5.0867e-05 0.00375894 0.0496688 0.00112945 0.00787926 100
reco:pmtrackpid:Chi2ParticleID 2.0301e-05 0.000214576 0.00111933 0.0001459 0.000215328 100
reco:pmtrajfit:PMAlgTrajFitter 0.000159911 0.922758 15.228 0.240787 2.13261 100
reco:pmtrajfitcalo:Calorimetry 4.4156e-05 0.0074604 0.0989374 0.0013192 0.0176033 100
reco:pmtrajfitpid:Chi2ParticleID 1.8297e-05 0.000156579 0.000570159 0.000129074 0.00010274 100
reco:pmtracktc:PMAlgTrackMaker 0.000717451 1.1829 20.3638 0.224106 2.82927 100
reco:pmtracktccalo:Calorimetry 4.6581e-05 0.00311117 0.030896 0.00091842 0.00607245 100
reco:pmtracktcpid:Chi2ParticleID 1.981e-05 0.000192538 0.000871033 0.000140076 0.000177151 100
reco:pmtrajfittc:PMAlgTrajFitter 0.00013278 0.743868 6.88506 0.266283 1.355 100
reco:pmtrajfittccalo:Calorimetry 4.0922e-05 0.00592401 0.0701225 0.00107905 0.013581 100
reco:pmtrajfittcpid:Chi2ParticleID 1.7646e-05 0.000254725 0.00137635 0.000154067 0.000291467 100
reco:blurredcluster:BlurredClustering 0.00526042 0.716353 3.9697 0.446227 0.846321 100
reco:emtrkmichelid:EmTrackMichelId 0.162568 5.83608 41.1023 2.46788 9.25482 100
reco:emshower:EMShower 0.000244178 0.022836 0.207669 0.00496301 0.034574 100
reco:cvnmap:CVNMapper 1.8598e-05 0.00620047 0.0336635 0.00388279 0.00706984 100
reco:cvneva:CVNEvaluator 1.5724e-05 0.482322 0.947492 0.571324 0.293713 100
reco:energyrecnumu:EnergyReco 0.000332972 0.0150395 0.303883 0.00584527 0.0355645 100
reco:energyrecnue:EnergyReco 0.000112509 0.00110122 0.00932437 0.000383007 0.00183807 100
reco:energyrecnc:EnergyReco 0.0013489 0.00265267 0.0119067 0.00214078 0.00190711 100
reco:energyrecnumurange:EnergyReco 0.00016594 0.0110311 0.292617 0.00146118 0.0347389 100
reco:energyrecnumumcs:EnergyReco 0.00139613 0.0121077 0.30121 0.00258998 0.0348154 100
reco:opdec:Deconvolution 0.0590708 0.258095 0.588788 0.23347 0.121211 100
reco:ophitspe:OpHitFinderDeco 0.194826 1.29666 3.09012 1.21313 0.599011 100
reco:opflash:OpFlashFinder 0.000338791 0.00119091 0.004711 0.0011243 0.000588334 100
reco:rns:RandomNumberSaver 1.7917e-05 3.09554e-05 0.000400604 2.5058e-05 3.78694e-05 100
reco:anglereconue:NuAngularReco 0.000163657 0.000926128 0.00932087 0.000385722 0.00158332 100
reco:anglereconumu:NuAngularReco 5.2318e-05 0.000714743 0.00916133 0.000192786 0.00152466 100
reco:anglereconuepfps:NuAngularReco 9.8959e-05 0.000849371 0.00914171 0.000326342 0.00150359 100
reco:anglereconumupfps:NuAngularReco 6.4097e-05 0.000756906 0.00944815 0.000240973 0.00151962 100
[art]:TriggerResults:TriggerResultInserter 8.193e-06 1.21536e-05 5.6715e-05 1.1202e-05 5.5198e-06 100
end_path:out1:RootOutput 3.275e-06 4.25437e-06 2.3255e-05 3.871e-06 2.12994e-06 100
end_path:out1:RootOutput(write) 0.0234348 0.180172 0.546062 0.184024 0.103334 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40018.6 MB
Peak resident set size usage (VmHWM): 2174.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2_reco_2024-11-22T_232408Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_908_20231201T170406Z_gen_g4_detsim_hitreco__20240507T201930Z_reco2_reco_data_2024-11-22T_232408Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
