Jobsub ID 301547.113@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 301547.113@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:29:37 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2024-11-23 00:15:24 |
| From worker node | Hostname | dune001-3355636.0-lcg2722.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:42:35 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 28m (1682s) |
| CPU time | 32m (1971s = 117%) |
| Outputting started | 2024-11-23 00:10:38 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2.root
|
| Finished | 2024-11-23 00:15:24 |
| Saved logs | justin-logs:301547.113-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:10:30 UTC run: 65996932 subRun: 1 event: 39800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:10:31 UTC run: 65996932 subRun: 1 event: 39800
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:10:31 UTC run: 65996932 subRun: 1 event: 39800
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:10:31 UTC run: 65996932 subRun: 1 event: 39800
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:10:34 UTC run: 65996932 subRun: 1 event: 39800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:10:34 UTC run: 65996932 subRun: 1 event: 39800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:10:34 UTC run: 65996932 subRun: 1 event: 39800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 223, 211, 153
minwire 0: 2314
minwire 1: 1077
minwire 2: 2080
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.00288319, 0.99565, 0.00146719,
Output 1: 0.00378404, 0.0145419, 0.192184, 0.78949,
Output 2: 0.988439, 0.0115607,
593
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2166!
23-Nov-2024 00:10:37 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2_reco_data_2024-11-22T_234238Z.root"
23-Nov-2024 00:10:37 UTC Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/87/e9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.0827947 16.2165 166.86 6.55115 28.4705 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00155685 0.0212745 0.621301 0.00510685 0.064726 100
reco:linecluster:LineCluster 0.00189393 0.0813002 2.56182 0.0158827 0.303537 100
reco:trajcluster:TrajCluster 0.000844318 0.278463 5.47567 0.0111744 0.935873 100
reco:pandora:StandardPandora 0.0155151 1.36154 10.7252 1.06074 1.25016 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000114263 0.0044915 0.0482918 0.00142573 0.0081777 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000150228 0.00900956 0.0902201 0.00227781 0.0175039 100
reco:pandoracalo:Calorimetry 8.6451e-05 0.0106432 0.214835 0.000929666 0.0317215 100
reco:pandorapid:Chi2ParticleID 3.1858e-05 0.000145905 0.00222618 0.000106511 0.000224149 100
reco:trkshowersplit:TrackShowerHits 4.3296e-05 0.0126216 0.276922 0.000643624 0.0403698 100
reco:pmtrack:PMAlgTrackMaker 0.000976226 1.41396 28.6493 0.143367 4.066 100
reco:pmtrackcalo:Calorimetry 4.9064e-05 0.00548117 0.129312 0.000855473 0.0159982 100
reco:pmtrackpid:Chi2ParticleID 1.9659e-05 0.000208162 0.00152578 0.000133116 0.000240759 100
reco:pmtrajfit:PMAlgTrajFitter 0.000163257 1.13951 17.0583 0.19273 2.81539 100
reco:pmtrajfitcalo:Calorimetry 4.641e-05 0.00915163 0.160982 0.001386 0.0248574 100
reco:pmtrajfitpid:Chi2ParticleID 1.957e-05 0.000152226 0.000541379 0.000135584 0.000100304 100
reco:pmtracktc:PMAlgTrackMaker 0.000664985 1.5898 24.2625 0.170738 4.36344 100
reco:pmtracktccalo:Calorimetry 5.1328e-05 0.00356056 0.0473999 0.000764907 0.00764841 100
reco:pmtracktcpid:Chi2ParticleID 2.1342e-05 0.000181136 0.000896156 0.000117608 0.000176423 100
reco:pmtrajfittc:PMAlgTrajFitter 0.00013185 0.915651 13.8289 0.183333 2.05979 100
reco:pmtrajfittccalo:Calorimetry 4.2904e-05 0.00716796 0.144059 0.000979146 0.0207039 100
reco:pmtrajfittcpid:Chi2ParticleID 1.9971e-05 0.000254038 0.00182623 0.000133768 0.000310073 100
reco:blurredcluster:BlurredClustering 0.000246162 0.839262 7.60086 0.356069 1.13383 100
reco:emtrkmichelid:EmTrackMichelId 0.000109355 6.51466 65.8967 2.23453 11.6486 100
reco:emshower:EMShower 0.000172571 0.0217714 0.183932 0.00502174 0.0328201 100
reco:cvnmap:CVNMapper 1.7706e-05 0.00560983 0.046591 0.00391175 0.00748851 100
reco:cvneva:CVNEvaluator 1.5413e-05 0.480379 0.982095 0.584179 0.299049 100
reco:energyrecnumu:EnergyReco 0.000283799 0.0374871 1.34449 0.00586631 0.154539 100
reco:energyrecnue:EnergyReco 9.6206e-05 0.00128562 0.0253233 0.000401292 0.00296434 100
reco:energyrecnc:EnergyReco 0.00135863 0.00280976 0.0282484 0.00200658 0.00306487 100
reco:energyrecnumurange:EnergyReco 0.000123757 0.0310296 1.09127 0.00156362 0.133358 100
reco:energyrecnumumcs:EnergyReco 0.000903186 0.0322024 1.09581 0.00227679 0.134162 100
reco:opdec:Deconvolution 0.0206267 0.120111 0.30948 0.112629 0.0515437 100
reco:ophitspe:OpHitFinderDeco 0.00274301 1.08124 2.71952 1.00373 0.559193 100
reco:opflash:OpFlashFinder 0.000117527 0.00113087 0.00540903 0.0010015 0.000654882 100
reco:rns:RandomNumberSaver 1.5844e-05 2.61464e-05 0.000348877 2.0131e-05 3.32246e-05 100
reco:anglereconue:NuAngularReco 0.000144158 0.00111832 0.0196014 0.000337045 0.00261312 100
reco:anglereconumu:NuAngularReco 4.8353e-05 0.000896289 0.0196584 0.000179983 0.00250704 100
reco:anglereconuepfps:NuAngularReco 9.6345e-05 0.00102839 0.019646 0.000299718 0.00254246 100
reco:anglereconumupfps:NuAngularReco 6.2845e-05 0.000941457 0.01927 0.000235943 0.00252251 100
[art]:TriggerResults:TriggerResultInserter 7.441e-06 1.02292e-05 5.8669e-05 8.918e-06 5.32166e-06 100
end_path:out1:RootOutput 3.075e-06 4.14436e-06 1.975e-05 3.6555e-06 1.75261e-06 100
end_path:out1:RootOutput(write) 0.0149515 0.177303 0.759626 0.162129 0.126025 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40438.5 MB
Peak resident set size usage (VmHWM): 2626.41 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2_reco_2024-11-22T_234238Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_397_20231202T054355Z_gen_g4_detsim_hitreco__20240508T034054Z_reco2_reco_data_2024-11-22T_234238Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
