Jobsub ID 301489.185@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 301489.185@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 4213 |
Stage ID | 1 |
User name | ismerio@fnal.gov |
HTCondor Group | group_dune |
Requested | Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 80000 (22 hours) |
Submitted time | 2024-11-22 23:05:17 |
Site | UK_RAL-Tier1 |
Entry | LIGO_UK_RAL_arc_ce02 |
Last heartbeat | 2024-11-23 00:14:56 |
From worker node | Hostname | dune001-3354546.0-lcg2693.gridpp.rl.ac.uk |
cpuinfo | AMD EPYC 9654 96-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 216000 (60 hours) |
Inner Apptainer? | True |
Job state | finished |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-11-22 23:23:11 |
Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
|
Jobscript | Exit code | 0 |
Real time | 46m (2769s) |
CPU time | 48m (2907s = 104%) |
Outputting started | 2024-11-23 00:09:21 |
Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
|
Finished | 2024-11-23 00:14:56 |
Saved logs | justin-logs:301489.185-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
me plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:09:15 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:09:15 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 52, 56, 43
minwire 0: 709
minwire 1: 1971
minwire 2: 373
Used alternate method to get min and max wires due to vertex determination failure: 135, 334
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 264, 463
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 107, 306
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.994654, 0.000510243, 0.00483564,
Output 1: 0.814583, 0.179646, 0.00528429, 0.00048699,
Output 2: 0.99692, 0.00307978,
432
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1445!
23-Nov-2024 00:09:19 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_data_2024-11-22T_232316Z.root"
23-Nov-2024 00:09:19 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9d/5d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.872177 26.2802 505.827 8.44058 64.606 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0014201 0.111001 0.475174 0.0765073 0.097483 100
reco:linecluster:LineCluster 0.0437083 0.677363 26.5249 0.169511 3.13155 100
reco:trajcluster:TrajCluster 0.00350165 0.825498 37.873 0.061415 4.21735 100
reco:pandora:StandardPandora 0.111426 2.85164 61.3671 1.44958 7.58062 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000183726 0.00512553 0.0603312 0.00124856 0.00910631 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000257267 0.0115364 0.190361 0.00223568 0.024278 100
reco:pandoracalo:Calorimetry 0.000125208 0.017438 0.482763 0.000751395 0.0657434 100
reco:pandorapid:Chi2ParticleID 4.649e-05 0.000187953 0.00136682 0.000132153 0.000177391 100
reco:trkshowersplit:TrackShowerHits 0.000104216 0.0262599 0.932382 0.000638295 0.110676 100
reco:pmtrack:PMAlgTrackMaker 0.00153654 2.83186 87.3507 0.128343 10.9103 100
reco:pmtrackcalo:Calorimetry 8.1933e-05 0.0066117 0.197587 0.000814094 0.0217337 100
reco:pmtrackpid:Chi2ParticleID 3.1357e-05 0.000283124 0.00320851 0.000155769 0.000405447 100
reco:pmtrajfit:PMAlgTrajFitter 0.000238489 2.09054 56.078 0.157655 7.16914 100
reco:pmtrajfitcalo:Calorimetry 6.626e-05 0.015771 0.437001 0.00100085 0.0616786 100
reco:pmtrajfitpid:Chi2ParticleID 3.1748e-05 0.000197407 0.000623768 0.000167702 0.000126477 100
reco:pmtracktc:PMAlgTrackMaker 0.00140464 2.88741 98.4291 0.22843 11.4258 100
reco:pmtracktccalo:Calorimetry 8.8303e-05 0.00441442 0.0990322 0.000836032 0.0118854 100
reco:pmtracktcpid:Chi2ParticleID 3.2609e-05 0.000260506 0.00229304 0.000168684 0.000330241 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000204768 1.40752 30.9404 0.25492 3.83037 100
reco:pmtrajfittccalo:Calorimetry 8.2874e-05 0.0115098 0.407967 0.000968096 0.0460834 100
reco:pmtrajfittcpid:Chi2ParticleID 3.1177e-05 0.000351377 0.00341683 0.000184728 0.000508041 100
reco:blurredcluster:BlurredClustering 0.00026598 0.935947 6.44593 0.377416 1.26704 100
reco:emtrkmichelid:EmTrackMichelId 0.000124748 8.37129 123.084 1.98622 16.7054 100
reco:emshower:EMShower 0.000184258 0.0276496 0.245196 0.00494869 0.0465229 100
reco:cvnmap:CVNMapper 1.9429e-05 0.00816113 0.0446986 0.00461952 0.0113308 100
reco:cvneva:CVNEvaluator 2.0331e-05 0.584974 1.18368 0.737833 0.483521 100
reco:energyrecnumu:EnergyReco 0.000367062 0.0324045 0.499774 0.00688504 0.0890936 100
reco:energyrecnue:EnergyReco 0.000121132 0.00175567 0.024383 0.000560783 0.00312279 100
reco:energyrecnc:EnergyReco 0.00167768 0.00416347 0.0299009 0.00309108 0.00340868 100
reco:energyrecnumurange:EnergyReco 0.000202404 0.029565 0.529527 0.00297871 0.0915919 100
reco:energyrecnumumcs:EnergyReco 0.00181738 0.0313315 0.543949 0.00334327 0.0928174 100
reco:opdec:Deconvolution 0.0957867 0.3139 0.800611 0.300821 0.145485 100
reco:ophitspe:OpHitFinderDeco 0.165231 1.90237 4.21739 1.84939 0.876613 100
reco:opflash:OpFlashFinder 0.000130877 0.00157773 0.00528254 0.00146523 0.000802456 100
reco:rns:RandomNumberSaver 2.1482e-05 3.83696e-05 0.000434804 2.99755e-05 4.33271e-05 100
reco:anglereconue:NuAngularReco 0.00015964 0.00135653 0.0190727 0.000409557 0.00254152 100
reco:anglereconumu:NuAngularReco 5.962e-05 0.00108739 0.0176569 0.000199996 0.00234499 100
reco:anglereconuepfps:NuAngularReco 0.000145098 0.00124922 0.0173605 0.000355655 0.00233526 100
reco:anglereconumupfps:NuAngularReco 0.000120512 0.0011371 0.0166329 0.000261413 0.0022768 100
[art]:TriggerResults:TriggerResultInserter 1.0376e-05 1.4906e-05 5.0056e-05 1.36005e-05 5.69632e-06 100
end_path:out1:RootOutput 3.185e-06 4.17511e-06 2.1192e-05 3.8005e-06 1.84339e-06 100
end_path:out1:RootOutput(write) 0.0162366 0.245281 1.21177 0.250946 0.194076 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40457.1 MB
Peak resident set size usage (VmHWM): 2672.66 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_2024-11-22T_232316Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_data_2024-11-22T_232316Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work