Jobsub ID 102633.1@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 102633.1@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4129 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 43200 (12 hours) |
| Submitted time | 2024-11-19 01:27:41 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep207 |
| Last heartbeat | 2024-11-19 04:16:54 |
| From worker node | Hostname | heplnc169.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-19 01:29:10 |
| Input files | fardet-hd:nutau_dune10kt_1x2x6_1428_894_20230827T234124Z_gen_g4_detsim_hitreco__20240220T155602Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10023s) |
| CPU time | 3h (11022s = 109%) |
| Outputting started | 2024-11-19 04:16:14 |
| Output files | |
| Finished | 2024-11-19 04:16:54 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/ee/nutau_dune10kt_1x2x6_1428_894_20230827T234124Z_gen_g4_detsim_hitreco__20240220T155602Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
<ERROR> : that's all I can do, please fix or remove this event.
Boundary wire vector sizes: 68, 72, 67
minwire 0: 191
minwire 1: 1925
minwire 2: 11
Used alternate method to get min and max wires due to vertex determination failure: 609, 1108
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 586, 1085
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.56724,
Output 1: 3.44347e-05, 7.06624e-06, 1.46057e-05, 0.999944,
Output 2: 0.211146, 0.358031, 0.160377, 0.270447,
Output 3: 0.991504, 0.00788375, 0.000522732, 8.95706e-05,
Output 4: 0.997207, 0.00278661, 5.7449e-06, 6.42213e-07,
Output 5: 0.999962, 3.68856e-05, 3.55903e-07, 3.09401e-07,
Output 6: 0.992279, 0.00661531, 0.000998307, 0.000107567,
ElectronInitialRegionRefinementAlgorithm: unable to find track pfo list TrackParticles3D
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 19-Nov-2024 04:13:00 GMT run: 1428 subRun: 1 event: 89498
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 19-Nov-2024 04:13:00 GMT run: 1428 subRun: 1 event: 89498
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 356, 253, 307
minwire 0: 2724
minwire 1: 552
minwire 2: 2669
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.412506,
Output 1: 2.46345e-05, 6.36372e-05, 0.000690623, 0.999221,
Output 2: 0.698384, 0.0569709, 0.0215284, 0.223116,
Output 3: 0.911397, 0.0857575, 0.00240905, 0.00043675,
Output 4: 0.998312, 0.00167156, 1.41202e-05, 2.07651e-06,
Output 5: 0.00190516, 0.998045, 4.8351e-05, 1.8071e-06,
Output 6: 0.982879, 0.0155429, 0.00140861, 0.000169397,
Boundary wire vector sizes: 128, 146, 131
minwire 0: 2213
minwire 1: 470
minwire 2: 2373
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.0583661,
Output 1: 2.70468e-05, 5.29233e-07, 5.33848e-06, 0.999967,
Output 2: 0.633899, 0.258264, 0.0781813, 0.0296553,
Output 3: 0.00193736, 0.997557, 0.0005005, 5.45499e-06,
Output 4: 0.999994, 6.28668e-06, 1.64941e-08, 1.15229e-09,
Output 5: 8.84378e-05, 0.99991, 1.15722e-06, 1.9046e-08,
Output 6: 0.999222, 0.000739637, 3.5721e-05, 2.31537e-06,
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 19-Nov-2024 04:13:46 GMT run: 1428 subRun: 1 event: 89500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 19-Nov-2024 04:13:46 GMT run: 1428 subRun: 1 event: 89500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 3662, 3599, 2922
minwire 0: 103
minwire 1: 1256
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.141012,
Output 1: 0.000980264, 0.740095, 0.16711, 0.0918147,
Output 2: 0.0204375, 0.0701642, 0.900333, 0.00906492,
Output 3: 0.150549, 0.530881, 0.276049, 0.0425215,
Output 4: 0.0345474, 0.128275, 0.282941, 0.554237,
Output 5: 0.839084, 0.148112, 0.0114046, 0.0013993,
Output 6: 0.995782, 0.00368054, 0.000343213, 0.000194085,
19-Nov-2024 04:16:11 GMT Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/ee/nutau_dune10kt_1x2x6_1428_894_20230827T234124Z_gen_g4_detsim_hitreco__20240220T155602Z_reco2.root"
19-Nov-2024 04:16:11 GMT Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/ee/nutau_dune10kt_1x2x6_1428_894_20230827T234124Z_gen_g4_detsim_hitreco__20240220T155602Z_reco2.root"
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 ccnuselection
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10949.296452 Real = 9936.694686
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 4971.18 VmHWM = 2318.24
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
