Jobsub ID 263291.95@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263291.95@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:58:20 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2024-09-26 11:14:54 |
| From worker node | Hostname | ccwcondor0533 |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 10:00:54 |
| Input files | hd-protodune:np04hd_raw_run029094_0159_dataflow0_datawriter_0_20240906T095107.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:14:54 |
| Saved logs | justin-logs:263291.95-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
iener
5374 hits in TPC 0
3467 hits in TPC 1
4433 hits in TPC 2
1970 hits in TPC 3
4459 hits in TPC 4
6454 hits in TPC 5
3738 hits in TPC 6
2622 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 5176 XUs and 2628 XVs -> 330 XUVs
C:0 T:2 6537 XUs and 10435 XVs -> 1567 XUVs
C:0 T:3 103 XUs and 175 XVs -> 1 XUVs
C:0 T:4 523 XUs and 591 XVs -> 42 XUVs
C:0 T:5 19988 XUs and 20480 XVs -> 1374 XUVs
C:0 T:6 9153 XUs and 7731 XVs -> 369 XUVs
C:0 T:7 68 XUs and 66 XVs -> 4 XUVs
3687 XUVs total
1055 collection wire objects
3687 potential space points
Neighbour search...
133951 tests to find 84174 neighbours
Iterating with no regularization...
Begin: 1.28597e+07
0 1.17565e+07
1 1.16502e+07
2 1.16349e+07
3 1.16298e+07
Now with regularization...
Begin: 1.06853e+07
0 1.06725e+07
1 1.0669e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 38384 TrkackID 0 startx, y, z 169.484 603.821 170.873 wireno, peakt tpcno 329 3289 2 dist 301.578min T, max_T9.79424 3302.09
no of hits closeby 0 event 38384 TrkackID 0 startx, y, z 169.484 603.821 170.873 wireno, peakt tpcno 329 3289 2 dist 301.578min T, max_T9.79424 3302.09
Begin processing the 29th record. run: 29094 subRun: 1 event: 38392 at 26-Sep-2024 13:02:41 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 45532 traces, 45532 summary
Retagger: tagging trace set: gauss with 34132 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 34132 traces tagged "gauss"
FrameSaver: q=778238 n=657068 tag=gauss
wclsFrameSaver: saving 45532 traces tagged "wiener"
FrameSaver: q=848548 n=602165 tag=wiener
1846 hits in TPC 0
2488 hits in TPC 1
2453 hits in TPC 2
1156 hits in TPC 3
3879 hits in TPC 4
5572 hits in TPC 5
4711 hits in TPC 6
2776 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 65 XUs and 81 XVs -> 2 XUVs
C:0 T:2 1934 XUs and 2182 XVs -> 107 XUVs
C:0 T:3 441 XUs and 434 XVs -> 51 XUVs
C:0 T:4 343 XUs and 567 XVs -> 18 XUVs
C:0 T:5 26788 XUs and 24023 XVs -> 2359 XUVs
C:0 T:6 27308 XUs and 13484 XVs -> 896 XUVs
C:0 T:7 1333 XUs and 921 XVs -> 22 XUVs
3455 XUVs total
1001 collection wire objects
3455 potential space points
Neighbour search...
229333 tests to find 140762 neighbours
Iterating with no regularization...
Begin: 9.17911e+06
0 8.33428e+06
1 8.17476e+06
2 8.16644e+06
3 8.16408e+06
Now with regularization...
Begin: 7.79692e+06
0 7.79534e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29094 subRun: 1 event: 38400 at 26-Sep-2024 13:03:50 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 38404 traces, 38404 summary
Retagger: tagging trace set: gauss with 27049 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 27049 traces tagged "gauss"
FrameSaver: q=583840 n=480389 tag=gauss
wclsFrameSaver: saving 38404 traces tagged "wiener"
FrameSaver: q=622576 n=421713 tag=wiener
2805 hits in TPC 0
1921 hits in TPC 1
2211 hits in TPC 2
805 hits in TPC 3
2785 hits in TPC 4
5171 hits in TPC 5
1579 hits in TPC 6
976 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 6 XUs and 9 XVs -> 0 XUVs
C:0 T:2 2177 XUs and 1746 XVs -> 78 XUVs
C:0 T:3 54 XUs and 94 XVs -> 11 XUVs
C:0 T:4 300 XUs and 184 XVs -> 2 XUVs
C:0 T:5 17891 XUs and 14671 XVs -> 1550 XUVs
C:0 T:6 1436 XUs and 2844 XVs -> 197 XUVs
C:0 T:7 1 XUs and 4 XVs -> 0 XUVs
1838 XUVs total
721 collection wire objects
1838 potential space points
Neighbour search...
68268 tests to find 42406 neighbours
Iterating with no regularization...
Begin: 2.78656e+06
0 2.48171e+06
1 2.45397e+06
2 2.44921e+06
3 2.44755e+06
Now with regularization...
Begin: 2.15738e+06
0 2.15653e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 13:05:03 CEST Closed output file "np04hd_raw_run029094_0159_dataflow0_datawriter_0_20240906T095107_reco_stage1_reco_stage2_20240926T110503_keepup.root"
26-Sep-2024 13:05:03 CEST Closed input file "np04hd_raw_run029094_0159_dataflow0_datawriter_0_20240906T095107_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.6927 88.9575 137.27 83.8883 18.3519 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000487629 0.00242733 0.00485714 0.00208971 0.00124442 30
produce:fembfilter:PDHDFEMBFilter 0.539714 0.656663 0.983591 0.643242 0.0923943 30
produce:wclsdatahd:WireCellToolkit 37.4394 41.0541 46.1621 41.1937 2.14696 30
produce:gaushit:GausHitFinder 0.229962 0.565012 1.052 0.548501 0.186578 30
produce:nhitsfilter:NumberOfHitsFilter 0.000183205 0.000358679 0.000594881 0.000349089 0.000101307 30
produce:reco3d:SpacePointSolver 0.0963139 0.710512 4.61066 0.494709 0.809366 30
produce:hitpdune:DisambigFromSpacePoints 0.0951109 0.415065 1.41452 0.367549 0.268953 30
produce:pandora:StandardPandora 3.1636 11.0018 35.7469 9.03143 7.0697 30
produce:pandoraWriter:StandardPandora 0.0613457 0.133591 0.252236 0.129166 0.0440323 30
produce:pandoraTrack:LArPandoraTrackCreation 0.350033 1.01333 2.62076 0.920534 0.519092 30
produce:pandoraShower:LArPandoraShowerCreation 0.341866 1.23297 3.64435 0.905833 0.808847 30
produce:pandoracalo:Calorimetry 0.178887 0.500372 1.22352 0.438915 0.223709 30
produce:pandoracalonosce:Calorimetry 0.154814 0.468227 1.05938 0.396013 0.213867 30
produce:pandorapid:Chi2ParticleID 0.000866112 0.00197317 0.0108959 0.00149704 0.00177119 30
produce:pandoraShowercalo:ShowerCalorimetry 0.240721 1.12186 3.39377 0.812503 0.756534 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.234957 1.08259 2.92465 0.798741 0.672807 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.059508 0.131412 0.239683 0.123243 0.0450656 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.02089 0.0440754 0.0801884 0.0394579 0.0158305 30
produce:emtrkmichelid:EmTrackMichelId 14.5892 27.4099 46.2601 26.3916 7.41604 30
[art]:TriggerResults:TriggerResultInserter 2.0298e-05 4.31343e-05 8.6082e-05 3.71345e-05 1.81225e-05 30
end_path:out1:RootOutput 7.864e-06 1.2204e-05 4.206e-05 1.0189e-05 7.34982e-06 30
end_path:michelremoving:michelremoving 0.0158917 0.0897145 0.397068 0.0348567 0.102239 30
end_path:michelremovinggnocchi:michelremoving 0.0188889 0.0897133 0.456535 0.0301689 0.119886 30
end_path:calibanagnocchi:CalibAnaTree 0.142049 0.391709 0.858881 0.346905 0.174142 30
end_path:out1:RootOutput(write) 0.377346 0.721547 1.27221 0.713424 0.190906 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4923.74 MB
Peak resident set size usage (VmHWM): 2350.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0159_dataflow0_datawriter_0_20240906T095107_reco_stage1_reco_stage2_20240926T110503_keepup.root
\tHists: np04hd_raw_run029094_0159_dataflow0_datawriter_0_20240906T095107_reco_stage1_reco_stage2_20240926T110503_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
