Jobsub ID 79900.124@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79900.124@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3519 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 07:29:59 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2024-09-27 16:38:30 |
| From worker node | Hostname | dunegli-4171512-0-fnpc9051.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 12:06:23 |
| Input files | hd-protodune:np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043.hdf5
|
| Outputting started | 2024-09-27 16:06:51 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
g trace set: wiener with 71055 traces, 71055 summary
Retagger: tagging trace set: gauss with 52192 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52192 traces tagged "gauss"
FrameSaver: q=1.99363e+06 n=971792 tag=gauss
wclsFrameSaver: saving 71055 traces tagged "wiener"
FrameSaver: q=2.1501e+06 n=885230 tag=wiener
5022 hits in TPC 0
5191 hits in TPC 1
8080 hits in TPC 2
3984 hits in TPC 3
3449 hits in TPC 4
4174 hits in TPC 5
6520 hits in TPC 6
3830 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 5947 XUs and 7364 XVs -> 643 XUVs
C:0 T:2 32729 XUs and 32549 XVs -> 3879 XUVs
C:0 T:3 765 XUs and 786 XVs -> 30 XUVs
C:0 T:4 64 XUs and 87 XVs -> 3 XUVs
C:0 T:5 7531 XUs and 9927 XVs -> 302 XUVs
C:0 T:6 14429 XUs and 15357 XVs -> 1854 XUVs
C:0 T:7 306 XUs and 348 XVs -> 11 XUVs
6722 XUVs total
1657 collection wire objects
6722 potential space points
Neighbour search...
385786 tests to find 236878 neighbours
Iterating with no regularization...
Begin: 2.08391e+07
0 1.85303e+07
1 1.82888e+07
2 1.8239e+07
3 1.82215e+07
Now with regularization...
Begin: 1.67228e+07
0 1.67107e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:06:43 UTC Closed output file "np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup.root"
27-Sep-2024 16:06:43 UTC Closed input file "np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 48.7044 170.596 369.579 150.785 70.4481 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000615526 0.00305068 0.0148731 0.00255155 0.00261387 35
produce:fembfilter:PDHDFEMBFilter 0.662371 1.34316 2.61019 1.24704 0.347988 35
produce:wclsdatahd:WireCellToolkit 41.5954 46.5758 55.2457 44.8667 3.91851 35
produce:gaushit:GausHitFinder 0.604307 1.07735 1.67519 1.03824 0.274545 35
produce:nhitsfilter:NumberOfHitsFilter 0.000330277 0.000569039 0.000816807 0.000557216 0.000129401 35
produce:reco3d:SpacePointSolver 0.369517 2.46036 21.1132 1.5814 3.49467 34
produce:hitpdune:DisambigFromSpacePoints 0.460882 1.29616 3.03462 1.07959 0.705705 34
produce:pandora:StandardPandora 12.5627 58.2427 221.352 48.6153 45.0585 34
produce:pandoraWriter:StandardPandora 0.128289 0.243755 0.450285 0.234732 0.0693278 34
produce:pandoraTrack:LArPandoraTrackCreation 1.45737 5.07424 13.3042 4.35554 3.09809 34
produce:pandoraShower:LArPandoraShowerCreation 1.13686 5.05122 14.7287 4.20874 3.44867 34
produce:pandoracalo:Calorimetry 0.637149 1.98019 5.02472 1.60588 1.20326 34
produce:pandoracalonosce:Calorimetry 0.540428 1.87631 4.75399 1.50255 1.14327 34
produce:pandorapid:Chi2ParticleID 0.00158559 0.00275401 0.00569012 0.0027124 0.000820765 34
produce:pandoraShowercalo:ShowerCalorimetry 0.797121 3.9562 11.9325 2.94809 2.52029 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.789767 3.72039 10.6209 2.92676 2.30674 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0849436 0.155602 0.289796 0.147248 0.046408 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0323921 0.0577485 0.112702 0.0545178 0.0170803 34
produce:emtrkmichelid:EmTrackMichelId 20.7176 37.9794 59.9032 36.1755 10.0687 34
[art]:TriggerResults:TriggerResultInserter 1.82e-05 4.45498e-05 0.000108347 4.5094e-05 1.88967e-05 35
end_path:out1:RootOutput 7.514e-06 1.03162e-05 3.0158e-05 9.264e-06 4.05374e-06 35
end_path:michelremoving:michelremoving 3.2262e-05 0.072974 0.225532 0.0537504 0.0552629 35
end_path:michelremovinggnocchi:michelremoving 1.7331e-05 0.0682105 0.225165 0.0454754 0.0532383 35
end_path:calibanagnocchi:CalibAnaTree 1.2691e-05 1.51084 5.0972 1.24845 0.937695 35
end_path:out1:RootOutput(write) 0.434165 1.14248 2.45067 1.12567 0.428715 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5084.87 MB
Peak resident set size usage (VmHWM): 2732.54 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup.root
\tHists: np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727447098.0,
"core.end_time": 1727453204.0,
"core.events": [
5743,
5747,
5751,
5755,
5759,
5763,
5767,
5771,
5775,
5779,
5783,
5787,
5791,
5795,
5799,
5803,
5807,
5811,
5815,
5819,
5823,
5827,
5831,
5835,
5839,
5843,
5847,
5851,
5855,
5859,
5863,
5867,
5871,
5875,
5879
],
"core.event_count": 35,
"core.first_event_number": 5743,
"core.last_event_number": 5879,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27412
],
"core.runs_subruns": [
2741200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043_reco_stage1_reco_stage2_20240927T160643_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727447098.0,
"core.end_time": 1727453204.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27412
],
"core.runs_subruns": [
2741200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027412_0041_dataflow3_datawriter_0_20240625T041043.hdf5"
}
]
} 