Jobsub ID 79889.18@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79889.18@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3519 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 07:01:38 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2024-09-27 16:28:28 |
| From worker node | Hostname | dunegli-3950101-0-fnpc23024.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 11:45:58 |
| Input files | hd-protodune:np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010.hdf5
|
| Outputting started | 2024-09-27 16:28:28 |
| Output files | |
| Finished | 2024-09-27 17:30:32 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s
wclsFrameSaver: saving 99359 traces tagged "wiener"
FrameSaver: q=3.30505e+06 n=1360368 tag=wiener
11522 hits in TPC 0
8982 hits in TPC 1
15749 hits in TPC 2
6663 hits in TPC 3
4911 hits in TPC 4
6748 hits in TPC 5
6846 hits in TPC 6
2983 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 53242 XUs and 40913 XVs -> 3313 XUVs
C:0 T:2 114916 XUs and 105285 XVs -> 4523 XUVs
C:0 T:3 795 XUs and 833 XVs -> 4 XUVs
C:0 T:4 680 XUs and 1219 XVs -> 38 XUVs
C:0 T:5 22713 XUs and 32475 XVs -> 1149 XUVs
C:0 T:6 47292 XUs and 62794 XVs -> 1947 XUVs
C:0 T:7 152 XUs and 330 XVs -> 4 XUVs
10978 XUVs total
3775 collection wire objects
10978 potential space points
Neighbour search...
612480 tests to find 275112 neighbours
Iterating with no regularization...
Begin: 7.67159e+07
0 6.76654e+07
1 6.69165e+07
2 6.68355e+07
3 6.68155e+07
Now with regularization...
Begin: 6.43182e+07
0 6.43039e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:28:23 UTC Closed output file "np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup.root"
27-Sep-2024 16:28:23 UTC Closed input file "np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 39.4893 82.1836 175.037 77.3711 27.7443 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000336863 0.00103083 0.00227697 0.000703762 0.000657558 35
produce:fembfilter:PDHDFEMBFilter 0.433047 0.444246 0.457467 0.444333 0.0055494 35
produce:wclsdatahd:WireCellToolkit 21.9171 22.7551 23.9968 22.8404 0.48397 35
produce:gaushit:GausHitFinder 0.27204 0.547044 0.787694 0.549605 0.127998 35
produce:nhitsfilter:NumberOfHitsFilter 0.000151388 0.000274503 0.000693042 0.000269044 8.88545e-05 35
produce:reco3d:SpacePointSolver 0.0985001 1.03196 2.99473 0.925871 0.691626 35
produce:hitpdune:DisambigFromSpacePoints 0.117509 0.611911 1.4368 0.605489 0.32307 35
produce:pandora:StandardPandora 3.3639 25.3756 97.5095 22.5787 18.8834 35
produce:pandoraWriter:StandardPandora 0.045185 0.103146 0.27214 0.0975995 0.0383352 35
produce:pandoraTrack:LArPandoraTrackCreation 0.362073 1.41089 3.64115 1.29473 0.713181 35
produce:pandoraShower:LArPandoraShowerCreation 0.341587 1.46612 3.49936 1.34874 0.696924 35
produce:pandoracalo:Calorimetry 0.203 0.782025 1.98291 0.713939 0.389473 35
produce:pandoracalonosce:Calorimetry 0.180554 0.742281 1.89065 0.674947 0.377706 35
produce:pandorapid:Chi2ParticleID 0.000745593 0.00147344 0.00228978 0.00145905 0.000381355 35
produce:pandoraShowercalo:ShowerCalorimetry 0.319685 1.51458 3.74902 1.43857 0.756099 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.311915 1.45167 3.63754 1.37657 0.730012 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0529794 0.0904895 0.134152 0.0925535 0.0178796 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0169512 0.0296598 0.0453395 0.0300349 0.00632105 35
produce:emtrkmichelid:EmTrackMichelId 10.9232 22.3881 32.3031 21.9044 5.20195 35
[art]:TriggerResults:TriggerResultInserter 1.1873e-05 1.69018e-05 6.5946e-05 1.544e-05 8.7575e-06 35
end_path:out1:RootOutput 3.036e-06 7.66494e-06 2.2804e-05 7.414e-06 2.89226e-06 35
end_path:michelremoving:michelremoving 0.00847887 0.0498851 0.276731 0.0187781 0.0596262 35
end_path:michelremovinggnocchi:michelremoving 0.00823811 0.0481744 0.273914 0.0167635 0.05954 35
end_path:calibanagnocchi:CalibAnaTree 0.129521 0.612089 1.50723 0.549637 0.312291 35
end_path:out1:RootOutput(write) 0.323004 0.656725 1.07738 0.658668 0.156796 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5060.41 MB
Peak resident set size usage (VmHWM): 2720.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup.root
\tHists: np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451604.0,
"core.end_time": 1727454503.0,
"core.events": [
2103,
2107,
2111,
2115,
2119,
2123,
2127,
2131,
2135,
2139,
2143,
2147,
2151,
2155,
2159,
2163,
2167,
2171,
2175,
2179,
2183,
2187,
2191,
2195,
2199,
2203,
2207,
2211,
2215,
2219,
2223,
2227,
2231,
2235,
2239
],
"core.event_count": 35,
"core.first_event_number": 2103,
"core.last_event_number": 2239,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27412
],
"core.runs_subruns": [
2741200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010_reco_stage1_reco_stage2_20240927T162823_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451604.0,
"core.end_time": 1727454503.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27412
],
"core.runs_subruns": [
2741200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027412_0015_dataflow3_datawriter_0_20240625T040010.hdf5"
}
]
} 