Jobsub ID 79658.116@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79658.116@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3512 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 00:09:43 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2024-09-27 16:54:53 |
| From worker node | Hostname | dunegli-3950716-0-fnpc23018.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 04:30:42 |
| Input files | hd-protodune:np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402.hdf5
|
| Outputting started | 2024-09-27 16:16:00 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
88 traces tagged "wiener"
FrameSaver: q=2.70052e+06 n=1088868 tag=wiener
4156 hits in TPC 0
4245 hits in TPC 1
9139 hits in TPC 2
3806 hits in TPC 3
5425 hits in TPC 4
7132 hits in TPC 5
9351 hits in TPC 6
7788 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3342 XUs and 2112 XVs -> 127 XUVs
C:0 T:2 29839 XUs and 31801 XVs -> 805 XUVs
C:0 T:3 130 XUs and 84 XVs -> 2 XUVs
C:0 T:4 552 XUs and 686 XVs -> 18 XUVs
C:0 T:5 22457 XUs and 27188 XVs -> 1503 XUVs
C:0 T:6 41026 XUs and 54103 XVs -> 5041 XUVs
C:0 T:7 1591 XUs and 2001 XVs -> 38 XUVs
7534 XUVs total
2305 collection wire objects
7534 potential space points
Neighbour search...
515558 tests to find 305400 neighbours
Iterating with no regularization...
Begin: 5.52291e+07
0 5.04431e+07
1 4.99478e+07
2 4.98491e+07
3 4.98185e+07
Now with regularization...
Begin: 4.65683e+07
0 4.65473e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:15:54 UTC Closed output file "np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup.root"
27-Sep-2024 16:15:54 UTC Closed input file "np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 42.4499 65.3991 104.907 65.4499 14.1384 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000262502 0.000989317 0.00204453 0.00089456 0.000460903 35
produce:fembfilter:PDHDFEMBFilter 0.441764 0.540798 0.67598 0.461401 0.098496 35
produce:wclsdatahd:WireCellToolkit 22.2319 25.112 32.0502 23.2268 3.54826 35
produce:gaushit:GausHitFinder 0.266607 0.526053 0.860997 0.529588 0.147468 35
produce:nhitsfilter:NumberOfHitsFilter 0.000170837 0.0002398 0.000428289 0.000231843 5.15233e-05 35
produce:reco3d:SpacePointSolver 0.129835 0.554383 1.64899 0.480945 0.375897 35
produce:hitpdune:DisambigFromSpacePoints 0.138701 0.43621 1.16002 0.366937 0.236421 35
produce:pandora:StandardPandora 4.07295 10.7884 24.1838 10.0279 5.06711 35
produce:pandoraWriter:StandardPandora 0.0509355 0.0982879 0.224609 0.0970234 0.0360304 35
produce:pandoraTrack:LArPandoraTrackCreation 0.344109 0.886352 1.93394 0.818955 0.343329 35
produce:pandoraShower:LArPandoraShowerCreation 0.37294 1.07728 2.75315 1.08854 0.491633 35
produce:pandoracalo:Calorimetry 0.187266 0.486547 0.941173 0.453072 0.174692 35
produce:pandoracalonosce:Calorimetry 0.170119 0.449972 0.875563 0.416566 0.16482 35
produce:pandorapid:Chi2ParticleID 0.000830798 0.00138216 0.00287451 0.00129541 0.000436959 35
produce:pandoraShowercalo:ShowerCalorimetry 0.342903 1.05743 2.46646 1.07294 0.471316 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.327927 1.01726 2.31117 1.02828 0.449997 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0428108 0.0936242 0.176273 0.0889895 0.0284685 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0141868 0.031168 0.0600336 0.0297523 0.00953692 35
produce:emtrkmichelid:EmTrackMichelId 11.4085 21.0656 32.6364 21.0147 5.31228 35
[art]:TriggerResults:TriggerResultInserter 1.2614e-05 1.90456e-05 5.1438e-05 1.6582e-05 7.97727e-06 35
end_path:out1:RootOutput 5.641e-06 8.83717e-06 1.9487e-05 8.517e-06 2.2002e-06 35
end_path:michelremoving:michelremoving 0.0107902 0.0664205 0.274774 0.0195617 0.0776883 35
end_path:michelremovinggnocchi:michelremoving 0.0102936 0.0650289 0.269341 0.0180425 0.0772402 35
end_path:calibanagnocchi:CalibAnaTree 0.141467 0.381842 0.709892 0.373209 0.13889 35
end_path:out1:RootOutput(write) 0.318901 0.602219 0.872865 0.622265 0.13868 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5000.33 MB
Peak resident set size usage (VmHWM): 2670.25 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup.root
\tHists: np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451442.0,
"core.end_time": 1727453755.0,
"core.events": [
26912,
26916,
26920,
26924,
26928,
26932,
26936,
26940,
26944,
26948,
26952,
26956,
26960,
26964,
26968,
26972,
26976,
26980,
26984,
26988,
26992,
26996,
27000,
27004,
27008,
27012,
27016,
27020,
27024,
27028,
27032,
27036,
27040,
27044,
27048
],
"core.event_count": 35,
"core.first_event_number": 26912,
"core.last_event_number": 27048,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27338
],
"core.runs_subruns": [
2733800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402_reco_stage1_reco_stage2_20240927T161554_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451442.0,
"core.end_time": 1727453755.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27338
],
"core.runs_subruns": [
2733800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027338_0192_dataflow0_datawriter_0_20240621T121402.hdf5"
}
]
} 