Jobsub ID 79662.63@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79662.63@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3512 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 00:18:53 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:43:15 |
| From worker node | Hostname | mh-7662-17.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 04:42:06 |
| Input files | hd-protodune:np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217.hdf5
|
| Outputting started | 2024-09-27 16:27:39 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s
wclsFrameSaver: saving 61760 traces tagged "gauss"
FrameSaver: q=2.27918e+06 n=1071944 tag=gauss
wclsFrameSaver: saving 84958 traces tagged "wiener"
FrameSaver: q=2.47619e+06 n=951776 tag=wiener
5306 hits in TPC 0
5712 hits in TPC 1
6285 hits in TPC 2
4106 hits in TPC 3
6416 hits in TPC 4
9715 hits in TPC 5
5337 hits in TPC 6
3472 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 115 XUs and 40 XVs -> 2 XUVs
C:0 T:1 12344 XUs and 9166 XVs -> 310 XUVs
C:0 T:2 17883 XUs and 21719 XVs -> 1740 XUVs
C:0 T:3 34 XUs and 20 XVs -> 4 XUVs
C:0 T:4 134 XUs and 180 XVs -> 10 XUVs
C:0 T:5 74490 XUs and 70011 XVs -> 4248 XUVs
C:0 T:6 18054 XUs and 18065 XVs -> 420 XUVs
C:0 T:7 240 XUs and 257 XVs -> 8 XUVs
6742 XUVs total
2356 collection wire objects
6742 potential space points
Neighbour search...
409862 tests to find 137994 neighbours
Iterating with no regularization...
Begin: 2.92581e+07
0 2.42732e+07
1 2.38004e+07
2 2.37155e+07
3 2.36944e+07
Now with regularization...
Begin: 2.13648e+07
0 2.13525e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:27:28 PDT Closed output file "np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup.root"
27-Sep-2024 09:27:28 PDT Closed input file "np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 87.6192 160.895 249.916 157.557 38.0885 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000719666 0.00369769 0.00889507 0.00313543 0.00208506 35
produce:fembfilter:PDHDFEMBFilter 0.7487 0.921061 1.11767 0.878384 0.139494 35
produce:wclsdatahd:WireCellToolkit 38.3226 46.3314 61.698 44.4815 6.64055 35
produce:gaushit:GausHitFinder 0.634797 1.18166 1.94096 1.10497 0.285511 35
produce:nhitsfilter:NumberOfHitsFilter 0.000360785 0.000610715 0.000932781 0.000605028 0.00011357 35
produce:reco3d:SpacePointSolver 0.279959 2.03918 5.60516 1.59342 1.31816 35
produce:hitpdune:DisambigFromSpacePoints 0.306064 1.03974 2.03117 0.9353 0.457399 35
produce:pandora:StandardPandora 10.909 47.4598 97.8527 42.554 21.8887 35
produce:pandoraWriter:StandardPandora 0.168037 0.260903 0.393814 0.252675 0.0517168 35
produce:pandoraTrack:LArPandoraTrackCreation 1.0688 3.45173 8.56446 3.30371 1.51281 35
produce:pandoraShower:LArPandoraShowerCreation 0.937572 3.661 9.69505 2.97499 2.03422 35
produce:pandoracalo:Calorimetry 0.5246 1.6402 4.65613 1.36197 0.832549 35
produce:pandoracalonosce:Calorimetry 0.474947 1.49098 4.39681 1.27779 0.812883 35
produce:pandorapid:Chi2ParticleID 0.0018011 0.00337769 0.00734102 0.00320938 0.00108894 35
produce:pandoraShowercalo:ShowerCalorimetry 0.916599 3.09687 10.7782 2.48978 1.96356 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.925455 2.77768 6.02925 2.35422 1.36283 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.118175 0.199806 0.324509 0.187402 0.0505065 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0467876 0.0682868 0.109431 0.0649124 0.0149467 35
produce:emtrkmichelid:EmTrackMichelId 22.798 42.1934 61.722 41.6816 9.26603 35
[art]:TriggerResults:TriggerResultInserter 2.7793e-05 7.66004e-05 0.000143412 7.5905e-05 2.56125e-05 35
end_path:out1:RootOutput 8.476e-06 2.11289e-05 8.6995e-05 1.7363e-05 1.33e-05 35
end_path:michelremoving:michelremoving 0.0242679 0.100897 0.437077 0.0524039 0.101514 35
end_path:michelremovinggnocchi:michelremoving 0.0218918 0.0959863 0.431491 0.04871 0.100391 35
end_path:calibanagnocchi:CalibAnaTree 0.347405 1.31995 2.97187 1.10889 0.67549 35
end_path:out1:RootOutput(write) 0.872967 1.32835 2.34654 1.32263 0.296179 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5043.45 MB
Peak resident set size usage (VmHWM): 2677.83 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup.root
\tHists: np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727448758.0,
"core.end_time": 1727454448.0,
"core.events": [
83307,
83311,
83315,
83319,
83323,
83327,
83331,
83335,
83339,
83343,
83347,
83351,
83355,
83359,
83363,
83367,
83371,
83375,
83379,
83383,
83387,
83391,
83395,
83399,
83403,
83407,
83411,
83415,
83419,
83423,
83427,
83431,
83435,
83439,
83443
],
"core.event_count": 35,
"core.first_event_number": 83307,
"core.last_event_number": 83443,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217_reco_stage1_reco_stage2_20240927T162728_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727448758.0,
"core.end_time": 1727454448.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0595_dataflow3_datawriter_0_20240621T090217.hdf5"
}
]
} 