Jobsub ID 80022.122@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80022.122@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3513 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:07:03 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:50:36 |
| From worker node | Hostname | mh-7662-13.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:51:27 |
| Input files | hd-protodune:np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4669s) |
| CPU time | 58m (3492s = 74%) |
| Outputting started | 2024-09-27 16:09:17 |
| Output files | |
| Finished | 2024-09-27 16:50:36 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
tagging trace set: wiener with 65151 traces, 65151 summary
Retagger: tagging trace set: gauss with 50605 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 50605 traces tagged "gauss"
FrameSaver: q=1.83146e+06 n=931330 tag=gauss
wclsFrameSaver: saving 65151 traces tagged "wiener"
FrameSaver: q=1.97433e+06 n=844856 tag=wiener
5218 hits in TPC 0
4115 hits in TPC 1
7259 hits in TPC 2
6679 hits in TPC 3
2755 hits in TPC 4
5612 hits in TPC 5
4247 hits in TPC 6
2375 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 17432 XUs and 10201 XVs -> 1326 XUVs
C:0 T:2 46024 XUs and 49974 XVs -> 1967 XUVs
C:0 T:3 952 XUs and 1106 XVs -> 43 XUVs
C:0 T:4 99 XUs and 124 XVs -> 3 XUVs
C:0 T:5 39399 XUs and 23126 XVs -> 1258 XUVs
C:0 T:6 14113 XUs and 18190 XVs -> 620 XUVs
C:0 T:7 142 XUs and 168 XVs -> 0 XUVs
5217 XUVs total
1876 collection wire objects
5217 potential space points
Neighbour search...
291463 tests to find 154600 neighbours
Iterating with no regularization...
Begin: 3.47004e+07
0 3.16836e+07
1 3.15323e+07
2 3.15143e+07
Now with regularization...
Begin: 2.98929e+07
0 2.98855e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:09:09 PDT Closed output file "np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup.root"
27-Sep-2024 09:09:09 PDT Closed input file "np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.2696 78.0939 97.3579 78.6152 9.87848 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000434197 0.00191719 0.00402043 0.00216899 0.000960523 35
produce:fembfilter:PDHDFEMBFilter 0.573214 0.591875 0.634297 0.589885 0.014144 35
produce:wclsdatahd:WireCellToolkit 27.3529 29.1904 30.4154 29.1849 0.599098 35
produce:gaushit:GausHitFinder 0.430869 0.68522 0.836555 0.695062 0.1005 35
produce:nhitsfilter:NumberOfHitsFilter 0.000246204 0.000357398 0.000541419 0.000357257 5.57571e-05 35
produce:reco3d:SpacePointSolver 0.226116 0.903157 2.65282 0.798858 0.576422 35
produce:hitpdune:DisambigFromSpacePoints 0.251181 0.497523 0.832425 0.479481 0.136431 35
produce:pandora:StandardPandora 6.80324 14.9393 28.5404 13.9052 5.27423 35
produce:pandoraWriter:StandardPandora 0.0893494 0.138361 0.183225 0.137037 0.022925 35
produce:pandoraTrack:LArPandoraTrackCreation 0.576885 1.17523 1.83785 1.16203 0.293059 35
produce:pandoraShower:LArPandoraShowerCreation 0.505026 1.33161 2.50577 1.36699 0.396762 35
produce:pandoracalo:Calorimetry 0.28872 0.577511 0.836538 0.597768 0.126005 35
produce:pandoracalonosce:Calorimetry 0.255919 0.530037 0.76622 0.536858 0.117865 35
produce:pandorapid:Chi2ParticleID 0.00132096 0.00172905 0.00301563 0.00168463 0.000296506 35
produce:pandoraShowercalo:ShowerCalorimetry 0.430722 1.19289 2.09555 1.18437 0.34161 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.426428 1.14445 1.99774 1.1331 0.324789 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0786787 0.119066 0.149237 0.116512 0.0181417 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0247248 0.0405621 0.0551899 0.0403403 0.00653572 35
produce:emtrkmichelid:EmTrackMichelId 17.2676 23.629 29.9591 24.2044 3.23169 35
[art]:TriggerResults:TriggerResultInserter 1.497e-05 2.50621e-05 7.7352e-05 2.46e-05 1.01106e-05 35
end_path:out1:RootOutput 8.69e-06 1.19845e-05 2.6431e-05 1.1731e-05 2.84781e-06 35
end_path:michelremoving:michelremoving 0.0159467 0.0504176 0.158083 0.0243778 0.0441831 35
end_path:michelremovinggnocchi:michelremoving 0.0125398 0.0478976 0.152334 0.0213059 0.0439647 35
end_path:calibanagnocchi:CalibAnaTree 0.206505 0.446641 0.649477 0.458893 0.107914 35
end_path:out1:RootOutput(write) 0.546467 0.767736 1.0076 0.786549 0.111135 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5014.81 MB
Peak resident set size usage (VmHWM): 2679.71 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup.root
\tHists: np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450582.0,
"core.end_time": 1727453350.0,
"core.events": [
9108,
9112,
9116,
9120,
9124,
9128,
9132,
9136,
9140,
9144,
9148,
9152,
9156,
9160,
9164,
9168,
9172,
9176,
9180,
9184,
9188,
9192,
9196,
9200,
9204,
9208,
9212,
9216,
9220,
9224,
9228,
9232,
9236,
9240,
9244
],
"core.event_count": 35,
"core.first_event_number": 9108,
"core.last_event_number": 9244,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27365
],
"core.runs_subruns": [
2736500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459_reco_stage1_reco_stage2_20240927T160909_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450582.0,
"core.end_time": 1727453350.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27365
],
"core.runs_subruns": [
2736500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027365_0065_dataflow0_datawriter_0_20240622T024459.hdf5"
}
]
} 