Jobsub ID 80417.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80417.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 3514 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-27 18:41:13 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw7 | |
| Last heartbeat | 2024-09-27 20:23:17 | |
| From worker node | Hostname | mh-7662-17.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-27 18:42:42 | |
| Input files | hd-protodune:np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5955s) | |
| CPU time | 1h (4599s = 77%) | |
| Outputting started | 2024-09-27 20:21:59 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup.root hd-protodune-det-reco:np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup_hists.root | |
| Finished | 2024-09-27 20:23:17 | |
| Saved logs | justin-logs:80417.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
es, 114736 summary
Retagger: tagging trace set: gauss with 86519 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 86519 traces tagged "gauss"
FrameSaver: q=3.20074e+06 n=1546534 tag=gauss
wclsFrameSaver: saving 114736 traces tagged "wiener"
FrameSaver: q=3.5356e+06 n=1394805 tag=wiener
6627 hits in TPC 0
5758 hits in TPC 1
16771 hits in TPC 2
6074 hits in TPC 3
9429 hits in TPC 4
12129 hits in TPC 5
8346 hits in TPC 6
4277 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7729 XUs and 6422 XVs -> 308 XUVs
C:0 T:2 161171 XUs and 203491 XVs -> 9345 XUVs
C:0 T:3 2115 XUs and 2828 XVs -> 41 XUVs
C:0 T:4 90 XUs and 105 XVs -> 2 XUVs
C:0 T:5 218200 XUs and 162197 XVs -> 10387 XUVs
C:0 T:6 68029 XUs and 100242 XVs -> 1880 XUVs
C:0 T:7 171 XUs and 132 XVs -> 8 XUVs
21971 XUVs total
5712 collection wire objects
21971 potential space points
Neighbour search...
2573601 tests to find 811552 neighbours
Iterating with no regularization...
Begin: 1.05921e+08
0 7.90406e+07
1 7.66712e+07
2 7.63569e+07
3 7.62683e+07
4 7.62324e+07
Now with regularization...
Begin: 7.24566e+07
0 7.24067e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 13:21:50 PDT Closed output file "np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup.root"
27-Sep-2024 13:21:50 PDT Closed input file "np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.2948 109.876 228.329 97.0116 40.4817 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00050058 0.00215382 0.0042481 0.00242566 0.00104427 35
produce:fembfilter:PDHDFEMBFilter 0.569036 0.591188 0.698699 0.588225 0.0231052 35
produce:wclsdatahd:WireCellToolkit 27.8306 29.8712 33.5668 29.7203 1.1852 35
produce:gaushit:GausHitFinder 0.455574 0.823081 1.27071 0.797083 0.189152 35
produce:nhitsfilter:NumberOfHitsFilter 0.00024799 0.000425895 0.00067447 0.000429986 9.26048e-05 35
produce:reco3d:SpacePointSolver 0.191228 1.46234 6.05547 1.05483 1.25645 35
produce:hitpdune:DisambigFromSpacePoints 0.196919 0.733711 1.73624 0.641773 0.376195 35
produce:pandora:StandardPandora 8.78173 35.6843 122.399 28.0753 26.9163 35
produce:pandoraWriter:StandardPandora 0.0820437 0.17243 0.280868 0.171676 0.0452983 35
produce:pandoraTrack:LArPandoraTrackCreation 0.644811 2.16157 6.78027 1.75212 1.34392 35
produce:pandoraShower:LArPandoraShowerCreation 0.573522 2.09599 7.09119 1.64092 1.37001 35
produce:pandoracalo:Calorimetry 0.335555 0.978188 2.63311 0.821369 0.520286 35
produce:pandoracalonosce:Calorimetry 0.303506 0.919525 2.50588 0.762891 0.501447 35
produce:pandorapid:Chi2ParticleID 0.00144217 0.00222158 0.00469799 0.00205178 0.000707962 35
produce:pandoraShowercalo:ShowerCalorimetry 0.527843 1.81904 5.32739 1.46806 1.06566 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.504631 1.73813 5.08626 1.37877 1.01332 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0726596 0.128887 0.196391 0.125655 0.0297876 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0242737 0.0445484 0.0695348 0.044484 0.010284 35
produce:emtrkmichelid:EmTrackMichelId 15.654 28.7217 45.5043 28.031 6.61657 35
[art]:TriggerResults:TriggerResultInserter 1.7443e-05 2.63182e-05 8.2547e-05 2.4827e-05 1.08237e-05 35
end_path:out1:RootOutput 7.274e-06 1.06962e-05 3.9424e-05 9.628e-06 5.91885e-06 35
end_path:michelremoving:michelremoving 0.0132638 0.0683001 0.223054 0.0299047 0.0606544 35
end_path:michelremovinggnocchi:michelremoving 0.0126054 0.0650399 0.221681 0.0263193 0.0602493 35
end_path:calibanagnocchi:CalibAnaTree 0.309772 0.768138 2.06252 0.633816 0.417185 35
end_path:out1:RootOutput(write) 0.49661 0.899276 1.45273 0.867548 0.21524 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5132.89 MB
Peak resident set size usage (VmHWM): 2722.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup.root
\tHists: np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727464629.0,
"core.end_time": 1727468511.0,
"core.events": [
8839,
8843,
8847,
8851,
8855,
8859,
8863,
8867,
8871,
8875,
8879,
8883,
8887,
8891,
8895,
8899,
8903,
8907,
8911,
8915,
8919,
8923,
8927,
8931,
8935,
8939,
8943,
8947,
8951,
8955,
8959,
8963,
8967,
8971,
8975
],
"core.event_count": 35,
"core.first_event_number": 8839,
"core.last_event_number": 8975,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27377
],
"core.runs_subruns": [
2737700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957_reco_stage1_reco_stage2_20240927T202150_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727464629.0,
"core.end_time": 1727468511.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27377
],
"core.runs_subruns": [
2737700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027377_0063_dataflow3_datawriter_0_20240622T090957.hdf5"
}
]
}