Jobsub ID 264819.173@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 264819.173@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3511 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-27 08:43:44 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2024-09-27 13:19:58 | |
| From worker node | Hostname | dunegli-35088-0-cmswn2324.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-27 09:45:07 | |
| Input files | hd-protodune:np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 3h (12778s) | |
| CPU time | 2h (7855s = 61%) | |
| Outputting started | 2024-09-27 13:18:06 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup.root hd-protodune-det-reco:np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup_hists.root | |
| Finished | 2024-09-27 13:19:58 | |
| Saved logs | justin-logs:264819.173-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
49e+06 n=888470 tag=gauss
wclsFrameSaver: saving 65699 traces tagged "wiener"
FrameSaver: q=1.94485e+06 n=804734 tag=wiener
4584 hits in TPC 0
3517 hits in TPC 1
2613 hits in TPC 2
1543 hits in TPC 3
4300 hits in TPC 4
6457 hits in TPC 5
7804 hits in TPC 6
5171 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 12 XUs and 25 XVs -> 3 XUVs
C:0 T:1 5325 XUs and 5755 XVs -> 159 XUVs
C:0 T:2 3831 XUs and 4300 XVs -> 299 XUVs
C:0 T:3 99 XUs and 117 XVs -> 5 XUVs
C:0 T:4 60 XUs and 35 XVs -> 2 XUVs
C:0 T:5 34876 XUs and 76789 XVs -> 4170 XUVs
C:0 T:6 27852 XUs and 30083 XVs -> 1167 XUVs
C:0 T:7 887 XUs and 950 XVs -> 17 XUVs
5822 XUVs total
2182 collection wire objects
5822 potential space points
Neighbour search...
410198 tests to find 193712 neighbours
Iterating with no regularization...
Begin: 3.16111e+07
0 2.74048e+07
1 2.71264e+07
2 2.70842e+07
3 2.70686e+07
Now with regularization...
Begin: 2.54429e+07
0 2.54332e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 13:17:48 UTC Closed output file "np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup.root"
27-Sep-2024 13:17:48 UTC Closed input file "np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 90.6072 195.413 455.209 195.448 63.216 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000696841 0.00365435 0.0192958 0.00333411 0.0032509 35
produce:fembfilter:PDHDFEMBFilter 0.788884 1.21817 2.01385 1.19828 0.218256 35
produce:wclsdatahd:WireCellToolkit 44.3923 55.8596 68.4284 53.7293 8.09081 35
produce:gaushit:GausHitFinder 0.700885 1.27486 1.91722 1.21981 0.266347 35
produce:nhitsfilter:NumberOfHitsFilter 0.000344893 0.000534086 0.000804897 0.000508186 0.000101567 35
produce:reco3d:SpacePointSolver 0.49838 2.38167 5.74776 2.09124 1.43578 35
produce:hitpdune:DisambigFromSpacePoints 0.335329 1.37332 2.92329 1.287 0.608297 35
produce:pandora:StandardPandora 11.3857 65.4926 285.911 58.0843 47.3941 35
produce:pandoraWriter:StandardPandora 0.143863 0.244333 0.357776 0.240604 0.0513333 35
produce:pandoraTrack:LArPandoraTrackCreation 1.52172 5.20826 14.7241 4.7913 2.70663 35
produce:pandoraShower:LArPandoraShowerCreation 1.80964 5.2541 10.797 4.69708 2.44665 35
produce:pandoracalo:Calorimetry 0.764792 2.20389 4.82255 1.98059 0.994276 35
produce:pandoracalonosce:Calorimetry 0.734859 2.08283 4.56766 1.81827 0.959965 35
produce:pandorapid:Chi2ParticleID 0.0017708 0.00306611 0.00430333 0.00309109 0.000618895 35
produce:pandoraShowercalo:ShowerCalorimetry 1.606 4.25128 8.74659 3.65011 1.94033 35
produce:pandoraShowercalonosce:ShowerCalorimetry 1.49301 4.07908 8.94395 3.51286 2.01106 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.118189 0.18432 0.247098 0.182299 0.0319352 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0405343 0.0640636 0.0897469 0.0637518 0.0112259 35
produce:emtrkmichelid:EmTrackMichelId 22.1433 41.063 56.0285 40.4265 7.74971 35
[art]:TriggerResults:TriggerResultInserter 2.7528e-05 4.7881e-05 8.386e-05 4.6275e-05 1.09867e-05 35
end_path:out1:RootOutput 8.043e-06 1.17673e-05 2.9778e-05 1.0772e-05 3.90069e-06 35
end_path:michelremoving:michelremoving 0.0309124 0.0816975 0.378013 0.0507917 0.0789741 35
end_path:michelremovinggnocchi:michelremoving 0.0282048 0.0716162 0.382895 0.0462855 0.0735166 35
end_path:calibanagnocchi:CalibAnaTree 0.587915 1.65878 4.27853 1.39971 0.858525 35
end_path:out1:RootOutput(write) 0.673694 1.17965 1.65807 1.1692 0.225807 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5085.49 MB
Peak resident set size usage (VmHWM): 2719.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup.root
\tHists: np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727436176.0,
"core.end_time": 1727443069.0,
"core.events": [
17081,
17085,
17089,
17093,
17097,
17101,
17105,
17109,
17113,
17117,
17121,
17125,
17129,
17133,
17137,
17141,
17145,
17149,
17153,
17157,
17161,
17165,
17169,
17173,
17177,
17181,
17185,
17189,
17193,
17197,
17201,
17205,
17209,
17213,
17217
],
"core.event_count": 35,
"core.first_event_number": 17081,
"core.last_event_number": 17217,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208_reco_stage1_reco_stage2_20240927T131748_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727436176.0,
"core.end_time": 1727443069.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0122_dataflow1_datawriter_0_20240620T232208.hdf5"
}
]
}