Jobsub ID 264478.105@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 264478.105@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3510 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 22:22:55 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 08:36:20 |
| From worker node | Hostname | mh-7763-5.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 01:36:39 |
| Input files | hd-protodune:np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858.hdf5
|
| Outputting started | 2024-09-27 08:29:44 |
| Output files | |
| Finished | 2024-09-27 08:36:20 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
trace set: gauss with 61210 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61210 traces tagged "gauss"
FrameSaver: q=2.2348e+06 n=1119005 tag=gauss
wclsFrameSaver: saving 78438 traces tagged "wiener"
FrameSaver: q=2.47294e+06 n=1022470 tag=wiener
11758 hits in TPC 0
9116 hits in TPC 1
5540 hits in TPC 2
4186 hits in TPC 3
3958 hits in TPC 4
6853 hits in TPC 5
4112 hits in TPC 6
1965 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 61164 XUs and 49643 XVs -> 5486 XUVs
C:0 T:2 14333 XUs and 22419 XVs -> 813 XUVs
C:0 T:3 148 XUs and 173 XVs -> 4 XUVs
C:0 T:4 593 XUs and 479 XVs -> 11 XUVs
C:0 T:5 33782 XUs and 22305 XVs -> 606 XUVs
C:0 T:6 11465 XUs and 18902 XVs -> 470 XUVs
C:0 T:7 47 XUs and 84 XVs -> 5 XUVs
7395 XUVs total
1943 collection wire objects
7395 potential space points
Neighbour search...
553369 tests to find 252976 neighbours
Iterating with no regularization...
Begin: 6.89991e+07
0 6.63979e+07
1 6.61419e+07
2 6.61366e+07
Now with regularization...
Begin: 6.50493e+07
0 6.50478e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 01:29:35 PDT Closed output file "np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup.root"
27-Sep-2024 01:29:35 PDT Closed input file "np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 44.3774 91.4989 156.573 92.6812 24.3208 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000367909 0.00176883 0.00399552 0.00146741 0.00099109 35
produce:fembfilter:PDHDFEMBFilter 0.534267 0.592463 0.868707 0.563195 0.0797605 35
produce:wclsdatahd:WireCellToolkit 26.2318 29.1165 39.2539 28.8743 2.18238 35
produce:gaushit:GausHitFinder 0.265097 0.643835 0.930145 0.664435 0.167629 35
produce:nhitsfilter:NumberOfHitsFilter 0.00017724 0.000307371 0.000557068 0.000299429 7.06958e-05 35
produce:reco3d:SpacePointSolver 0.159305 1.00457 3.85247 0.829522 0.732776 35
produce:hitpdune:DisambigFromSpacePoints 0.0863824 0.576677 1.64689 0.56171 0.309338 35
produce:pandora:StandardPandora 2.6417 21.8353 53.1376 21.6517 12.6719 35
produce:pandoraWriter:StandardPandora 0.0641639 0.13974 0.23471 0.136838 0.0427496 35
produce:pandoraTrack:LArPandoraTrackCreation 0.328752 1.68671 3.75118 1.43319 0.859097 35
produce:pandoraShower:LArPandoraShowerCreation 0.235863 1.63512 4.19309 1.41252 0.892107 35
produce:pandoracalo:Calorimetry 0.180133 0.844553 1.77035 0.701659 0.406827 35
produce:pandoracalonosce:Calorimetry 0.162338 0.793041 1.6698 0.668462 0.381627 35
produce:pandorapid:Chi2ParticleID 0.000948956 0.00186159 0.00353431 0.00174823 0.000505894 35
produce:pandoraShowercalo:ShowerCalorimetry 0.197171 1.56288 3.74574 1.37379 0.859805 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.189168 1.45722 3.47039 1.28894 0.794135 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0371103 0.103349 0.224592 0.0958121 0.0332181 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0132697 0.0349025 0.0718392 0.0330432 0.010843 35
produce:emtrkmichelid:EmTrackMichelId 11.5401 27.8204 46.3355 28.3842 7.29717 35
[art]:TriggerResults:TriggerResultInserter 1.766e-05 3.03037e-05 8.229e-05 2.5931e-05 1.19096e-05 35
end_path:out1:RootOutput 3.59e-06 5.30166e-06 2.425e-05 4.5e-06 3.35274e-06 35
end_path:michelremoving:michelremoving 0.00783945 0.0468866 0.232608 0.0268304 0.0477902 35
end_path:michelremovinggnocchi:michelremoving 0.00745168 0.043755 0.207499 0.021916 0.0467539 35
end_path:calibanagnocchi:CalibAnaTree 0.125123 0.666697 1.67627 0.562126 0.34884 35
end_path:out1:RootOutput(write) 0.341635 0.765193 1.64375 0.762506 0.25392 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5083.13 MB
Peak resident set size usage (VmHWM): 2704.99 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup.root
\tHists: np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727422539.0,
"core.end_time": 1727425775.0,
"core.events": [
3528,
3532,
3536,
3540,
3544,
3548,
3552,
3556,
3560,
3564,
3568,
3572,
3576,
3580,
3584,
3588,
3592,
3596,
3600,
3604,
3608,
3612,
3616,
3620,
3624,
3628,
3632,
3636,
3640,
3644,
3648,
3652,
3656,
3660,
3664
],
"core.event_count": 35,
"core.first_event_number": 3528,
"core.last_event_number": 3664,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27314
],
"core.runs_subruns": [
2731400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858_reco_stage1_reco_stage2_20240927T082935_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727422539.0,
"core.end_time": 1727425775.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27314
],
"core.runs_subruns": [
2731400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027314_0025_dataflow0_datawriter_0_20240620T090858.hdf5"
}
]
} 