Jobsub ID 80051.38@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80051.38@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3493 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:24:02 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:41:37 |
| From worker node | Hostname | mh-7662-2.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:31:27 |
| Input files | hd-protodune:np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514.hdf5
|
| Outputting started | 2024-09-27 16:09:50 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
5
8781 hits in TPC 6
5677 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9587 XUs and 6302 XVs -> 119 XUVs
C:0 T:2 65216 XUs and 79656 XVs -> 2333 XUVs
C:0 T:3 375 XUs and 330 XVs -> 10 XUVs
C:0 T:4 246 XUs and 148 XVs -> 9 XUVs
C:0 T:5 19536 XUs and 19080 XVs -> 250 XUVs
C:0 T:6 70409 XUs and 84021 XVs -> 2906 XUVs
C:0 T:7 1643 XUs and 1343 XVs -> 51 XUVs
5678 XUVs total
2096 collection wire objects
5678 potential space points
Neighbour search...
320570 tests to find 173258 neighbours
Iterating with no regularization...
Begin: 3.24969e+07
0 2.9699e+07
1 2.95674e+07
2 2.95505e+07
Now with regularization...
Begin: 2.7888e+07
0 2.78805e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 1403 TrkackID 7 startx, y, z 244.043 492.334 460.744 wireno, peakt tpcno 256 3964.49 6 dist 298.927min T, max_T913.201 3988.92
no of hits closeby 0 event 1403 TrkackID 7 startx, y, z 244.043 492.334 460.744 wireno, peakt tpcno 256 3964.49 6 dist 298.927min T, max_T913.201 3988.92
27-Sep-2024 09:09:42 PDT Closed output file "np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup.root"
27-Sep-2024 09:09:42 PDT Closed input file "np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 61.0534 108.957 236.902 108.31 30.7053 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000549423 0.00243688 0.00602532 0.00203127 0.0014735 35
produce:fembfilter:PDHDFEMBFilter 0.585809 0.673663 0.717086 0.675407 0.0253096 35
produce:wclsdatahd:WireCellToolkit 30.7801 33.2707 35.8024 33.351 1.17506 35
produce:gaushit:GausHitFinder 0.470544 0.792035 1.27189 0.761839 0.161801 35
produce:nhitsfilter:NumberOfHitsFilter 0.000321808 0.000454158 0.000723597 0.000450131 7.85981e-05 35
produce:reco3d:SpacePointSolver 0.397198 1.44183 4.07847 1.09691 0.944926 35
produce:hitpdune:DisambigFromSpacePoints 0.253561 0.725273 1.61254 0.638393 0.304029 35
produce:pandora:StandardPandora 7.5166 29.8734 125.748 27.3525 19.8545 35
produce:pandoraWriter:StandardPandora 0.0921184 0.190513 0.270757 0.187483 0.0415609 35
produce:pandoraTrack:LArPandoraTrackCreation 0.473425 2.21621 4.84109 1.99485 0.999769 35
produce:pandoraShower:LArPandoraShowerCreation 0.578904 2.16393 4.83136 1.82517 1.05011 35
produce:pandoracalo:Calorimetry 0.263849 0.998484 2.05158 0.906763 0.419813 35
produce:pandoracalonosce:Calorimetry 0.223539 0.947559 1.95361 0.803283 0.417835 35
produce:pandorapid:Chi2ParticleID 0.0016283 0.00230785 0.00367164 0.00223277 0.000467539 35
produce:pandoraShowercalo:ShowerCalorimetry 0.470363 1.93495 4.85788 1.58167 1.05942 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.462054 1.88597 5.24337 1.48104 1.06538 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0904283 0.144406 0.208009 0.135125 0.027097 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0276774 0.0513247 0.0780591 0.048078 0.0106366 35
produce:emtrkmichelid:EmTrackMichelId 15.7615 29.6314 44.3329 29.2411 5.89866 35
[art]:TriggerResults:TriggerResultInserter 1.617e-05 3.35907e-05 9.8443e-05 2.8011e-05 1.5695e-05 35
end_path:out1:RootOutput 7.86e-06 9.736e-06 3.0021e-05 8.85e-06 3.81039e-06 35
end_path:michelremoving:michelremoving 0.0220776 0.0611997 0.237782 0.0328845 0.0544014 35
end_path:michelremovinggnocchi:michelremoving 0.0160003 0.0569851 0.241348 0.028081 0.0548243 35
end_path:calibanagnocchi:CalibAnaTree 0.208225 0.780117 1.9298 0.687984 0.354578 35
end_path:out1:RootOutput(write) 0.524463 0.976861 1.52708 0.947139 0.207822 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5050.44 MB
Peak resident set size usage (VmHWM): 2699.06 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup.root
\tHists: np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449528.0,
"core.end_time": 1727453382.0,
"core.events": [
1267,
1271,
1275,
1279,
1283,
1287,
1291,
1295,
1299,
1303,
1307,
1311,
1315,
1319,
1323,
1327,
1331,
1335,
1339,
1343,
1347,
1351,
1355,
1359,
1363,
1367,
1371,
1375,
1379,
1383,
1387,
1391,
1395,
1399,
1403
],
"core.event_count": 35,
"core.first_event_number": 1267,
"core.last_event_number": 1403,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514_reco_stage1_reco_stage2_20240927T160942_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449528.0,
"core.end_time": 1727453382.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0009_dataflow3_datawriter_0_20240620T044514.hdf5"
}
]
} 