Jobsub ID 82998.138@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 82998.138@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3704 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-10-17 04:25:26 |
Site | US_FNAL-FermiGrid |
Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
Last heartbeat | 2024-10-17 13:29:11 |
From worker node | Hostname | dunegli-3968599-0-fnpc19129.fnal.gov |
cpuinfo | AMD EPYC 7502 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 172800 (48 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-10-17 11:29:05 |
Input files | hd-protodune:np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738.hdf5
|
Outputting started | 2024-10-17 13:21:05 |
Output files | |
Finished | 2024-10-17 14:25:27 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
r
3449 hits in TPC 0
3849 hits in TPC 1
4404 hits in TPC 2
3933 hits in TPC 3
2868 hits in TPC 4
4818 hits in TPC 5
8035 hits in TPC 6
3236 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 39 XUs and 33 XVs -> 1 XUVs
C:0 T:1 8968 XUs and 3484 XVs -> 248 XUVs
C:0 T:2 14775 XUs and 23899 XVs -> 1334 XUVs
C:0 T:3 139 XUs and 224 XVs -> 14 XUVs
C:0 T:4 124 XUs and 91 XVs -> 5 XUVs
C:0 T:5 11181 XUs and 8254 XVs -> 246 XUVs
C:0 T:6 33842 XUs and 31082 XVs -> 925 XUVs
C:0 T:7 854 XUs and 476 XVs -> 8 XUVs
2781 XUVs total
1377 collection wire objects
2781 potential space points
Neighbour search...
59549 tests to find 35880 neighbours
Iterating with no regularization...
Begin: 2.22789e+07
0 2.02323e+07
1 2.01138e+07
2 2.00932e+07
3 2.00876e+07
Now with regularization...
Begin: 1.82613e+07
0 1.82552e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 4618 TrkackID 7 startx, y, z 46.4706 590.803 197.534 wireno, peakt tpcno 376 2827.19 2 dist 419.584min T, max_T10.5985 2847.27
no of hits closeby 0 event 4618 TrkackID 7 startx, y, z 46.4706 590.803 197.534 wireno, peakt tpcno 376 2827.19 2 dist 419.584min T, max_T10.5985 2847.27
17-Oct-2024 13:20:58 UTC Closed output file "np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup.root"
17-Oct-2024 13:20:58 UTC Closed input file "np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 55.9988 86.7551 125.405 87.3055 17.3853 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000616396 0.00241968 0.00408162 0.00229343 0.00105217 35
produce:fembfilter:PDHDFEMBFilter 0.722729 0.857749 1.08341 0.818079 0.119048 35
produce:wclsdatahd:WireCellToolkit 28.2922 33.3809 44.8428 31.607 4.43517 35
produce:gaushit:GausHitFinder 0.334714 0.702198 1.2774 0.662969 0.210683 35
produce:nhitsfilter:NumberOfHitsFilter 0.000280983 0.000390472 0.000595236 0.000378013 8.37909e-05 35
produce:reco3d:SpacePointSolver 0.0733996 1.0125 6.0172 0.689767 1.05355 35
produce:hitpdune:DisambigFromSpacePoints 0.10094 0.534862 1.43953 0.517952 0.272738 35
produce:pandora:StandardPandora 4.04812 14.9258 29.5079 14.1717 6.28279 35
produce:pandoraWriter:StandardPandora 0.0556663 0.166865 0.25585 0.167704 0.0426475 35
produce:pandoraTrack:LArPandoraTrackCreation 0.29968 1.50926 2.95849 1.33998 0.646143 35
produce:pandoraShower:LArPandoraShowerCreation 0.276972 1.72082 4.43824 1.54802 0.913624 35
produce:pandoracalo:Calorimetry 0.174627 0.6933 1.38736 0.621255 0.282658 35
produce:pandoracalonosce:Calorimetry 0.15076 0.645593 1.45087 0.579514 0.286203 35
produce:pandorapid:Chi2ParticleID 0.000923709 0.00194763 0.00322297 0.00181402 0.000495521 35
produce:pandoraShowercalo:ShowerCalorimetry 0.254993 1.42934 3.67763 1.25529 0.752003 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.246018 1.33684 3.29748 1.20021 0.664322 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0551813 0.131554 0.261925 0.121762 0.0439452 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0180179 0.045519 0.0822497 0.0430678 0.0137533 35
produce:emtrkmichelid:EmTrackMichelId 16.1407 26.0332 40.1268 25.05 5.92858 35
[art]:TriggerResults:TriggerResultInserter 1.4001e-05 3.19035e-05 7.1211e-05 2.617e-05 1.46768e-05 35
end_path:out1:RootOutput 7.5e-06 1.17912e-05 2.9311e-05 1.037e-05 4.3407e-06 35
end_path:michelremoving:michelremoving 0.0156277 0.078485 0.331979 0.0271086 0.0808527 35
end_path:michelremovinggnocchi:michelremoving 0.0155138 0.0772798 0.331711 0.0267454 0.0806573 35
end_path:calibanagnocchi:CalibAnaTree 0.198944 0.497065 1.01854 0.455497 0.176139 35
end_path:out1:RootOutput(write) 0.362359 0.839307 1.19449 0.837603 0.181987 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4972.22 MB
Peak resident set size usage (VmHWM): 2628.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup.root
\tHists: np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729168180.0,
"core.end_time": 1729171258.0,
"core.events": [
4482,
4486,
4490,
4494,
4498,
4502,
4506,
4510,
4514,
4518,
4522,
4526,
4530,
4534,
4538,
4542,
4546,
4550,
4554,
4558,
4562,
4566,
4570,
4574,
4578,
4582,
4586,
4590,
4594,
4598,
4602,
4606,
4610,
4614,
4618
],
"core.event_count": 35,
"core.first_event_number": 4482,
"core.last_event_number": 4618,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27394
],
"core.runs_subruns": [
2739400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738_reco_stage1_reco_stage2_20241017T132058_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729168180.0,
"core.end_time": 1729171258.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27394
],
"core.runs_subruns": [
2739400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027394_0032_dataflow2_datawriter_0_20240623T164738.hdf5"
}
]
}