Jobsub ID 77766.186@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 77766.186@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3450 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-25 23:56:09 |
Site | UK_Durham |
Entry | DUNE_UK_SGridDurham_ce3 |
Last heartbeat | 2024-09-26 05:15:39 |
From worker node | Hostname | n244.dur.scotgrid.ac.uk |
cpuinfo | AMD EPYC 7763 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 03:13:27 |
Input files | hd-protodune:np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520.hdf5
|
Outputting started | 2024-09-26 04:39:28 |
Output files | |
Finished | 2024-09-26 05:15:39 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ing as is
Retagger: tagging trace set: wiener with 54321 traces, 54321 summary
Retagger: tagging trace set: gauss with 40819 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40819 traces tagged "gauss"
FrameSaver: q=850559 n=754419 tag=gauss
wclsFrameSaver: saving 54321 traces tagged "wiener"
FrameSaver: q=915696 n=680200 tag=wiener
4151 hits in TPC 0
2998 hits in TPC 1
2045 hits in TPC 2
1882 hits in TPC 3
3776 hits in TPC 4
4823 hits in TPC 5
5568 hits in TPC 6
2486 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 146 XUs and 97 XVs -> 9 XUVs
C:0 T:2 8692 XUs and 13701 XVs -> 797 XUVs
C:0 T:3 35 XUs and 45 XVs -> 4 XUVs
C:0 T:4 131 XUs and 202 XVs -> 5 XUVs
C:0 T:5 14523 XUs and 22642 XVs -> 1018 XUVs
C:0 T:6 31790 XUs and 36765 XVs -> 1122 XUVs
C:0 T:7 334 XUs and 214 XVs -> 17 XUVs
2972 XUVs total
1330 collection wire objects
2972 potential space points
Neighbour search...
157698 tests to find 80592 neighbours
Iterating with no regularization...
Begin: 6.67984e+06
0 5.91915e+06
1 5.88001e+06
2 5.87557e+06
Now with regularization...
Begin: 5.4971e+06
0 5.49551e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 05:39:20 BST Closed output file "np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup.root"
26-Sep-2024 05:39:20 BST Closed input file "np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 46.2322 65.9284 100.026 63.1358 12.9997 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00047662 0.00154214 0.00297586 0.00154382 0.000651725 30
produce:fembfilter:PDHDFEMBFilter 0.487888 0.532094 0.736436 0.518942 0.0558183 30
produce:wclsdatahd:WireCellToolkit 26.9219 28.8816 31.9255 28.6739 1.11082 30
produce:gaushit:GausHitFinder 0.246308 0.473064 0.751833 0.445028 0.125847 30
produce:nhitsfilter:NumberOfHitsFilter 0.000191442 0.000267122 0.000404685 0.000245649 5.92862e-05 30
produce:reco3d:SpacePointSolver 0.108507 0.664362 2.58064 0.451863 0.575745 30
produce:hitpdune:DisambigFromSpacePoints 0.104086 0.330269 0.911845 0.264652 0.210639 30
produce:pandora:StandardPandora 2.82762 8.25251 18.4305 7.09609 4.16533 30
produce:pandoraWriter:StandardPandora 0.0476466 0.110014 0.199321 0.10133 0.0354257 30
produce:pandoraTrack:LArPandoraTrackCreation 0.219386 0.765506 2.12029 0.670301 0.377265 30
produce:pandoraShower:LArPandoraShowerCreation 0.195845 0.964961 3.00227 0.838163 0.567212 30
produce:pandoracalo:Calorimetry 0.140854 0.436831 1.15283 0.384832 0.199918 30
produce:pandoracalonosce:Calorimetry 0.11152 0.39718 1.08218 0.349579 0.189987 30
produce:pandorapid:Chi2ParticleID 0.000897606 0.00140482 0.00252479 0.00130299 0.000351273 30
produce:pandoraShowercalo:ShowerCalorimetry 0.186792 0.941899 3.09101 0.860778 0.56854 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.180591 0.909702 2.91675 0.841451 0.538372 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0556428 0.0978933 0.178113 0.0939494 0.0272453 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.018536 0.034798 0.064954 0.0320072 0.0102076 30
produce:emtrkmichelid:EmTrackMichelId 11.6003 20.9511 34.1409 20.5751 5.44494 30
[art]:TriggerResults:TriggerResultInserter 1.6371e-05 2.46139e-05 8.4259e-05 2.0734e-05 1.24383e-05 30
end_path:out1:RootOutput 7.354e-06 9.7582e-06 2.8454e-05 8.887e-06 3.66526e-06 30
end_path:michelremoving:michelremoving 0.0114398 0.0663738 0.296813 0.0240217 0.077952 30
end_path:michelremovinggnocchi:michelremoving 0.0103747 0.0645661 0.295436 0.0220339 0.0774163 30
end_path:calibanagnocchi:CalibAnaTree 0.091057 0.345344 0.820661 0.320001 0.15844 30
end_path:out1:RootOutput(write) 0.34033 0.623319 1.01738 0.610663 0.17389 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4929.3 MB
Peak resident set size usage (VmHWM): 2600.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup.root
\tHists: np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727323542.0,
"core.end_time": 1727325560.0,
"core.events": [
325438,
325478,
325486,
325494,
325502,
325510,
325518,
325526,
325534,
325542,
325550,
325558,
325566,
325574,
325582,
325590,
325598,
325606,
325614,
325622,
325630,
325638,
325646,
325654,
325662,
325670,
325678,
325686,
325694,
325702
],
"core.event_count": 30,
"core.first_event_number": 325438,
"core.last_event_number": 325702,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520_reco_stage1_reco_stage2_20240926T043920_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727323542.0,
"core.end_time": 1727325560.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1356_dataflow6_datawriter_0_20240907T132520.hdf5"
}
]
}