Jobsub ID 257403.158@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 257403.158@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3245 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-16 12:19:41 | |
| Site | UK_Sheffield | |
| Entry | DUNE_UK_Sheffield_lcgce1 | |
| Last heartbeat | 2024-09-17 01:43:32 | |
| From worker node | Hostname | wn081.hep |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-16 12:50:51 | |
| Input files | hd-protodune:np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 12h (46256s) | |
| CPU time | 12h (45407s = 98%) | |
| Outputting started | 2024-09-17 01:41:56 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup_hists.root | |
| Finished | 2024-09-17 01:43:26 | |
| Saved logs | justin-logs:257403.158-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
h...
55848 tests to find 24672 neighbours
Iterating with no regularization...
Begin: 7.98053e+06
0 7.18151e+06
1 7.14945e+06
2 7.14711e+06
Now with regularization...
Begin: 6.80788e+06
0 6.80704e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000298686 0.000298686 0.000298683 0.000298683 0.000298683 0.000404052 0.000433505 0.000433505 0.000433505 0.000433512 0.000433505 0.000433505 0.000433512
----view 1: 0.001091 0.00263938 0.0184754 0.00644842 0.0032053 0.00218457 0.00269875 0.00127938 0.00187308 0.00229201 0.0120865 0.010922 0.0132825
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000298686 0.000298686 0.000298683 0.000298683 0.000298683 0.000404052 0.000433505 0.000433505 0.000433505 0.000433512 0.000433505 0.000433505 0.000433512
----view 1: 0.001091 0.00263938 0.0184754 0.00644842 0.0032053 0.00218457 0.00269875 0.00127938 0.00187308 0.00229201 0.0120865 0.010922 0.0132825
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
17-Sep-2024 02:41:35 BST Closed output file "np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup.root"
17-Sep-2024 02:41:35 BST Closed input file "np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 86.5922 1431.16 39967.9 142.965 7035.87 31
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000534837 0.00318134 0.0159625 0.00280733 0.00269377 31
produce:fembfilter:PDHDFEMBFilter 0.697141 0.774706 1.04842 0.760044 0.0690442 31
produce:wclsdatahd:WireCellToolkit 43.934 58.9226 65.5998 62.0687 7.27816 31
produce:gaushit:GausHitFinder 0.414927 0.856688 1.35061 0.890089 0.211594 31
produce:nhitsfilter:NumberOfHitsFilter 0.000200097 0.00039338 0.000603872 0.000393903 0.000115043 31
produce:reco3d:SpacePointSolver 0.200555 0.947691 3.0732 0.625038 0.755087 31
produce:hitpdune:DisambigFromSpacePoints 0.196188 0.789553 1.47532 0.641571 0.377914 31
produce:pandora:StandardPandora 7.16171 1301.66 39822.5 17.0931 7032.91 31
produce:pandoraWriter:StandardPandora 0.085985 0.163145 0.305242 0.160409 0.0494448 31
produce:pandoraTrack:LArPandoraTrackCreation 0.589041 1.72239 3.96559 1.76262 0.842081 31
produce:pandoraShower:LArPandoraShowerCreation 0.523011 2.04543 5.88748 1.83982 1.1319 31
produce:pandoracalo:Calorimetry 0.318347 0.866053 1.71329 0.849932 0.333291 31
produce:pandoracalonosce:Calorimetry 0.284978 0.799627 1.64504 0.783932 0.321334 31
produce:pandorapid:Chi2ParticleID 0.00136081 0.00207974 0.00311536 0.00205497 0.000422942 31
produce:pandoraShowercalo:ShowerCalorimetry 0.454324 1.98053 4.72719 1.91433 0.998046 31
produce:pandoraShowercalonosce:ShowerCalorimetry 0.435144 1.9318 4.60388 1.85628 0.943426 31
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0882164 0.147859 0.220051 0.141965 0.0345802 31
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.027697 0.0494353 0.0769709 0.0471657 0.0122345 31
produce:emtrkmichelid:EmTrackMichelId 30.0444 55.64 94.5482 55.9029 13.4319 31
[art]:TriggerResults:TriggerResultInserter 2.4746e-05 4.48059e-05 8.504e-05 3.7741e-05 1.73374e-05 31
end_path:out1:RootOutput 7.995e-06 1.0694e-05 2.4746e-05 9.189e-06 3.66599e-06 31
end_path:michelremoving:michelremoving 0.0229216 0.121274 0.472438 0.0523221 0.110607 31
end_path:michelremovinggnocchi:michelremoving 0.0206916 0.112687 0.462359 0.0449037 0.103794 31
end_path:calibanagnocchi:CalibAnaTree 0.270874 0.691528 1.4348 0.658649 0.266847 31
end_path:out1:RootOutput(write) 0.478969 0.817919 1.1869 0.788706 0.181847 31
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4990.78 MB
Peak resident set size usage (VmHWM): 2365.53 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup.root
\tHists: np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726492882.0,
"core.end_time": 1726537298.0,
"core.events": [
69196,
69204,
69212,
69220,
69228,
69236,
69244,
69252,
69260,
69268,
69276,
69284,
69292,
69300,
69308,
69316,
69324,
69332,
69340,
69348,
69356,
69364,
69372,
69380,
69388,
69396,
69404,
69412,
69420,
69428,
69436
],
"core.event_count": 31,
"core.first_event_number": 69196,
"core.last_event_number": 69436,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29186
],
"core.runs_subruns": [
2918600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736_reco_stage1_reco_stage2_20240917T014135_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726492882.0,
"core.end_time": 1726537298.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29186
],
"core.runs_subruns": [
2918600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029186_0279_dataflow4_datawriter_0_20240914T191736.hdf5"
}
]
}