Jobsub ID 269446.2@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 269446.2@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3599 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-10-04 18:25:43 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2024-10-04 23:50:31 | |
| From worker node | Hostname | wn5917301.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-10-04 21:48:27 | |
| Input files | hd-protodune:np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (7112s) | |
| CPU time | 1h (6327s = 88%) | |
| Outputting started | 2024-10-04 23:47:00 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup.root hd-protodune-det-reco:np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup_hists.root | |
| Finished | 2024-10-04 23:50:31 | |
| Saved logs | justin-logs:269446.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
p-value for these numbers
----view 0: 0.00123239 0.00101924 0.00101924 0.00101924 0.00101924 0.00101924 0.001019 0.00101924 0.00104046 0.00105214 0.00105214
----view 1: 0.000712872 0.000712991 0.000712752 0.000712752 0.000712991 0.0395213 0.0506821 0.0257645 0.004035 0.00242329 0.0494957
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00101924 0.00101924 0.00101924 0.00101924 0.00101924 0.001019 0.00101924 0.00104046 0.00105214 0.00105214 0.00105238
----view 1: 0.000712991 0.000712752 0.000712752 0.000712991 0.0395213 0.0506821 0.0257645 0.004035 0.00242329 0.0494957 0.0597229
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00101924 0.00101924 0.00101924 0.00101924 0.001019 0.00101924 0.00104046 0.00105214 0.00105214 0.00105238 0.00105214
----view 1: 0.000712752 0.000712752 0.000712991 0.0395213 0.0506821 0.0257645 0.004035 0.00242329 0.0494957 0.0597229 0.106857
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
05-Oct-2024 00:46:41 BST Closed output file "np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup.root"
05-Oct-2024 00:46:41 BST Closed input file "np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 93.8418 131.21 242.511 126.584 30.7149 39
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00047707 0.00299974 0.00521132 0.00325615 0.00121678 39
produce:fembfilter:PDHDFEMBFilter 0.716564 1.01099 1.1142 1.00483 0.0576338 39
produce:wclsdatahd:WireCellToolkit 46.5215 55.5772 59.4687 55.8594 2.06601 39
produce:gaushit:GausHitFinder 0.554567 1.01619 1.65025 0.991367 0.232745 39
produce:nhitsfilter:NumberOfHitsFilter 0.000314814 0.000469315 0.000728955 0.000441804 0.000103271 39
produce:reco3d:SpacePointSolver 0.240551 1.37928 7.47489 0.963808 1.31766 39
produce:hitpdune:DisambigFromSpacePoints 0.231291 0.76185 2.28011 0.685213 0.429654 39
produce:pandora:StandardPandora 6.31972 20.2265 98.5034 15.8515 16.1946 39
produce:pandoraWriter:StandardPandora 0.14903 0.264942 0.431691 0.258752 0.0644882 39
produce:pandoraTrack:LArPandoraTrackCreation 0.751317 1.90003 6.13482 1.60387 1.07449 39
produce:pandoraShower:LArPandoraShowerCreation 0.746165 2.01867 6.83762 1.68212 1.18268 39
produce:pandoracalo:Calorimetry 0.413123 0.943628 2.40655 0.847499 0.413626 39
produce:pandoracalonosce:Calorimetry 0.349834 0.848697 2.14143 0.752965 0.399009 39
produce:pandorapid:Chi2ParticleID 0.00178296 0.00287405 0.00465538 0.00284376 0.000612821 39
produce:pandoraShowercalo:ShowerCalorimetry 0.617452 1.8345 6.34419 1.5416 1.04674 39
produce:pandoraShowercalonosce:ShowerCalorimetry 0.577883 1.7654 6.02393 1.54088 1.00348 39
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.144649 0.242168 0.41094 0.243916 0.0604173 39
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0489755 0.0809777 0.128735 0.080231 0.0185289 39
produce:emtrkmichelid:EmTrackMichelId 24.4108 39.0512 62.7934 37.3783 8.82651 39
[art]:TriggerResults:TriggerResultInserter 2.5688e-05 5.19048e-05 0.000107463 4.7119e-05 1.68484e-05 39
end_path:out1:RootOutput 4.698e-06 8.04256e-06 2.6881e-05 6.352e-06 3.89328e-06 39
end_path:michelremoving:michelremoving 0.0234535 0.103451 0.376222 0.0558192 0.0938923 39
end_path:michelremovinggnocchi:michelremoving 0.0197682 0.101908 0.379652 0.0497539 0.0941088 39
end_path:calibanagnocchi:CalibAnaTree 0.270131 0.653797 1.59855 0.558377 0.302572 39
end_path:out1:RootOutput(write) 0.757281 1.23879 2.06688 1.17934 0.274852 39
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4912.69 MB
Peak resident set size usage (VmHWM): 2541.99 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup.root
\tHists: np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728080409.0,
"core.end_time": 1728085603.0,
"core.events": [
2653,
2655,
2657,
2659,
2661,
2663,
2665,
2667,
2669,
2671,
2673,
2675,
2677,
2679,
2681,
2683,
2685,
2687,
2689,
2691,
2693,
2695,
2697,
2699,
2701,
2703,
2705,
2707,
2709,
2711,
2713,
2715,
2717,
2719,
2721,
2723,
2725,
2727,
2729
],
"core.event_count": 39,
"core.first_event_number": 2653,
"core.last_event_number": 2729,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29405
],
"core.runs_subruns": [
2940500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916_reco_stage1_reco_stage2_20241004T234641_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728080409.0,
"core.end_time": 1728085603.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29405
],
"core.runs_subruns": [
2940500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029405_0034_dataflow1_datawriter_0_20241001T191916.hdf5"
}
]
}