Jobsub ID 59493.183@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 59493.183@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 2867 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-08-18 21:19:53 | |
| Site | NL_NIKHEF | |
| Entry | VIRGO_NL_NIKHEF_dissel_multicore | |
| Last heartbeat | 2024-08-18 22:51:35 | |
| From worker node | Hostname | wn-choc-021.farm.nikhef.nl |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-08-18 21:26:47 | |
| Input files | hd-protodune:np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5023s) | |
| CPU time | 1h (4720s = 93%) | |
| Outputting started | 2024-08-18 22:50:31 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup.root hd-protodune-det-reco:np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup_hists.root | |
| Finished | 2024-08-18 22:51:35 | |
| Saved logs | justin-logs:59493.183-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
potential space points
Neighbour search...
145426 tests to find 76172 neighbours
Iterating with no regularization...
Begin: 1.12627e+07
0 1.02741e+07
1 1.02357e+07
2 1.02317e+07
Now with regularization...
Begin: 9.81012e+06
0 9.80835e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000310242 0.000310242 0.000310302 0.000310242 0.000310242 0.000310302 0.000310242 0.000310242 0.000310302 0.000310242 0.000310242
----view 1: 0.000205219 0.00229609 0.0271356 0.0433553 0.0328217 0.0729141 0.146229 0.0457543 0.0313743 0.0303621 0.00888896
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000310242 0.000310302 0.000310242 0.000310242 0.000310302 0.000310242 0.000310242 0.000310302 0.000310242 0.000310242 0.000310302
----view 1: 0.00229609 0.0271356 0.0433553 0.0328217 0.0729141 0.146229 0.0457543 0.0313743 0.0303621 0.00888896 0.0441598
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
19-Aug-2024 00:50:23 CEST Closed output file "np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup.root"
19-Aug-2024 00:50:23 CEST Closed input file "np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 75.635 121.485 224.609 116.351 28.0196 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000385746 0.00218063 0.00446075 0.00202685 0.00111507 30
produce:fembfilter:PDHDFEMBFilter 0.61841 0.698104 0.739413 0.704742 0.0228278 30
produce:wclsdatahd:WireCellToolkit 42.1488 45.6911 47.5522 45.6887 1.03448 30
produce:gaushit:GausHitFinder 0.510355 0.942129 1.36567 0.949236 0.194198 30
produce:nhitsfilter:NumberOfHitsFilter 0.000229461 0.000407607 0.00057626 0.000396041 8.22514e-05 30
produce:reco3d:SpacePointSolver 0.226874 1.18601 3.18113 0.838537 0.799424 30
produce:hitpdune:DisambigFromSpacePoints 0.214741 0.845982 1.63381 0.826489 0.369126 30
produce:pandora:StandardPandora 7.90702 28.6256 105.047 24.4707 17.8251 30
produce:pandoraWriter:StandardPandora 0.112987 0.187976 0.277937 0.18186 0.0395446 30
produce:pandoraTrack:LArPandoraTrackCreation 0.881036 2.09254 4.07475 2.19143 0.804101 30
produce:pandoraShower:LArPandoraShowerCreation 0.68802 2.11186 4.54443 1.95136 0.934275 30
produce:pandoracalo:Calorimetry 0.413406 0.966159 1.8303 0.963795 0.337184 30
produce:pandoracalonosce:Calorimetry 0.377856 0.901314 1.73582 0.899417 0.321737 30
produce:pandorapid:Chi2ParticleID 0.00156487 0.00216442 0.00318398 0.00214615 0.000406465 30
produce:pandoraShowercalo:ShowerCalorimetry 0.579872 1.88045 3.94077 1.76231 0.800631 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.567043 1.83366 3.98263 1.71527 0.797448 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0715862 0.149671 0.235914 0.152179 0.0337542 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0264898 0.054786 0.0838364 0.053638 0.0121547 30
produce:emtrkmichelid:EmTrackMichelId 16.7584 31.4196 45.3534 30.5859 6.4156 30
[art]:TriggerResults:TriggerResultInserter 2.0667e-05 2.84518e-05 6.8803e-05 2.59315e-05 8.93952e-06 30
end_path:out1:RootOutput 7.164e-06 9.31753e-06 2.1931e-05 8.805e-06 2.52053e-06 30
end_path:michelremoving:michelremoving 0.0187762 0.0598989 0.223457 0.037271 0.0488022 30
end_path:michelremovinggnocchi:michelremoving 0.0168271 0.0557601 0.222026 0.0334067 0.0486024 30
end_path:calibanagnocchi:CalibAnaTree 0.337198 0.71235 1.25364 0.743295 0.227167 30
end_path:out1:RootOutput(write) 0.527836 0.964276 1.37835 0.946779 0.206037 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4974.66 MB
Peak resident set size usage (VmHWM): 2651.16 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup.root
\tHists: np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup.root
Ran successfully
{
"name": "np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1724017737.0,
"core.end_time": 1724021424.0,
"core.events": [
206879,
206895,
206903,
206911,
206919,
206927,
206935,
206943,
206951,
206959,
206967,
206975,
206983,
206991,
206999,
207007,
207015,
207023,
207031,
207039,
207047,
207055,
207063,
207071,
207079,
207087,
207095,
207103,
207143,
207151
],
"core.event_count": 30,
"core.first_event_number": 206879,
"core.last_event_number": 207151,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28762
],
"core.runs_subruns": [
2876200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554_reco_stage1_reco_stage2_20240818T225023_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1724017737.0,
"core.end_time": 1724021424.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28762
],
"core.runs_subruns": [
2876200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028762_0862_dataflow7_datawriter_0_20240818T204554.hdf5"
}
]
}