Jobsub ID 80051.6@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80051.6@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3493 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:24:02 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:35:24 |
| From worker node | Hostname | mh-7662-11.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:30:40 |
| Input files | hd-protodune:np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6474s) |
| CPU time | 1h (4720s = 72%) |
| Outputting started | 2024-09-27 16:18:35 |
| Output files | |
| Finished | 2024-09-27 16:35:24 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
alculate correlation coefficient p-value for these numbers
----view 0: 5.29885e-05 5.29289e-05 5.29885e-05 0.000433624 0.000386775 5.72205e-05 5.72801e-05 5.72205e-05 5.72801e-05 0.000603378 7.31349e-05 0.00555342 0.00275427
----view 1: 1.98483e-05 1.97887e-05 1.98483e-05 1.97887e-05 1.98483e-05 1.97887e-05 1.98483e-05 0.000375986 3.6478e-05 3.6478e-05 3.6478e-05 3.64184e-05 3.6478e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 5.29289e-05 5.29885e-05 0.000433624 0.000386775 5.72205e-05 5.72801e-05 5.72205e-05 5.72801e-05 0.000603378 7.31349e-05 0.00555342 0.00275427 7.01547e-05
----view 1: 1.97887e-05 1.98483e-05 1.97887e-05 1.98483e-05 1.97887e-05 1.98483e-05 0.000375986 3.6478e-05 3.6478e-05 3.6478e-05 3.64184e-05 3.6478e-05 3.6478e-05
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:18:27 PDT Closed output file "np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup.root"
27-Sep-2024 09:18:27 PDT Closed input file "np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 65.2628 110.446 171.579 104.315 31.0804 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000604264 0.00266979 0.00523771 0.00256858 0.00124765 35
produce:fembfilter:PDHDFEMBFilter 0.641711 0.678784 0.72875 0.675792 0.0207425 35
produce:wclsdatahd:WireCellToolkit 31.5368 33.8591 36.324 33.7769 0.966618 35
produce:gaushit:GausHitFinder 0.573403 0.916153 1.28785 0.912653 0.2061 35
produce:nhitsfilter:NumberOfHitsFilter 0.000281347 0.000421356 0.000606484 0.00041887 8.06566e-05 35
produce:reco3d:SpacePointSolver 0.261945 1.60614 6.24005 1.29 1.31154 35
produce:hitpdune:DisambigFromSpacePoints 0.245256 0.756776 1.62855 0.680295 0.369312 35
produce:pandora:StandardPandora 7.57877 29.8247 66.6977 25.5455 17.6852 35
produce:pandoraWriter:StandardPandora 0.0995472 0.191053 0.288035 0.1922 0.051375 35
produce:pandoraTrack:LArPandoraTrackCreation 0.70462 2.25552 4.80373 1.99947 1.15154 35
produce:pandoraShower:LArPandoraShowerCreation 0.759085 2.31088 5.24944 2.11522 1.24645 35
produce:pandoracalo:Calorimetry 0.365362 1.00985 1.9596 0.96307 0.459664 35
produce:pandoracalonosce:Calorimetry 0.327045 0.936968 1.83019 0.877279 0.435889 35
produce:pandorapid:Chi2ParticleID 0.00146848 0.00230959 0.00406884 0.00223656 0.000574868 35
produce:pandoraShowercalo:ShowerCalorimetry 0.588471 1.9875 5.50571 1.65069 1.14077 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.562949 1.84983 4.05673 1.58178 0.969049 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0766335 0.151748 0.234439 0.159408 0.04025 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0289273 0.0525276 0.077094 0.0545677 0.0131053 35
produce:emtrkmichelid:EmTrackMichelId 17.9693 30.0294 42.4457 30.1444 7.18479 35
[art]:TriggerResults:TriggerResultInserter 2.086e-05 3.0841e-05 9.4142e-05 2.622e-05 1.33629e-05 35
end_path:out1:RootOutput 6.64e-06 8.75369e-06 3.22e-05 8.14e-06 4.15549e-06 35
end_path:michelremoving:michelremoving 0.0154225 0.0643025 0.278056 0.0317023 0.0652362 35
end_path:michelremovinggnocchi:michelremoving 0.0151832 0.0624046 0.270998 0.0311899 0.0641519 35
end_path:calibanagnocchi:CalibAnaTree 0.254174 0.757174 1.64484 0.70667 0.349528 35
end_path:out1:RootOutput(write) 0.587888 0.999373 1.45986 1.03527 0.24573 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5077.49 MB
Peak resident set size usage (VmHWM): 2703.97 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup.root
\tHists: np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450007.0,
"core.end_time": 1727453907.0,
"core.events": [
428,
432,
436,
440,
444,
448,
452,
456,
460,
464,
468,
472,
476,
480,
484,
488,
492,
496,
500,
504,
508,
512,
516,
520,
524,
528,
532,
536,
540,
544,
548,
552,
556,
560,
564
],
"core.event_count": 35,
"core.first_event_number": 428,
"core.last_event_number": 564,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157_reco_stage1_reco_stage2_20240927T161827_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450007.0,
"core.end_time": 1727453907.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0003_dataflow0_datawriter_0_20240620T044157.hdf5"
}
]
} 