Jobsub ID 261577.29@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 261577.29@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3390 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-24 19:57:04 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2024-09-24 23:26:30 |
| From worker node | Hostname | ccwcondor0601 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-24 22:07:57 |
| Input files | hd-protodune:np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656.hdf5
|
| Outputting started | 2024-09-24 23:14:20 |
| Output files | |
| Finished | 2024-09-24 23:26:30 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
etagger: tagging trace set: gauss with 42179 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 42179 traces tagged "gauss"
FrameSaver: q=889064 n=730236 tag=gauss
wclsFrameSaver: saving 58001 traces tagged "wiener"
FrameSaver: q=963985 n=656284 tag=wiener
3798 hits in TPC 0
3558 hits in TPC 1
5319 hits in TPC 2
2989 hits in TPC 3
1597 hits in TPC 4
2708 hits in TPC 5
4636 hits in TPC 6
2542 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7044 XUs and 5164 XVs -> 195 XUVs
C:0 T:2 20404 XUs and 44408 XVs -> 1780 XUVs
C:0 T:3 66 XUs and 94 XVs -> 1 XUVs
C:0 T:4 1 XUs and 7 XVs -> 0 XUVs
C:0 T:5 3077 XUs and 5114 XVs -> 571 XUVs
C:0 T:6 16933 XUs and 16789 XVs -> 367 XUVs
C:0 T:7 142 XUs and 97 XVs -> 4 XUVs
2918 XUVs total
1254 collection wire objects
2918 potential space points
Neighbour search...
128766 tests to find 74750 neighbours
Iterating with no regularization...
Begin: 6.07185e+06
0 5.58961e+06
1 5.55671e+06
2 5.55205e+06
Now with regularization...
Begin: 5.17723e+06
0 5.17608e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
25-Sep-2024 01:14:01 CEST Closed output file "np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup.root"
25-Sep-2024 01:14:01 CEST Closed input file "np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 67.6252 100.81 156.045 98.2873 20.2431 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000608147 0.00295793 0.00459578 0.00337346 0.00115517 30
produce:fembfilter:PDHDFEMBFilter 0.562778 0.675295 0.820421 0.675655 0.0595292 30
produce:wclsdatahd:WireCellToolkit 36.9451 42.5871 49.613 42.2236 3.02678 30
produce:gaushit:GausHitFinder 0.421206 0.735839 1.25134 0.737787 0.195742 30
produce:nhitsfilter:NumberOfHitsFilter 0.000199303 0.000339644 0.0005672 0.000322177 7.59506e-05 30
produce:reco3d:SpacePointSolver 0.166203 1.32185 4.75217 0.965839 1.07339 30
produce:hitpdune:DisambigFromSpacePoints 0.189617 0.593636 1.48093 0.619486 0.273343 30
produce:pandora:StandardPandora 4.71422 12.4507 28.5812 11.9822 5.38523 30
produce:pandoraWriter:StandardPandora 0.0664648 0.160407 0.258934 0.153256 0.040383 30
produce:pandoraTrack:LArPandoraTrackCreation 0.656012 1.74036 4.04377 1.58814 0.797561 30
produce:pandoraShower:LArPandoraShowerCreation 0.47855 2.32291 7.39763 1.90883 1.53367 30
produce:pandoracalo:Calorimetry 0.326859 0.88914 2.48408 0.803542 0.458645 30
produce:pandoracalonosce:Calorimetry 0.350106 0.814249 2.34681 0.708669 0.450654 30
produce:pandorapid:Chi2ParticleID 0.00107563 0.00222263 0.00410975 0.00222538 0.000629338 30
produce:pandoraShowercalo:ShowerCalorimetry 0.520251 1.95547 7.13497 1.61996 1.38253 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.531109 1.82614 5.6856 1.57767 1.08469 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.079737 0.145981 0.24829 0.141466 0.0455403 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0237805 0.057931 0.0914549 0.0579823 0.0146398 30
produce:emtrkmichelid:EmTrackMichelId 17.8327 30.817 47.0747 30.0383 7.13912 30
[art]:TriggerResults:TriggerResultInserter 2.7351e-05 6.02406e-05 0.000129552 5.90705e-05 1.98641e-05 30
end_path:out1:RootOutput 9.648e-06 1.88298e-05 3.8222e-05 1.73325e-05 6.66736e-06 30
end_path:michelremoving:michelremoving 0.0216515 0.0876445 0.327501 0.0446578 0.0814503 30
end_path:michelremovinggnocchi:michelremoving 0.0227186 0.0808426 0.320672 0.0414834 0.0781885 30
end_path:calibanagnocchi:CalibAnaTree 0.221808 0.557613 1.36897 0.536532 0.243637 30
end_path:out1:RootOutput(write) 0.495561 0.742582 1.15978 0.709926 0.178954 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4902.48 MB
Peak resident set size usage (VmHWM): 2327.46 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup.root
\tHists: np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727216571.0,
"core.end_time": 1727219643.0,
"core.events": [
712086,
712094,
712102,
712110,
712118,
712126,
712134,
712142,
712150,
712158,
712166,
712174,
712182,
712190,
712198,
712206,
712214,
712222,
712230,
712238,
712246,
712254,
712262,
712270,
712278,
712286,
712294,
712302,
712310,
712318
],
"core.event_count": 30,
"core.first_event_number": 712086,
"core.last_event_number": 712318,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29006
],
"core.runs_subruns": [
2900600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656_reco_stage1_reco_stage2_20240924T231401_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727216571.0,
"core.end_time": 1727219643.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29006
],
"core.runs_subruns": [
2900600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029006_2967_dataflow6_datawriter_0_20240901T170656.hdf5"
}
]
} 