Jobsub ID 79871.92@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79871.92@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3516 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 06:22:54 |
| Site | US_BNL |
| Entry | DUNE_US_BNL_sp02 |
| Last heartbeat | 2024-09-27 16:36:01 |
| From worker node | Hostname | spool1493.sdcc.bnl.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | False |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 10:13:53 |
| Input files | hd-protodune:np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | 2024-09-27 16:17:20 |
| Output files | |
| Finished | 2024-09-27 16:36:01 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ng 40435 traces tagged "gauss"
FrameSaver: q=1.29854e+06 n=696185 tag=gauss
wclsFrameSaver: saving 55014 traces tagged "wiener"
FrameSaver: q=1.4204e+06 n=623863 tag=wiener
6781 hits in TPC 0
5892 hits in TPC 1
4377 hits in TPC 2
2489 hits in TPC 3
2525 hits in TPC 4
2920 hits in TPC 5
2876 hits in TPC 6
1059 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 49 XUs and 29 XVs -> 1 XUVs
C:0 T:1 10543 XUs and 10405 XVs -> 798 XUVs
C:0 T:2 14414 XUs and 11175 XVs -> 187 XUVs
C:0 T:3 173 XUs and 120 XVs -> 8 XUVs
C:0 T:4 791 XUs and 1122 XVs -> 54 XUVs
C:0 T:5 9017 XUs and 9541 XVs -> 174 XUVs
C:0 T:6 5971 XUs and 2717 XVs -> 111 XUVs
C:0 T:7 104 XUs and 74 XVs -> 8 XUVs
1341 XUVs total
635 collection wire objects
1341 potential space points
Neighbour search...
26781 tests to find 16848 neighbours
Iterating with no regularization...
Begin: 8.87661e+06
0 8.72582e+06
1 8.71161e+06
2 8.71071e+06
Now with regularization...
Begin: 8.43794e+06
0 8.43773e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:17:09 UTC Closed output file "np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup.root"
27-Sep-2024 16:17:09 UTC Closed input file "np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 72.6805 101.073 170.581 99.3146 20.0641 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000419841 0.00205753 0.00570292 0.00147474 0.00162523 35
produce:fembfilter:PDHDFEMBFilter 0.665348 0.753237 1.19807 0.716244 0.114255 35
produce:wclsdatahd:WireCellToolkit 46.3208 52.5006 73.3099 51.1243 5.66811 35
produce:gaushit:GausHitFinder 0.496952 0.807821 1.49004 0.775426 0.185088 35
produce:nhitsfilter:NumberOfHitsFilter 0.000329374 0.000579768 0.00123382 0.000533276 0.000162412 35
produce:reco3d:SpacePointSolver 0.345175 1.20757 3.52234 1.1222 0.720628 35
produce:hitpdune:DisambigFromSpacePoints 0.202348 0.517117 1.46616 0.435938 0.256796 35
produce:pandora:StandardPandora 5.4808 14.3185 34.5303 12.9195 5.8921 35
produce:pandoraWriter:StandardPandora 0.101519 0.183046 0.398606 0.177306 0.0559054 35
produce:pandoraTrack:LArPandoraTrackCreation 0.870814 3.02416 10.9301 2.8642 1.85449 35
produce:pandoraShower:LArPandoraShowerCreation 0.87052 3.22161 11.4654 2.94828 2.05155 35
produce:pandoracalo:Calorimetry 0.417748 1.091 2.51893 1.01835 0.496147 35
produce:pandoracalonosce:Calorimetry 0.382247 0.994902 2.46723 0.961917 0.465185 35
produce:pandorapid:Chi2ParticleID 0.00131606 0.00225398 0.00406798 0.00220234 0.000636341 35
produce:pandoraShowercalo:ShowerCalorimetry 0.778739 2.45464 9.76238 2.09435 1.7076 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.71069 2.43155 12.5615 2.10305 2.01727 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0645546 0.111811 0.253301 0.1056 0.0355666 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0238997 0.0458793 0.0813691 0.0451036 0.0120915 35
produce:emtrkmichelid:EmTrackMichelId 9.1045 15.3831 23.2848 15.2196 3.19557 35
[art]:TriggerResults:TriggerResultInserter 2.9948e-05 6.35515e-05 9.7615e-05 6.5554e-05 1.59154e-05 35
end_path:out1:RootOutput 7.333e-06 1.64138e-05 4.6347e-05 1.5288e-05 6.45251e-06 35
end_path:michelremoving:michelremoving 0.021554 0.0770419 0.318513 0.0459439 0.0670982 35
end_path:michelremovinggnocchi:michelremoving 0.0201662 0.0696625 0.292975 0.0436323 0.0615802 35
end_path:calibanagnocchi:CalibAnaTree 0.257403 0.837048 3.60098 0.69024 0.632169 35
end_path:out1:RootOutput(write) 0.431307 0.742605 1.15144 0.731281 0.163073 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5862.79 MB
Peak resident set size usage (VmHWM): 2618.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup.root
\tHists: np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450248.0,
"core.end_time": 1727453830.0,
"core.events": [
37944,
37948,
37952,
37956,
37960,
37964,
37968,
37972,
37976,
37980,
37984,
37988,
37992,
37996,
38000,
38004,
38008,
38012,
38016,
38020,
38024,
38028,
38032,
38036,
38040,
38044,
38048,
38052,
38056,
38060,
38064,
38068,
38072,
38076,
38080
],
"core.event_count": 35,
"core.first_event_number": 37944,
"core.last_event_number": 38080,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27392
],
"core.runs_subruns": [
2739200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528_reco_stage1_reco_stage2_20240927T161709_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450248.0,
"core.end_time": 1727453830.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27392
],
"core.runs_subruns": [
2739200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027392_0271_dataflow0_datawriter_0_20240623T141528.hdf5"
}
]
} 