Jobsub ID 269271.23@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 269271.23@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3571 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-10-04 16:39:58 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2024-10-04 19:52:29 | |
| From worker node | Hostname | dunegli-3956575-0-fnpc9077.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-10-04 16:54:36 | |
| Input files | hd-protodune:np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 2h (10624s) | |
| CPU time | 2h (9804s = 92%) | |
| Outputting started | 2024-10-04 19:51:41 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup.root hd-protodune-det-reco:np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup_hists.root | |
| Finished | 2024-10-04 19:52:29 | |
| Saved logs | justin-logs:269271.23-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ct-2024 19:49:02 UTC
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 34549 traces, 34549 summary
Retagger: tagging trace set: gauss with 27432 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 27432 traces tagged "gauss"
FrameSaver: q=925233 n=567983 tag=gauss
wclsFrameSaver: saving 34549 traces tagged "wiener"
FrameSaver: q=985318 n=521243 tag=wiener
3684 hits in TPC 0
3097 hits in TPC 1
2262 hits in TPC 2
3140 hits in TPC 3
3894 hits in TPC 4
5659 hits in TPC 5
1639 hits in TPC 6
3714 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7865 XUs and 8882 XVs -> 697 XUVs
C:0 T:2 131 XUs and 0 XVs -> 0 XUVs
C:0 T:3 0 XUs and 0 XVs -> 0 XUVs
C:0 T:4 302 XUs and 292 XVs -> 16 XUVs
C:0 T:5 13944 XUs and 11024 XVs -> 150 XUVs
863 XUVs total
273 collection wire objects
863 potential space points
Neighbour search...
42883 tests to find 28674 neighbours
Iterating with no regularization...
Begin: 3.41017e+06
0 3.32142e+06
1 3.3189e+06
Now with regularization...
Begin: 3.25214e+06
0 3.25198e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
04-Oct-2024 19:51:30 UTC Closed output file "np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup.root"
04-Oct-2024 19:51:30 UTC Closed input file "np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 94.5453 224.099 953.555 178.284 143.807 40
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000464014 0.011257 0.209251 0.00130977 0.0429081 40
produce:fembfilter:PDHDFEMBFilter 0.966512 1.1728 1.77711 1.05677 0.215468 40
produce:wclsdatahd:WireCellToolkit 40.3305 42.8024 48.5596 42.3735 1.74564 40
produce:gaushit:GausHitFinder 0.376163 0.625252 1.05201 0.609768 0.156668 40
produce:nhitsfilter:NumberOfHitsFilter 0.000175854 0.00547152 0.202105 0.000405334 0.0314869 40
produce:reco3d:SpacePointSolver 0.043677 0.43802 1.29371 0.28007 0.344977 40
produce:hitpdune:DisambigFromSpacePoints 0.125919 0.390888 1.06263 0.357413 0.196154 40
produce:pandora:StandardPandora 29.2615 132.479 838.173 88.0747 134.031 40
produce:pandoraWriter:StandardPandora 0.142629 0.472865 3.21516 0.275072 0.58751 40
produce:pandoraTrack:LArPandoraTrackCreation 0.14784 0.498037 1.06789 0.436027 0.235922 40
produce:pandoraShower:LArPandoraShowerCreation 0.096326 0.535618 1.70746 0.460154 0.35206 40
produce:pandoracalo:Calorimetry 0.0735462 0.247011 0.521525 0.240369 0.103613 40
produce:pandoracalonosce:Calorimetry 0.0656968 0.217647 0.422357 0.223226 0.0895594 40
produce:pandorapid:Chi2ParticleID 0.000684699 0.0011362 0.00214505 0.00110159 0.000282137 40
produce:pandoraShowercalo:ShowerCalorimetry 0.0798064 0.409451 1.29107 0.381944 0.24312 40
produce:pandoraShowercalonosce:ShowerCalorimetry 0.0804264 0.397265 1.13785 0.369984 0.22832 40
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0267963 0.0533964 0.0835554 0.0528305 0.0146369 40
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.00978867 0.0201835 0.0300537 0.019696 0.00536703 40
produce:emtrkmichelid:EmTrackMichelId 20.0596 42.049 90.0496 39.4982 12.6725 40
[art]:TriggerResults:TriggerResultInserter 2.1468e-05 5.04791e-05 7.744e-05 5.0448e-05 1.29297e-05 40
end_path:out1:RootOutput 8.084e-06 1.36652e-05 2.5266e-05 1.34555e-05 4.39743e-06 40
end_path:michelremoving:michelremoving 0.0117671 0.0207473 0.039364 0.0197004 0.00622593 40
end_path:michelremovinggnocchi:michelremoving 0.0104691 0.0182148 0.0277056 0.0184664 0.00435582 40
end_path:calibanagnocchi:CalibAnaTree 0.0629268 0.159 0.312089 0.143712 0.0655348 40
end_path:out1:RootOutput(write) 0.306459 0.849505 4.1501 0.595702 0.741589 40
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4991.25 MB
Peak resident set size usage (VmHWM): 2664.2 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup.root
\tHists: np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728062478.0,
"core.end_time": 1728071491.0,
"core.events": [
241,
242,
243,
244,
245,
246,
247,
248,
249,
250,
251,
252,
253,
254,
255,
256,
257,
258,
259,
260,
261,
262,
263,
264,
265,
266,
267,
268,
269,
270,
271,
272,
273,
274,
275,
276,
277,
278,
279,
280
],
"core.event_count": 40,
"core.first_event_number": 241,
"core.last_event_number": 280,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27549
],
"core.runs_subruns": [
2754900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547_reco_stage1_reco_stage2_20241004T195130_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728062478.0,
"core.end_time": 1728071491.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27549
],
"core.runs_subruns": [
2754900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027549_0006_dataflow0_datawriter_0_20240628T135547.hdf5"
}
]
}