Jobsub ID 270243.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 270243.0@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3577 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-10-05 18:15:49 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2024-10-06 20:19:51 | |
| From worker node | Hostname | dunegli-35605-0-cmswn3003.fnal.gov |
| cpuinfo | AMD EPYC 7542 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-10-05 20:58:52 | |
| Input files | hd-protodune:np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 23h (83943s) | |
| CPU time | 22h (81463s = 97%) | |
| Outputting started | 2024-10-06 20:17:57 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup.root hd-protodune-det-reco:np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup_hists.root | |
| Finished | 2024-10-06 20:19:51 | |
| Saved logs | justin-logs:270243.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
g with no regularization...
Begin: 0
0 0
1 0
2 0
3 0
4 0
5 0
6 0
7 0
8 0
9 0
10 0
11 0
12 0
13 0
14 0
15 0
16 0
17 0
18 0
19 0
20 0
21 0
22 0
23 0
24 0
25 0
26 0
27 0
28 0
29 0
30 0
31 0
32 0
33 0
34 0
35 0
36 0
37 0
38 0
39 0
40 0
41 0
42 0
43 0
44 0
45 0
46 0
47 0
48 0
49 0
50 0
51 0
52 0
53 0
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
Now with regularization...
Begin: 0
0 0
1 0
2 0
3 0
4 0
5 0
6 0
7 0
8 0
9 0
10 0
11 0
12 0
13 0
14 0
15 0
16 0
17 0
18 0
19 0
20 0
21 0
22 0
23 0
24 0
25 0
26 0
27 0
28 0
29 0
30 0
31 0
32 0
33 0
34 0
35 0
36 0
37 0
38 0
39 0
40 0
41 0
42 0
43 0
44 0
45 0
46 0
47 0
48 0
49 0
50 0
51 0
52 0
53 0
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
06-Oct-2024 20:17:50 UTC Closed output file "np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup.root"
06-Oct-2024 20:17:50 UTC Closed input file "np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 90.6368 2022.76 72494.6 189.208 11285 40
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000348722 0.000603966 0.00334339 0.00045852 0.000484681 40
produce:fembfilter:PDHDFEMBFilter 0.553943 0.662046 0.777885 0.670204 0.0404579 40
produce:wclsdatahd:WireCellToolkit 23.9548 25.0542 29.2756 24.7013 1.18271 40
produce:gaushit:GausHitFinder 0.179829 0.311037 0.522641 0.286346 0.0899551 40
produce:nhitsfilter:NumberOfHitsFilter 0.00020002 0.000287354 0.00096351 0.000257273 0.000121194 40
produce:reco3d:SpacePointSolver 0.0149802 0.0239864 0.0390818 0.0226142 0.0064186 40
produce:hitpdune:DisambigFromSpacePoints 0.0229789 0.0398943 0.0775938 0.0361541 0.0139144 40
produce:pandora:StandardPandora 38.8244 1959.13 72426.6 127.44 11284.2 40
produce:pandoraWriter:StandardPandora 0.155984 0.268581 0.472534 0.249457 0.0816563 40
produce:pandoraTrack:LArPandoraTrackCreation 0.000729825 0.0305597 0.112986 0.0260477 0.0188375 40
produce:pandoraShower:LArPandoraShowerCreation 0.000135326 0.00475256 0.0521198 0.000391397 0.0129335 40
produce:pandoracalo:Calorimetry 0.000249754 0.00814138 0.0617265 0.00307528 0.0134879 40
produce:pandoracalonosce:Calorimetry 0.000180232 0.00647437 0.0563226 0.0018117 0.0119025 40
produce:pandorapid:Chi2ParticleID 7.6616e-05 0.000251406 0.00119864 0.00019254 0.000197988 40
produce:pandoraShowercalo:ShowerCalorimetry 6.4472e-05 0.00408831 0.0461786 0.000252253 0.0114534 40
produce:pandoraShowercalonosce:ShowerCalorimetry 4.1849e-05 0.00378344 0.044311 0.000171766 0.0110645 40
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.000155244 0.00206499 0.0106295 0.00143546 0.00237991 40
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.000113625 0.00116546 0.00706118 0.000668585 0.00150446 40
produce:emtrkmichelid:EmTrackMichelId 23.2252 36.6408 58.2791 34.8531 9.4473 40
[art]:TriggerResults:TriggerResultInserter 1.6251e-05 2.53598e-05 7.0073e-05 2.2202e-05 1.18448e-05 40
end_path:out1:RootOutput 7.745e-06 1.10269e-05 2.3625e-05 1.0515e-05 2.47189e-06 40
end_path:michelremoving:michelremoving 0.00224216 0.00501885 0.0112497 0.00463212 0.00183984 40
end_path:michelremovinggnocchi:michelremoving 0.00204551 0.00444763 0.0107929 0.00421317 0.00159307 40
end_path:calibanagnocchi:CalibAnaTree 0.00705183 0.0116959 0.0260582 0.0102332 0.00459331 40
end_path:out1:RootOutput(write) 0.158429 0.29347 0.535637 0.265106 0.091602 40
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5027.11 MB
Peak resident set size usage (VmHWM): 2666.11 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup.root
\tHists: np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728164927.0,
"core.end_time": 1728245871.0,
"core.events": [
481,
482,
483,
484,
485,
486,
487,
488,
489,
490,
491,
492,
493,
494,
495,
496,
497,
498,
499,
500,
501,
502,
503,
504,
505,
506,
507,
508,
509,
510,
511,
512,
513,
514,
515,
516,
517,
518,
519,
520
],
"core.event_count": 40,
"core.first_event_number": 481,
"core.last_event_number": 520,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27581
],
"core.runs_subruns": [
2758100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138_reco_stage1_reco_stage2_20241006T201750_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728164927.0,
"core.end_time": 1728245871.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27581
],
"core.runs_subruns": [
2758100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027581_0012_dataflow0_datawriter_0_20240701T140138.hdf5"
}
]
}