Jobsub ID 273172.177@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 273172.177@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3670 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-10-11 01:44:38 |
Site | US_UCSD |
Entry | CMSHTPC_T2_US_UCSD_gw6 |
Last heartbeat | 2024-10-11 04:47:16 |
From worker node | Hostname | mh-7662-7.t2.ucsd.edu |
cpuinfo | AMD EPYC 7662 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-10-11 03:17:58 |
Input files | hd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5
|
Outputting started | 2024-10-11 04:45:51 |
Output files | |
Finished | 2024-10-11 04:47:16 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
es, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41887 traces tagged "gauss"
FrameSaver: q=1.3801e+06 n=771512 tag=gauss
wclsFrameSaver: saving 54932 traces tagged "wiener"
FrameSaver: q=1.47488e+06 n=693200 tag=wiener
4798 hits in TPC 0
3943 hits in TPC 1
4960 hits in TPC 2
2047 hits in TPC 3
2902 hits in TPC 4
6190 hits in TPC 5
4380 hits in TPC 6
1837 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4930 XUs and 4956 XVs -> 294 XUVs
C:0 T:2 12855 XUs and 10496 XVs -> 174 XUVs
C:0 T:3 90 XUs and 42 XVs -> 3 XUVs
C:0 T:4 270 XUs and 475 XVs -> 9 XUVs
C:0 T:5 19280 XUs and 11529 XVs -> 199 XUVs
C:0 T:6 13153 XUs and 20479 XVs -> 276 XUVs
C:0 T:7 102 XUs and 107 XVs -> 1 XUVs
956 XUVs total
617 collection wire objects
956 potential space points
Neighbour search...
14588 tests to find 7880 neighbours
Iterating with no regularization...
Begin: 1.08992e+07
0 1.04523e+07
1 1.04434e+07
Now with regularization...
Begin: 1.01924e+07
0 1.0192e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
10-Oct-2024 21:45:43 PDT Closed output file "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root"
10-Oct-2024 21:45:43 PDT Closed input file "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 39.8765 80.1038 105.255 82.8057 13.2752 40
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00044572 0.00186562 0.00412792 0.00170331 0.000910168 40
produce:fembfilter:PDHDFEMBFilter 0.650588 0.675181 0.70221 0.678353 0.0128843 40
produce:wclsdatahd:WireCellToolkit 32.9981 35.6404 43.4442 34.7774 2.65081 40
produce:gaushit:GausHitFinder 0.401507 0.675743 1.61125 0.685549 0.188049 40
produce:nhitsfilter:NumberOfHitsFilter 0.000244946 0.000362758 0.000685645 0.000359453 8.36071e-05 40
produce:reco3d:SpacePointSolver 0.160934 0.862244 4.45465 0.564425 0.80845 39
produce:hitpdune:DisambigFromSpacePoints 0.161383 0.468152 1.14188 0.454352 0.195113 39
produce:pandora:StandardPandora 5.29757 12.3349 28.7206 11.5181 4.5866 39
produce:pandoraWriter:StandardPandora 0.0867355 0.139472 0.191524 0.141646 0.0250031 39
produce:pandoraTrack:LArPandoraTrackCreation 0.438292 1.0503 1.54921 1.12046 0.290352 39
produce:pandoraShower:LArPandoraShowerCreation 0.465902 1.24569 2.0544 1.22492 0.426299 39
produce:pandoracalo:Calorimetry 0.236362 0.525303 0.773161 0.550031 0.129349 39
produce:pandoracalonosce:Calorimetry 0.21646 0.482959 0.708987 0.500574 0.124826 39
produce:pandorapid:Chi2ParticleID 0.00108288 0.00179172 0.00404107 0.0017084 0.00049135 39
produce:pandoraShowercalo:ShowerCalorimetry 0.417142 1.12502 1.89548 1.16267 0.38573 39
produce:pandoraShowercalonosce:ShowerCalorimetry 0.393257 1.06774 1.79397 1.09922 0.358056 39
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.083018 0.124789 0.176022 0.125603 0.0237605 39
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0283385 0.0428116 0.059712 0.0432878 0.00768486 39
produce:emtrkmichelid:EmTrackMichelId 14.9961 23.3637 31.7347 23.8906 4.16462 39
[art]:TriggerResults:TriggerResultInserter 1.502e-05 2.76978e-05 6.7981e-05 2.5045e-05 1.21037e-05 40
end_path:out1:RootOutput 3.46e-06 7.19493e-06 2.392e-05 6.15e-06 3.7509e-06 40
end_path:michelremoving:michelremoving 2.157e-05 0.0429487 0.154664 0.0242773 0.0421598 40
end_path:michelremovinggnocchi:michelremoving 6.63e-06 0.0419381 0.155411 0.0225349 0.0421218 40
end_path:calibanagnocchi:CalibAnaTree 5.51e-06 0.389081 0.687307 0.413681 0.126368 40
end_path:out1:RootOutput(write) 0.516406 0.770425 1.03591 0.776803 0.143714 40
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5016.83 MB
Peak resident set size usage (VmHWM): 2669.69 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root
\tHists: np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728618704.0,
"core.end_time": 1728621943.0,
"core.events": [
9394,
9402,
9410,
9418,
9426,
9434,
9442,
9450,
9458,
9466,
9474,
9482,
9490,
9498,
9506,
9514,
9522,
9530,
9538,
9546,
9554,
9562,
9570,
9578,
9586,
9594,
9602,
9610,
9618,
9626,
9634,
9642,
9650,
9658,
9666,
9674,
9682,
9690,
9698,
9706
],
"core.event_count": 40,
"core.first_event_number": 9394,
"core.last_event_number": 9706,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27940
],
"core.runs_subruns": [
2794000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728618704.0,
"core.end_time": 1728621943.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27940
],
"core.runs_subruns": [
2794000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5"
}
]
}