justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 401876.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID401876.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7106
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-05-22 10:27:23
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-05-22 11:51:13
From worker nodeHostnamedunegli-5201595-0-fnpc23107.fnal.gov
cpuinfoAMD EPYC 9354 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-05-22 10:41:27
Input filesmonte-carlo-007106-005542
JobscriptExit code0
Real time1h (4147s)
CPU time1h (3992s = 96%)
Max RSS bytes11818336256 (11270 MiB)
Outputting started2025-05-22 11:50:35
Output filesusertests:extracted_wires_r401876_s00046_20250522T104130Z_401876_46_1.h5
Finished2025-05-22 11:51:13
Saved logsjustin-logs:401876.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
22-May-2025 11:46:28 UTC  Initiating request to open input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5.root"
22-May-2025 11:46:28 UTC  Opened input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88805 traces, 88805 summary
Retagger: tagging trace set: gauss with 75090 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75090 traces tagged "gauss"
FrameSaver: q=2.01171e+06 n=1139904 tag=gauss
wclsFrameSaver: saving 88805 traces tagged "wiener"
FrameSaver: q=2.20295e+06 n=1040284 tag=wiener
22-May-2025 11:46:58 UTC  Opened output file with pattern "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 114249 traces, 114249 summary
Retagger: tagging trace set: gauss with 90142 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90142 traces tagged "gauss"
FrameSaver: q=2.77288e+06 n=1380940 tag=gauss
wclsFrameSaver: saving 114249 traces tagged "wiener"
FrameSaver: q=3.08327e+06 n=1247963 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 83811 traces, 83811 summary
Retagger: tagging trace set: gauss with 70368 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 70368 traces tagged "gauss"
FrameSaver: q=1.91711e+06 n=1028373 tag=gauss
wclsFrameSaver: saving 83811 traces tagged "wiener"
FrameSaver: q=2.13892e+06 n=969408 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 114707 traces, 114707 summary
Retagger: tagging trace set: gauss with 91488 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91488 traces tagged "gauss"
FrameSaver: q=2.6874e+06 n=1401143 tag=gauss
wclsFrameSaver: saving 114707 traces tagged "wiener"
FrameSaver: q=2.96893e+06 n=1254517 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 89692 traces, 89692 summary
Retagger: tagging trace set: gauss with 73202 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73202 traces tagged "gauss"
FrameSaver: q=2.01948e+06 n=1088875 tag=gauss
wclsFrameSaver: saving 89692 traces tagged "wiener"
FrameSaver: q=2.27456e+06 n=1016472 tag=wiener
22-May-2025 11:49:59 UTC  Closed output file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root"
22-May-2025 11:49:59 UTC  Closed input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      26.6289       26.9768        27.52        26.8439      0.337857         5     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000440951   0.000746716   0.000997948   0.000878155   0.000234398       5     
simulate:wclsnfspbadapa1:WireCellToolkit        26.3465       26.703        27.1235       26.6415      0.290535         5     
[art]:TriggerResults:TriggerResultInserter    1.8808e-05    3.13316e-05   6.1073e-05    2.5619e-05    1.51058e-05       5     
end_path:out1:RootOutput                       3.144e-06    7.3588e-06    1.6274e-05     5.368e-06    4.67173e-06       5     
end_path:out1:RootOutput(write)                0.199902      0.271209      0.394139      0.261931      0.0677456        5     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4915.32 MB
  Peak resident set size usage (VmHWM): 3294.47 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root'}
extract
Running extract
['lar', '-c', 'run_extract_wire.fcl', 'placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root', '-n', '-1', '-e', '401876:46:1']
Stdout:
Begin processing the 1st record. run: 401876 subRun: 46 event: 1 at 22-May-2025 11:50:14 UTC
Begin processing the 2nd record. run: 401876 subRun: 46 event: 2 at 22-May-2025 11:50:17 UTC
Begin processing the 3rd record. run: 401876 subRun: 46 event: 3 at 22-May-2025 11:50:21 UTC
Begin processing the 4th record. run: 401876 subRun: 46 event: 4 at 22-May-2025 11:50:24 UTC
Begin processing the 5th record. run: 401876 subRun: 46 event: 5 at 22-May-2025 11:50:29 UTC
Art has completed and will exit with status 0.

Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_01_03d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25608 nodes/ 5535 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
22-May-2025 11:50:13 UTC  Initiating request to open input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root"
22-May-2025 11:50:14 UTC  Opened input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root"
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
initializeNtuple() called with cflag_=6
22-May-2025 11:50:34 UTC  Closed input file "placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6.root"

======================================================================================================================
TimeTracker printout (sec)              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================
Full event                            1.17408       2.13539       3.27138       1.93636      0.743203         5     
----------------------------------------------------------------------------------------------------------------------
source:RootInput(read)              0.000477406   0.000892371   0.00147928    0.000868291   0.000378575       5     
end_path:extractwire:ExtractWire      1.17302       2.1342        3.27005       1.93568      0.743032         5     
======================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3131.54 MB
  Peak resident set size usage (VmHWM): 2277.31 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'placeholder_1_401876_46_1747910493_stage1_stage2_stage3_stage4_stage5_stage6_extract.root', 'start_time': 1747914600.01908, 'end_time': 1747914634.984887}
extracted_wires_r401876_s00046.h5
justIN time: 2025-05-22 15:38:08 UTC       justIN version: 01.03.01