Jobsub ID 166392.110@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 166392.110@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 5729 |
Stage ID | 1 |
User name | pgranger@fnal.gov |
HTCondor Group | group_dune |
Requested | Processors | 1 |
GPU | No |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 10800 (3 hours) |
Submitted time | 2025-03-26 17:09:15 |
Site | UK_Manchester |
Entry | UBoone_T2_UK_Manchester_ce02 |
Last heartbeat | 2025-03-26 20:38:50 |
From worker node | Hostname | wn1207240.tier2.hep.manchester.ac.uk |
cpuinfo | AMD EPYC 7702P 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 257400 (71 hours) |
GPU | |
Inner Apptainer? | True |
Job state | finished |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2025-03-26 18:19:38 |
Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2.root
|
Jobscript | Exit code | 0 |
Real time | 2h (8329s) |
CPU time | 2h (8011s = 96%) |
Max RSS bytes | 3399778304 (3242 MiB) |
Outputting started | 2025-03-26 20:38:27 |
Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/05729/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2_ana_2025-03-26T_181944Z.root
|
Finished | 2025-03-26 20:38:50 |
Saved logs | justin-logs:166392.110-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
iencegrid.org/sw/dune/2e65a52f75a809374d0c6186ed903ef86d6f1fff/trigger_ana/localProducts_larsoft_v10_04_07_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/2e65a52f75a809374d0c6186ed903ef86d6f1fff/trigger_ana/localProducts_larsoft_v10_04_07_e26_prof
local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/2e65a52f75a809374d0c6186ed903ef86d6f1fff/trigger_ana/localProducts_larsoft_v10_04_07_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.28 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.28 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.27 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.26 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.26 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.25 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::DepoTransform : 0.23 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::Reframer : 0.18 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::Reframer : 0.15 sec
[20:38:14.896] I [ timer ] Timer: WireCell::Gen::Reframer : 0.15 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.14 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.14 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.12 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.12 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.12 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.1 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.1 sec
[20:38:14.897] I [ timer ] Timer: wcls::FrameSaver : 0.09 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.07 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.05 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.05 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Reframer : 0.05 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Retagger : 0.04 sec
[20:38:14.897] I [ timer ] Timer: WireCell::Gen::Drifter : 0.04 sec
[20:38:14.897] I [ timer ] Timer: wcls::SimDepoSource : 0.01 sec
[20:38:14.897] I [ timer ] Timer: Total node execution : 28.019999688491225 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
=============== EVENT ID 75100 == RUN ID 50649927 == SUBRUN ID 1 ================
%MSG-w CAFMaker: AtmoAnalysis:analysistree@BeginModule 26-Mar-2025 20:38:26 GMT run: 50649927 subRun: 1 event: 75100
No AngularRecoOutput found with label 'anglereconuepfps'
%MSG
Number of spacepoints outside fiducial volume: 16
Number of spacepoints outside fiducial volume (pandora): 63
26-Mar-2025 20:38:26 GMT Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/df/9c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2.root"
26-Mar-2025 20:38:26 GMT Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/df/9c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 22.868 81.8557 1763.86 41.0416 186.643 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0108026 0.0330675 0.0671305 0.0342632 0.0127661 100
prod:energyrecnue:EnergyReco 0.101236 0.176756 0.514581 0.17166 0.0527028 100
prod:energyrecnumu:EnergyReco 0.00362497 0.144946 2.25578 0.0872776 0.294055 100
prod:energyrecnumurange:EnergyReco 0.000372142 0.0730677 1.83043 0.00452159 0.259157 100
prod:energyrecnumumcs:EnergyReco 0.00216552 0.0883669 1.84554 0.0268545 0.252498 100
prod:energyrecnc:EnergyReco 0.00330444 0.0199181 0.306502 0.00510962 0.0394347 100
prod:tpcrawdecoder:WireCellToolkit 16.553 73.7853 1748.05 33.0436 185.627 100
prod:tpmakerTPC:TriggerPrimitiveMakerTPC 5.43409 7.18665 7.84514 7.37799 0.602659 100
[art]:TriggerResults:TriggerResultInserter 1.8675e-05 3.4848e-05 0.000166575 2.98015e-05 2.12867e-05 100
end_path:analysistree:AtmoAnalysis 0.0896827 0.346608 2.90039 0.293585 0.323946 100
================================================================================================================================
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 22.868 81.8557 1763.86 41.0416 186.643 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0108026 0.0330675 0.0671305 0.0342632 0.0127661 100
prod:energyrecnue:EnergyReco 0.101236 0.176756 0.514581 0.17166 0.0527028 100
prod:energyrecnumu:EnergyReco 0.00362497 0.144946 2.25578 0.0872776 0.294055 100
prod:energyrecnumurange:EnergyReco 0.000372142 0.0730677 1.83043 0.00452159 0.259157 100
prod:energyrecnumumcs:EnergyReco 0.00216552 0.0883669 1.84554 0.0268545 0.252498 100
prod:energyrecnc:EnergyReco 0.00330444 0.0199181 0.306502 0.00510962 0.0394347 100
prod:tpcrawdecoder:WireCellToolkit 16.553 73.7853 1748.05 33.0436 185.627 100
prod:tpmakerTPC:TriggerPrimitiveMakerTPC 5.43409 7.18665 7.84514 7.37799 0.602659 100
[art]:TriggerResults:TriggerResultInserter 1.8675e-05 3.4848e-05 0.000166575 2.98015e-05 2.12867e-05 100
end_path:analysistree:AtmoAnalysis 0.0896827 0.346608 2.90039 0.293585 0.323946 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 22607.1 MB
Peak resident set size usage (VmHWM): 3399.78 MB
====================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 22607.1 MB
Peak resident set size usage (VmHWM): 3399.78 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 analysistree
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 7914.058766 Real = 8225.236036
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 22607.1 VmHWM = 3399.78
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 7064
-rw-r--r-- 1 dune01 dune01 3631698 Mar 26 20:38 wcls-sim-drift-simchannel.log
-rw-r--r-- 1 dune01 dune01 2301602 Mar 26 20:38 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2_ana_2025-03-26T_181944Z.root
-rw-r--r-- 1 dune01 dune01 852518 Mar 26 20:38 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_750_20231208T054455Z_gen_g4_detsim_hitreco__20240510T065439Z_reco2_reco_2025-03-26T_181944Z.log
-rw-r--r-- 1 dune01 dune01 404682 Mar 26 20:38 debug.log
-rw-r--r-- 1 dune01 dune01 10319 Mar 26 20:38 jobscript.log
-rw-r--r-- 1 dune01 dune01 201 Mar 26 20:38 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 138 Mar 26 18:19 all-input-dids.txt