justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 404805.122@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID404805.122@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7257
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-05-31 11:29:15
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-06-01 15:29:03
From worker nodeHostnamedunegli-42342-0-cmswn2385.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-01 03:16:04
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T085635Z_gen_002684_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time12h (43909s)
CPU time12h (43706s = 99%)
Max RSS bytes1757454336 (1676 MiB)
Outputting started2025-06-01 15:27:55
Output files
Finished2025-06-01 15:29:03
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

9.65, 121.42, 1654.27 )
*** Matched flash: 
 - Purity 0.00 Plane 2 #Hits 5 PE 645.51 MaxPE 270.51
 - Time 776.53 Fast 0.79 Residual 30746.44
 - Reco Time,Y,Z ( 776.53, -743.30, 1641.62 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 106.25, 120.06, 1659.29 )
 - Reco X,Y,Z ( 229.80, 121.42, 1654.27 )
%MSG
Begin processing the 10th record. run: 5004 subRun: 0 event: 26840 at 01-Jun-2025 14:29:30 UTC
%MSG-i SolarNuAna:  SolarNuAna:solarnuana@BeginModule 01-Jun-2025 14:29:34 UTC  run: 5004 subRun: 0 event: 26840

#########################################
Event: 26840 Flag: 1043734946
TPC Frequency in [MHz]: 2.00
TPC Tick in [us]: 0.50
TPC DriftLength in [cm]: 650.07
TPC DriftTime in [us]: 4048.69
#########################################
%MSG
%MSG-i SolarNuAna:  SolarNuAna:solarnuana@BeginModule 01-Jun-2025 14:29:35 UTC  run: 5004 subRun: 0 event: 26840

There are a total of 133142 Particles in the event

# of particles 42	from gen 1 marley
# of particles 31198	from gen 2 Ar39GenInLAr
# of particles 3618	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 35	from gen 6 Rn222ChainRn222GenInLAr
# of particles 31	from gen 7 Rn222ChainPo218GenInLAr
# of particles 35	from gen 8 Rn222ChainPb214GenInLAr
# of particles 63	from gen 9 Rn222ChainBi214GenInLAr
# of particles 15	from gen 10 Rn222ChainPb210GenInLAr
# of particles 12	from gen 11 Rn220ChainPb212GenInLAr
# of particles 216	from gen 12 K40GenInCathode
# of particles 2910	from gen 13 U238ChainGenInCathode
# of particles 3636	from gen 14 Th232ChainGenInCathode
# of particles 98	from gen 15 K40GenInAnode
# of particles 1483	from gen 16 U238ChainGenInAnode
# of particles 1726	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 16	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 34	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 45	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 26	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 39	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 10	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i SolarNuAna:  SolarNuAna:solarnuana@BeginModule 01-Jun-2025 14:29:35 UTC  run: 5004 subRun: 0 event: 26840

Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 44.03 MeV
Position (314.60, 697.87, 1357.81) cm
Gen.	PdgCode		Energy		EndPosition		Mother
------------------------------------------------------------------------
marley	11		0.54	 (505.89, 306.62, 1128.89)	133169
marley	-12		0.12	 (-569.30, 5033.92, 499.14)	133169
marley	1000060140	13040.91 (505.89, 306.62, 1128.89)	133091
marley	2212		938.86	 (505.89, 306.62, 1128.89)	133091
marley	2212		938.27	 (493.41, 280.33, 1138.04)	133091
marley	2212		938.27	 (501.44, 272.68, 1144.56)	133091
marley	1000070140	13040.20 (501.94, 272.87, 1144.68)	133091
marley	1000260560	52089.81 (505.39, 267.68, 1147.91)	133091
marley	1000070140	13040.20 (505.38, 267.70, 1147.91)	133091
marley	1000260560	52089.81 (505.50, 269.11, 1145.67)	133091
marley	1000070140	13040.20 (506.33, 269.54, 1145.82)	133091
marley	1000080160	14895.08 (502.75, 270.17, 1144.15)	133091
marley	1000070140	13040.20 (505.22, 270.14, 1144.40)	133091
marley	1000070140	13040.20 (505.23, 270.14, 1144.39)	133091
marley	1000070140	13040.20 (505.30, 269.99, 1144.95)	133091
marley	1000260560	52089.81 (505.22, 270.74, 1144.73)	133091
marley	1000060120	11174.86 (504.32, 268.71, 1149.92)	133091
marley	1000080160	14895.08 (505.20, 269.07, 1148.26)	133091
marley	1000280580	53952.16 (505.69, 271.49, 1147.85)	133091
marley	1000070140	13040.20 (506.54, 273.55, 1148.76)	133091
marley	1000070140	13040.21 (506.54, 273.52, 1148.73)	133091
marley	2212		938.28	 (504.53, 279.09, 1148.19)	133091
marley	2212		938.36	 (495.52, 286.89, 1160.95)	133091
marley	2212		938.39	 (443.64, 295.32, 1145.76)	133091
marley	1000180400	37215.55 (306.54, 464.42, 891.22)	133091
marley	1000180400	37215.54 (317.13, 470.46, 891.84)	133091
marley	1000060120	11174.87 (434.25, 572.70, 1327.88)	133091
marley	1000060120	11174.88 (434.24, 572.59, 1328.09)	133091
marley	1000060120	11174.96 (437.38, 573.44, 1333.89)	133091
marley	1000060120	11174.95 (435.95, 572.28, 1317.56)	133091
marley	2212		939.72	 (432.91, 571.40, 1318.90)	133091
marley	1000180400	37215.55 (322.10, 701.07, 1363.74)	133091
marley	1000180400	37215.74 (319.79, 706.07, 1367.25)	133091
marley	22		0.00	 (324.94, 697.87, 1361.01)	133089
marley	22		0.00	 (324.93, 697.87, 1361.01)	133089
marley	22		1.46	 (509.33, 627.96, 1298.14)	133089
marley	1000180400	37215.71 (324.93, 697.87, 1361.01)	133089
marley	2112		941.65	 (505.89, 306.62, 1128.89)	133089
marley	1000180400	37215.54 (324.51, 697.86, 1360.82)	133089
marley	2112		943.28	 (324.93, 697.87, 1361.01)	0
marley	1000190390	36284.87 (314.60, 697.87, 1357.81)	0
marley	11		31.41	 (312.42, 701.78, 1366.74)	0
Signal Track IDs: 133087; 133088; 133089; 133090; 133091; 133092; 133093; 133094; 133095; 133133; 133134; 133135; 133136; 133137; 133138; 133139; 133140; 133141; 133142; 133143; 133144; 133145; 133146; 133147; 133148; 133149; 133150; 133151; 133152; 133153; 133154; 133155; 133156; 133158; 133159; 133160; 133161; 133162; 133168; 133169; 133171; 133172; 
%MSG
%MSG-i SolarNuAna:  SolarNuAna:solarnuana@BeginModule 01-Jun-2025 14:29:50 UTC  run: 5004 subRun: 0 event: 26840
OpFlash PE 52.42 with purity 0.00 time -0.76 plane 2
 - Vertex (239.20, -743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 141.41 with purity 0.00 time 0.22 plane 1
 - Vertex (104.38, 743.30, 152.42)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 27.03 with purity 0.44 time 0.96 plane 0
 - Vertex (-327.50, 433.81, 982.71)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 7489.96 with purity 0.10 time 1.08 plane 1
 - Vertex (285.07, 743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 27.16 with purity 0.70 time 1.06 plane 0
 - Vertex (-327.50, 185.06, 1694.88)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 15.40 with purity 0.00 time 0.78 plane 0
 - Vertex (-327.50, 402.77, 1426.94)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 80.03 with purity 0.57 time 1.10 plane 1
 - Vertex (164.48, 743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 531.80 with purity 0.56 time 1.85 plane 1
 - Vertex (210.07, 743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.71 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

%MSG
%MSG-i SolarNuAna:  SolarNuAna:solarnuana@BeginModule 01-Jun-2025 14:29:50 UTC  run: 5004 subRun: 0 event: 26840

# OpHits (ophit10ppm) in full geometry: 52011
# OpFlashes (solarflash) in full geometry: 4061
# Hits (gaushit) in each view: 6742, 6709, 6681, 0
# Cluster from the hits: 2838, 2862, 5706, 0
# Tracks (pmtracktc) in full geometry: 0
%MSG
01-Jun-2025 15:27:52 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/77/0b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T085635Z_gen_002684_supernova_g4stage1_g4stage2_detsim_reco.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          3498.31       4381.66       5440.75       4371.01       574.086        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000640266   0.00797871     0.0469991     0.0010495     0.0147909       10     
end_path:solarnuana:SolarNuAna      3498.28       4381.65       5440.74       4371.01       574.086        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 01-Jun-2025 15:27:52 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2485.39 MB
  Peak resident set size usage (VmHWM): 1757.45 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 43681.937825 Real = 43876.744351

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2485.39 VmHWM = 1757.45

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Output file: fdhd_ana_2025-06-01T_031613Z.root
Output hist file: fdhd_ana_2025-06-01T_031613Z_hist.root
lar exit code 0
justIN time: 2025-08-14 18:19:22 UTC       justIN version: 01.03.02