justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108551.54@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108551.54@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:16:35
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:17:27
From worker nodeHostnamedune001-2993211.0-lcg2706.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:33
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2.root
JobscriptExit code0
Real time32m (1979s)
CPU time34m (2065s = 104%)
Outputting started2024-11-23 00:06:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2.root
Finished2024-11-23 00:17:27
Saved logsjustin-logs:108551.54-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ttc@BeginModule  23-Nov-2024 00:06:04 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:04 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:27 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:27 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:27 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:27 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:27 UTC run: 50624901 subRun: 1 event: 41400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1218, 1267, 946
minwire 0: 2493
minwire 1: 558
minwire 2: 2380
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00958019, 0.981407, 0.00901251, 
Output 1: 0.660569, 0.322896, 0.014122, 0.00241299, 
Output 2: 0.304192, 0.695808, 

607
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2292!
23-Nov-2024 00:06:31 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2_reco_data_2024-11-22T_233336Z.root"
23-Nov-2024 00:06:31 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/37/c1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.408419       18.325        255.794       9.00132       32.5776        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00292533     0.117799      0.678118      0.096645      0.102367        100    
reco:linecluster:LineCluster                           0.0295914     0.427616       8.20553      0.279265      0.930291        100    
reco:trajcluster:TrajCluster                          0.000768368    0.417843       9.59916      0.128508       1.29684        100    
reco:pandora:StandardPandora                           0.0548394      1.63456       17.3113       1.28091       1.80597        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000125559   0.00471854     0.0337597    0.00187881    0.00738607       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000175354   0.00853542     0.133217     0.00239263     0.0179984       100    
reco:pandoracalo:Calorimetry                           8.597e-05     0.0116739      0.41393     0.00144837     0.0459568       100    
reco:pandorapid:Chi2ParticleID                        3.4092e-05    0.000163258   0.00207606    0.00012245    0.000209915      100    
reco:trkshowersplit:TrackShowerHits                   9.5605e-05     0.0126092     0.281964     0.00080218     0.0410376       100    
reco:pmtrack:PMAlgTrackMaker                          0.000935961     1.60121       50.2159      0.209228       5.57816        100    
reco:pmtrackcalo:Calorimetry                          5.3701e-05    0.00513782     0.0791545     0.0010652     0.0128007       100    
reco:pmtrackpid:Chi2ParticleID                         2.013e-05    0.000230763    0.0015271    0.000140277   0.000277397      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000162895     1.5333        33.4354       0.32955       4.07717        100    
reco:pmtrajfitcalo:Calorimetry                        4.1763e-05     0.0134918     0.611693     0.00161664     0.0639964       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.009e-05    0.000166205   0.000858754   0.000139821   0.000119177      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000810431     1.74659       41.4004      0.210735       5.23829        100    
reco:pmtracktccalo:Calorimetry                        4.9144e-05    0.00285695     0.029633     0.00112377    0.00531219       100    
reco:pmtracktcpid:Chi2ParticleID                      2.1712e-05    0.000202099   0.000851093   0.000141438   0.000189238      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000109726    0.894899       15.2042      0.236579       1.95123        100    
reco:pmtrajfittccalo:Calorimetry                      4.0471e-05    0.00670042     0.182294     0.00143561     0.0208715       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.8407e-05    0.000261419   0.00187235    0.000151809   0.000306064      100    
reco:blurredcluster:BlurredClustering                 0.000196697    0.841144       5.29143      0.474028       1.07473        100    
reco:emtrkmichelid:EmTrackMichelId                    7.6275e-05      6.55224       70.1253       2.8021        11.2945        100    
reco:emshower:EMShower                                0.00012643     0.0234075     0.241765     0.00549751     0.0397382       100    
reco:cvnmap:CVNMapper                                 1.4982e-05    0.00599566     0.0477497    0.00399871    0.00774352       100    
reco:cvneva:CVNEvaluator                               1.356e-05     0.450167      0.873094      0.554675      0.316723        100    
reco:energyrecnumu:EnergyReco                         0.000299181    0.0214487      0.48698     0.00556701     0.0569117       100    
reco:energyrecnue:EnergyReco                          0.000102074   0.00124898     0.0152829    0.000459873   0.00221721       100    
reco:energyrecnc:EnergyReco                            0.0012992    0.00288409     0.0185246    0.00230133    0.00245387       100    
reco:energyrecnumurange:EnergyReco                    0.000162004    0.0192135     0.482722     0.00219599     0.0592592       100    
reco:energyrecnumumcs:EnergyReco                      0.000890893    0.0194265     0.479942     0.00276157     0.0553074       100    
reco:opdec:Deconvolution                               0.0299311     0.322588      0.808672      0.298556      0.149817        100    
reco:ophitspe:OpHitFinderDeco                          0.0775051      1.43028       2.68965       1.43141      0.588705        100    
reco:opflash:OpFlashFinder                            0.000143656   0.00122115    0.00534023    0.00113791    0.000630904      100    
reco:rns:RandomNumberSaver                            1.7717e-05    3.51911e-05   0.000414455   2.56035e-05   4.91514e-05      100    
reco:anglereconue:NuAngularReco                       0.000153852   0.000992158    0.0130321    0.000387444   0.00184707       100    
reco:anglereconumu:NuAngularReco                      5.8718e-05    0.000761512    0.0131057    0.000202035   0.00179051       100    
reco:anglereconuepfps:NuAngularReco                   0.000113151   0.000897223    0.0132365    0.000310288   0.00180834       100    
reco:anglereconumupfps:NuAngularReco                  8.1644e-05     0.0008124     0.0132982    0.000259307   0.00180965       100    
[art]:TriggerResults:TriggerResultInserter             7.372e-06    1.11915e-05   4.7221e-05    1.04555e-05   4.51213e-06      100    
end_path:out1:RootOutput                               2.574e-06    4.12844e-06   2.0581e-05     3.39e-06     2.75473e-06      100    
end_path:out1:RootOutput(write)                        0.0124386     0.188001      0.642059      0.192458      0.124483        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40369.3 MB
  Peak resident set size usage (VmHWM): 2587.48 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2_reco_2024-11-22T_233336Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50624901_413_20231207T125824Z_gen_g4_detsim_hitreco__20240510T043214Z_reco2_reco_data_2024-11-22T_233336Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:42:32 UTC       justIN version: 01.01.09