justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301494.108@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301494.108@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:14:08
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:12:44
From worker nodeHostnamedune001-2995018.0-lcg2702.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:32:21
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2.root
JobscriptExit code0
Real time33m (2026s)
CPU time34m (2060s = 101%)
Outputting started2024-11-23 00:06:08
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2.root
Finished2024-11-23 00:12:44
Saved logsjustin-logs:301494.108-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

onCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:01 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:01 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:01 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:02 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:02 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:02 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:02 UTC run: 6432497 subRun: 1 event: 31200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 3013, 3174, 2087
minwire 0: 2208
minwire 1: 800
minwire 2: 1963
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0156973, 0.849723, 0.134579, 
Output 1: 0.150133, 0.425079, 0.328718, 0.0960705, 
Output 2: 0.0898677, 0.910132, 

833
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3137!
23-Nov-2024 00:06:07 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2_reco_data_2024-11-22T_233229Z.root"
23-Nov-2024 00:06:07 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/53/35/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.41606       18.6644       197.439       7.55897       31.606         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00238069     0.109189      0.791636      0.0878014     0.101746        100    
reco:linecluster:LineCluster                           0.0475623     0.406646       6.09392      0.269975      0.676371        100    
reco:trajcluster:TrajCluster                           0.0069834     0.516586       17.3038      0.121287       2.01416        100    
reco:pandora:StandardPandora                            1.06404       1.65366       14.308        1.27151       1.76142        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000135684   0.00479404     0.0584328     0.0014422    0.00908569       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000183506    0.0126461     0.301811     0.00267062     0.0376633       100    
reco:pandoracalo:Calorimetry                          9.0106e-05     0.0106382     0.277787     0.000834849    0.0360431       100    
reco:pandorapid:Chi2ParticleID                         3.317e-05    0.000155452   0.00157257    0.000127536   0.000172083      100    
reco:trkshowersplit:TrackShowerHits                   0.000115684    0.0142983     0.397869     0.00054209     0.0538814       100    
reco:pmtrack:PMAlgTrackMaker                          0.00150996      1.72999       40.4629      0.115603       5.57616        100    
reco:pmtrackcalo:Calorimetry                          6.8803e-05    0.00429069     0.105338     0.000734067    0.0123469       100    
reco:pmtrackpid:Chi2ParticleID                        2.9203e-05    0.000210085   0.00182973    0.000127867   0.000252895      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000222384     1.33236       19.1437      0.261174       3.09077        100    
reco:pmtrajfitcalo:Calorimetry                        5.9069e-05    0.00999052     0.195272     0.00116337     0.0317351       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.4947e-05    0.000162921   0.000582825    0.0001331    0.000110303      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00134163      1.76925        34.18       0.146751        5.092         100    
reco:pmtracktccalo:Calorimetry                        7.0766e-05    0.00385592     0.0815307    0.000833877   0.00994745       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7942e-05    0.000196603   0.00136381    0.000130516   0.00019478       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000242824    0.911893       10.363       0.190695       1.83981        100    
reco:pmtrajfittccalo:Calorimetry                      7.1708e-05    0.00636022      0.11441     0.000999532    0.0168969       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.8693e-05    0.000261961   0.00169984    0.000149785   0.000297817      100    
reco:blurredcluster:BlurredClustering                 0.00406165     0.828027       5.56777      0.471123       1.05062        100    
reco:emtrkmichelid:EmTrackMichelId                     0.199623       6.59055       63.7286       1.63596       11.359         100    
reco:emshower:EMShower                                0.000251668    0.0154266     0.173854      0.0026988     0.0310976       100    
reco:cvnmap:CVNMapper                                  1.958e-05    0.00573146     0.0418177    0.00417136    0.00783223       100    
reco:cvneva:CVNEvaluator                              1.5823e-05     0.502255       1.0341       0.614042      0.362617        100    
reco:energyrecnumu:EnergyReco                         0.000366251    0.0227281     0.302747     0.00661018     0.0513321       100    
reco:energyrecnue:EnergyReco                          0.000118017    0.0014754     0.0202418    0.000513476   0.00294937       100    
reco:energyrecnc:EnergyReco                           0.00126362    0.00324326     0.0238876    0.00245856    0.00312201       100    
reco:energyrecnumurange:EnergyReco                    0.000171878    0.0182827     0.294761     0.00239152     0.0503659       100    
reco:energyrecnumumcs:EnergyReco                      0.000722245    0.0193921     0.307939     0.00277712     0.0510484       100    
reco:opdec:Deconvolution                               0.075735      0.341492       2.80284       0.30608       0.28802        100    
reco:ophitspe:OpHitFinderDeco                          0.411125       1.60965       3.19262       1.52008      0.686369        100    
reco:opflash:OpFlashFinder                            0.000406961   0.00141462    0.00558467    0.00133407    0.000673489      100    
reco:rns:RandomNumberSaver                            2.1402e-05    3.63255e-05   0.000323826   2.86835e-05   3.13154e-05      100    
reco:anglereconue:NuAngularReco                       0.000170166   0.00118928     0.0164255    0.000389931    0.0023923       100    
reco:anglereconumu:NuAngularReco                      5.1648e-05    0.000939672    0.0149858    0.00019972    0.00226321       100    
reco:anglereconuepfps:NuAngularReco                   9.3941e-05    0.00108076     0.0150813    0.000316346   0.00239303       100    
reco:anglereconumupfps:NuAngularReco                   6.638e-05    0.000988809    0.0148863    0.000237658   0.00226004       100    
[art]:TriggerResults:TriggerResultInserter             8.993e-06    1.38771e-05   9.1958e-05    1.2564e-05    8.30462e-06      100    
end_path:out1:RootOutput                               3.585e-06    5.65492e-06   6.5379e-05     4.432e-06    6.16819e-06      100    
end_path:out1:RootOutput(write)                        0.033891      0.200948      0.723856      0.221105      0.131601        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40216.3 MB
  Peak resident set size usage (VmHWM): 2406.98 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2_reco_2024-11-22T_233229Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_311_20231206T032930Z_gen_g4_detsim_hitreco__20240510T035314Z_reco2_reco_data_2024-11-22T_233229Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:53:47 UTC       justIN version: 01.01.09