justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301550.87@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301550.87@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:32:58
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:23
From worker nodeHostnamedune001-2995246.0-lcg2699.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:47:52
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2.root
JobscriptExit code0
Real time24m (1495s)
CPU time29m (1756s = 117%)
Outputting started2024-11-23 00:12:48
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2.root
Finished2024-11-23 00:26:23
Saved logsjustin-logs:301550.87-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:15 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:15 UTC run: 6419587 subRun: 1 event: 24800
Track empty.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:15 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:42 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:42 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:42 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:42 UTC run: 6419587 subRun: 1 event: 24800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2323, 2008, 1441
minwire 0: 400
minwire 1: 2241
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0358182, 0.798808, 0.165374, 
Output 1: 0.192385, 0.664754, 0.126811, 0.0160506, 
Output 2: 0.0629507, 0.937049, 

681
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2605!
23-Nov-2024 00:12:47 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2_reco_data_2024-11-22T_234755Z.root"
23-Nov-2024 00:12:47 UTC  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/4e/7f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.492798       14.4765       151.591       6.85916       24.3159        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00144294     0.0138015     0.0527665     0.0152843     0.0106919       100    
reco:linecluster:LineCluster                          0.00167125     0.0611189      2.02087      0.0153344      0.24098        100    
reco:trajcluster:TrajCluster                          0.00102098     0.200816       7.37033      0.0119497     0.852726        100    
reco:pandora:StandardPandora                           0.0173335      1.32857       10.9796       1.05831       1.4098         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000117577   0.00358738     0.0359103    0.00116758    0.00602163       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000154542   0.00957123     0.162023     0.00238286     0.0218756       100    
reco:pandoracalo:Calorimetry                          8.1252e-05    0.00792262     0.177623     0.000670074    0.0259239       100    
reco:pandorapid:Chi2ParticleID                         3.284e-05    0.000126391   0.00111691     9.298e-05    0.000124788      100    
reco:trkshowersplit:TrackShowerHits                   8.8423e-05     0.0108009     0.263394     0.000671155    0.0398673       100    
reco:pmtrack:PMAlgTrackMaker                          0.000889719     1.08912       17.5893      0.156462       2.95914        100    
reco:pmtrackcalo:Calorimetry                          4.7572e-05    0.00407193      0.08346     0.000720529    0.0120057       100    
reco:pmtrackpid:Chi2ParticleID                        1.8929e-05    0.000186033   0.00135976    0.000116465   0.000228412      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000128453     1.09396       14.374       0.209621       2.45907        100    
reco:pmtrajfitcalo:Calorimetry                        4.1412e-05    0.00771069     0.167941     0.00104278     0.0237451       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8488e-05    0.000135637   0.000427173   0.000110677   8.88129e-05      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000673634     1.19827       20.6554      0.164637       3.10251        100    
reco:pmtracktccalo:Calorimetry                        4.5488e-05    0.00322844     0.040352     0.000801396   0.00761909       100    
reco:pmtracktcpid:Chi2ParticleID                      1.7867e-05    0.000167381   0.000988768   0.000118979   0.000161044      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000109645    0.733465       10.2261       0.1922        1.57373        100    
reco:pmtrajfittccalo:Calorimetry                       3.959e-05    0.00620698     0.125215     0.00100593     0.0200099       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6786e-05    0.000230688   0.00188295    0.000133672   0.000316649      100    
reco:blurredcluster:BlurredClustering                 0.000237368    0.763442       4.86427       0.41196      0.955698        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000122014     6.03734       67.6423       2.22714       11.0203        100    
reco:emshower:EMShower                                0.000195804    0.014567       0.19484     0.00315491     0.0266866       100    
reco:cvnmap:CVNMapper                                 1.8087e-05    0.00581652     0.0353072    0.00412646     0.0071793       100    
reco:cvneva:CVNEvaluator                              1.5012e-05     0.454655      0.907643       0.55976      0.304895        100    
reco:energyrecnumu:EnergyReco                         0.000290638    0.0167163     0.381743     0.00585788     0.0436816       100    
reco:energyrecnue:EnergyReco                          0.000108333   0.00109162     0.0101605    0.00048488    0.00167087       100    
reco:energyrecnc:EnergyReco                           0.00126844    0.00263092     0.0120655    0.00223006    0.00178632       100    
reco:energyrecnumurange:EnergyReco                    0.00015316     0.0134513      0.35851     0.00162464     0.0419647       100    
reco:energyrecnumumcs:EnergyReco                      0.00122606     0.014424       0.36581     0.00252963     0.0424496       100    
reco:opdec:Deconvolution                                0.01231      0.121547      0.233222      0.118413      0.0542469       100    
reco:ophitspe:OpHitFinderDeco                          0.091692       1.08822       2.4713       0.984124      0.572158        100    
reco:opflash:OpFlashFinder                            0.000229846   0.00109256    0.00482808     0.0010753    0.000568454      100    
reco:rns:RandomNumberSaver                            1.7136e-05    2.71933e-05   0.000328975   2.2454e-05    3.10039e-05      100    
reco:anglereconue:NuAngularReco                       0.000142234   0.000787396   0.00913677    0.000337623   0.00139675       100    
reco:anglereconumu:NuAngularReco                      4.9604e-05    0.000594278   0.00877325    0.000151794   0.00134063       100    
reco:anglereconuepfps:NuAngularReco                   9.2709e-05    0.00071313     0.0089254    0.000266236   0.00136732       100    
reco:anglereconumupfps:NuAngularReco                  6.9985e-05    0.000643449   0.00903006    0.000212064   0.00136895       100    
[art]:TriggerResults:TriggerResultInserter             8.292e-06    1.20027e-05   4.8723e-05    1.0611e-05    5.38183e-06      100    
end_path:out1:RootOutput                               3.045e-06    4.23572e-06   2.3275e-05    3.5705e-06    2.16336e-06      100    
end_path:out1:RootOutput(write)                        0.0165191     0.163997      0.509255      0.165351      0.101498        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40134.1 MB
  Peak resident set size usage (VmHWM): 2360.94 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2_reco_2024-11-22T_234755Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_247_20231204T001602Z_gen_g4_detsim_hitreco__20240509T203816Z_reco2_reco_data_2024-11-22T_234755Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:03:52 UTC       justIN version: 01.01.09