justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301489.185@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301489.185@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:05:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:14:56
From worker nodeHostnamedune001-3354546.0-lcg2693.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:11
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
JobscriptExit code0
Real time46m (2769s)
CPU time48m (2907s = 104%)
Outputting started2024-11-23 00:09:21
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
Finished2024-11-23 00:14:56
Saved logsjustin-logs:301489.185-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

me plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:13 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:15 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:15 UTC run: 74525168 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 52, 56, 43
minwire 0: 709
minwire 1: 1971
minwire 2: 373
Used alternate method to get min and max wires due to vertex determination failure: 135, 334
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 264, 463
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 107, 306
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.994654, 0.000510243, 0.00483564, 
Output 1: 0.814583, 0.179646, 0.00528429, 0.00048699, 
Output 2: 0.99692, 0.00307978, 

432
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1445!
23-Nov-2024 00:09:19 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_data_2024-11-22T_232316Z.root"
23-Nov-2024 00:09:19 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9d/5d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.872177       26.2802       505.827       8.44058       64.606         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0014201     0.111001      0.475174      0.0765073     0.097483        100    
reco:linecluster:LineCluster                           0.0437083     0.677363       26.5249      0.169511       3.13155        100    
reco:trajcluster:TrajCluster                          0.00350165     0.825498       37.873       0.061415       4.21735        100    
reco:pandora:StandardPandora                           0.111426       2.85164       61.3671       1.44958       7.58062        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000183726   0.00512553     0.0603312    0.00124856    0.00910631       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000257267    0.0115364     0.190361     0.00223568     0.024278        100    
reco:pandoracalo:Calorimetry                          0.000125208    0.017438      0.482763     0.000751395    0.0657434       100    
reco:pandorapid:Chi2ParticleID                         4.649e-05    0.000187953   0.00136682    0.000132153   0.000177391      100    
reco:trkshowersplit:TrackShowerHits                   0.000104216    0.0262599     0.932382     0.000638295    0.110676        100    
reco:pmtrack:PMAlgTrackMaker                          0.00153654      2.83186       87.3507      0.128343       10.9103        100    
reco:pmtrackcalo:Calorimetry                          8.1933e-05     0.0066117     0.197587     0.000814094    0.0217337       100    
reco:pmtrackpid:Chi2ParticleID                        3.1357e-05    0.000283124   0.00320851    0.000155769   0.000405447      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000238489     2.09054       56.078       0.157655       7.16914        100    
reco:pmtrajfitcalo:Calorimetry                         6.626e-05     0.015771      0.437001     0.00100085     0.0616786       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.1748e-05    0.000197407   0.000623768   0.000167702   0.000126477      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00140464      2.88741       98.4291       0.22843       11.4258        100    
reco:pmtracktccalo:Calorimetry                        8.8303e-05    0.00441442     0.0990322    0.000836032    0.0118854       100    
reco:pmtracktcpid:Chi2ParticleID                      3.2609e-05    0.000260506   0.00229304    0.000168684   0.000330241      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000204768     1.40752       30.9404       0.25492       3.83037        100    
reco:pmtrajfittccalo:Calorimetry                      8.2874e-05     0.0115098     0.407967     0.000968096    0.0460834       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.1177e-05    0.000351377   0.00341683    0.000184728   0.000508041      100    
reco:blurredcluster:BlurredClustering                 0.00026598     0.935947       6.44593      0.377416       1.26704        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000124748     8.37129       123.084       1.98622       16.7054        100    
reco:emshower:EMShower                                0.000184258    0.0276496     0.245196     0.00494869     0.0465229       100    
reco:cvnmap:CVNMapper                                 1.9429e-05    0.00816113     0.0446986    0.00461952     0.0113308       100    
reco:cvneva:CVNEvaluator                              2.0331e-05     0.584974       1.18368      0.737833      0.483521        100    
reco:energyrecnumu:EnergyReco                         0.000367062    0.0324045     0.499774     0.00688504     0.0890936       100    
reco:energyrecnue:EnergyReco                          0.000121132   0.00175567     0.024383     0.000560783   0.00312279       100    
reco:energyrecnc:EnergyReco                           0.00167768    0.00416347     0.0299009    0.00309108    0.00340868       100    
reco:energyrecnumurange:EnergyReco                    0.000202404    0.029565      0.529527     0.00297871     0.0915919       100    
reco:energyrecnumumcs:EnergyReco                      0.00181738     0.0313315     0.543949     0.00334327     0.0928174       100    
reco:opdec:Deconvolution                               0.0957867      0.3139       0.800611      0.300821      0.145485        100    
reco:ophitspe:OpHitFinderDeco                          0.165231       1.90237       4.21739       1.84939      0.876613        100    
reco:opflash:OpFlashFinder                            0.000130877   0.00157773    0.00528254    0.00146523    0.000802456      100    
reco:rns:RandomNumberSaver                            2.1482e-05    3.83696e-05   0.000434804   2.99755e-05   4.33271e-05      100    
reco:anglereconue:NuAngularReco                       0.00015964    0.00135653     0.0190727    0.000409557   0.00254152       100    
reco:anglereconumu:NuAngularReco                       5.962e-05    0.00108739     0.0176569    0.000199996   0.00234499       100    
reco:anglereconuepfps:NuAngularReco                   0.000145098   0.00124922     0.0173605    0.000355655   0.00233526       100    
reco:anglereconumupfps:NuAngularReco                  0.000120512    0.0011371     0.0166329    0.000261413    0.0022768       100    
[art]:TriggerResults:TriggerResultInserter            1.0376e-05    1.4906e-05    5.0056e-05    1.36005e-05   5.69632e-06      100    
end_path:out1:RootOutput                               3.185e-06    4.17511e-06   2.1192e-05    3.8005e-06    1.84339e-06      100    
end_path:out1:RootOutput(write)                        0.0162366     0.245281       1.21177      0.250946      0.194076        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40457.1 MB
  Peak resident set size usage (VmHWM): 2672.66 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_2024-11-22T_232316Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_623_20231206T234852Z_gen_g4_detsim_hitreco__20240510T063156Z_reco2_reco_data_2024-11-22T_232316Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 16:03:11 UTC       justIN version: 01.01.09