justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108546.172@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108546.172@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:03:58
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:06:59
From worker nodeHostnamedune001-3354920.0-lcg2708.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:26:48
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2.root
JobscriptExit code0
Real time32m (1931s)
CPU time31m (1868s = 96%)
Outputting started2024-11-22 23:59:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2.root
Finished2024-11-23 00:06:59
Saved logsjustin-logs:108546.172-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

th KE=0.437434 GeV, E=1.37571 GeV, p2=1.01221
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:56 UTC run: 6405486 subRun: 1 event: 34000
1st wire C:0 T:5 P:2 W:487 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:57 UTC run: 6405486 subRun: 1 event: 34000
Comparing two wires in the same plane: return failure
%MSG
343
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1030!
22-Nov-2024 23:58:59 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2_reco_data_2024-11-22T_232710Z.root"
22-Nov-2024 23:58:59 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/a4/fe/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.607443       17.8325       155.534       10.0534       25.1396        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00123445     0.116622      0.727128      0.079518      0.109574        100    
reco:linecluster:LineCluster                           0.033727      0.262991       1.79971      0.175049      0.309323        100    
reco:trajcluster:TrajCluster                          0.00119988     0.304602       11.4157      0.060813       1.22788        100    
reco:pandora:StandardPandora                           0.0682663      1.63172       9.2337        1.36608       1.11168        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000155084   0.00414197     0.0341693    0.00184805    0.00561874       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000227572    0.0107166     0.160848     0.00321465     0.0216454       100    
reco:pandoracalo:Calorimetry                          0.000115514   0.00692646     0.0906815    0.00122553     0.0163008       100    
reco:pandorapid:Chi2ParticleID                        4.4407e-05    0.000163485   0.000440322   0.000154032   8.37807e-05      100    
reco:trkshowersplit:TrackShowerHits                   0.000118268    0.0101932     0.293967     0.000869458    0.0357006       100    
reco:pmtrack:PMAlgTrackMaker                          0.00116716      1.24848       16.1209      0.267329       2.72138        100    
reco:pmtrackcalo:Calorimetry                          7.0116e-05    0.00487641     0.0856601    0.00108091     0.0122639       100    
reco:pmtrackpid:Chi2ParticleID                        2.5378e-05    0.000252692   0.00190186    0.00017637    0.000287789      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000205479     1.19871       15.6202       0.32041       2.45119        100    
reco:pmtrajfitcalo:Calorimetry                        6.0871e-05    0.00841657     0.125198     0.00168281     0.020636        100    
reco:pmtrajfitpid:Chi2ParticleID                       2.664e-05    0.000200231   0.000660413   0.000175288   0.000131523      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000974616     1.54703       26.1912      0.256223       3.9125         100    
reco:pmtracktccalo:Calorimetry                        6.4587e-05    0.00413918     0.0579616    0.00116808    0.00917172       100    
reco:pmtracktcpid:Chi2ParticleID                      2.4206e-05    0.000236628    0.0014671    0.000174703   0.00024003       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000162805     1.0657        14.9782      0.285468       2.36233        100    
reco:pmtrajfittccalo:Calorimetry                      4.3175e-05     0.0072701     0.153708     0.00152383     0.020966        100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.8818e-05    0.000305496   0.00252235    0.000205479   0.000385081      100    
reco:blurredcluster:BlurredClustering                 0.000234142    0.800535       3.59278       0.51932      0.857928        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000110456     6.70377       56.5432       2.87188       10.4123        100    
reco:emshower:EMShower                                0.000190857    0.019711      0.194266     0.00632339     0.0317837       100    
reco:cvnmap:CVNMapper                                 1.8918e-05    0.00812356     0.0356901    0.00447134    0.00965579       100    
reco:cvneva:CVNEvaluator                              1.7096e-05     0.566791       1.06419      0.805303      0.392414        100    
reco:energyrecnumu:EnergyReco                         0.000331949    0.0123822     0.111105     0.00721241     0.0164721       100    
reco:energyrecnue:EnergyReco                          0.000105449   0.00121911     0.0133613    0.00048845     0.0019483       100    
reco:energyrecnc:EnergyReco                           0.00156796    0.00331503     0.0154524     0.0026495    0.00201801       100    
reco:energyrecnumurange:EnergyReco                    0.000158598   0.00889906     0.100674     0.00251507     0.0155528       100    
reco:energyrecnumumcs:EnergyReco                      0.00150395     0.010225      0.0984849     0.0031333     0.0154584       100    
reco:opdec:Deconvolution                               0.0550971     0.277633      0.626201      0.271179       0.13581        100    
reco:ophitspe:OpHitFinderDeco                          0.230615       1.75666       3.90343       1.76479      0.813118        100    
reco:opflash:OpFlashFinder                            0.000108974   0.00147493    0.00458117    0.00148295    0.000707568      100    
reco:rns:RandomNumberSaver                             1.975e-05    3.72956e-05   0.000401223   3.09265e-05   3.81788e-05      100    
reco:anglereconue:NuAngularReco                       0.000176585   0.00108084     0.0187637    0.000402445   0.00219521       100    
reco:anglereconumu:NuAngularReco                      6.4407e-05    0.000852959    0.0186307    0.000211913   0.00214995       100    
reco:anglereconuepfps:NuAngularReco                   0.00012607    0.00100862     0.0190399    0.000331463   0.00219026       100    
reco:anglereconumupfps:NuAngularReco                  9.6445e-05    0.000914572    0.0190041    0.000271843   0.00217682       100    
[art]:TriggerResults:TriggerResultInserter             8.833e-06    1.38073e-05   5.0656e-05    1.24285e-05   4.96272e-06      100    
end_path:out1:RootOutput                               3.275e-06    5.3182e-06    2.0561e-05    4.2315e-06    2.68726e-06      100    
end_path:out1:RootOutput(write)                        0.0124176     0.222179      0.723911      0.243464      0.142549        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40015.4 MB
  Peak resident set size usage (VmHWM): 2242.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2_reco_2024-11-22T_232710Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6405486_339_20231202T113048Z_gen_g4_detsim_hitreco__20240507T214808Z_reco2_reco_data_2024-11-22T_232710Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:53:07 UTC       justIN version: 01.01.09