justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301437.137@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301437.137@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:04:16
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:27:11
From worker nodeHostnametds211.pic.es
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:20:05
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2.root
JobscriptExit code0
Real time55m (3334s)
CPU time46m (2770s = 83%)
Outputting started2024-11-22 23:15:39
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2.root
Finished2024-11-22 23:27:11
Saved logsjustin-logs:301437.137-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

n: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:15:24 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:15:24 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:25 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:25 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:25 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:25 CET run: 50568178 subRun: 1 event: 46900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 254, 390, 326
minwire 0: 2020
minwire 1: 56
minwire 2: 2671
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0583623, 0.0111155, 0.930522, 
Output 1: 0.633951, 0.318816, 0.0433471, 0.00388622, 
Output 2: 0.0935438, 0.906456, 

332
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 903!
23-Nov-2024 00:15:38 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2_reco_data_2024-11-22T_222008Z.root"
23-Nov-2024 00:15:38 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/96/eb/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.10714       27.7213       421.95        11.0615       51.9652        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.045605      0.0816496     0.245496      0.0727274     0.0274328       100    
reco:linecluster:LineCluster                           0.410943      0.598604       9.65551      0.436185      0.931551        100    
reco:trajcluster:TrajCluster                           0.134543      0.707111       22.6111       0.14882       2.40109        100    
reco:pandora:StandardPandora                            1.34728       2.36476       44.3875       1.54642       4.41035        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000138972   0.00632249     0.0858459    0.00163982     0.0128472       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000184075    0.0100599     0.0988387    0.00394796     0.0157395       100    
reco:pandoracalo:Calorimetry                          0.000102634    0.0251153      1.00412     0.00132535     0.110609        100    
reco:pandorapid:Chi2ParticleID                        4.0335e-05    0.000170575   0.00147713    0.00013674    0.000164752      100    
reco:trkshowersplit:TrackShowerHits                   0.000105354    0.016054      0.631286     0.000797444    0.0662533       100    
reco:pmtrack:PMAlgTrackMaker                          0.00126563      1.85485       34.9095      0.236066       4.69641        100    
reco:pmtrackcalo:Calorimetry                          8.6013e-05    0.00921165     0.222976     0.000945372    0.0276648       100    
reco:pmtrackpid:Chi2ParticleID                         3.518e-05    0.000287902   0.00265654    0.000134797   0.000398983      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000210711     2.01334       58.1643      0.301968       6.37312        100    
reco:pmtrajfitcalo:Calorimetry                         8.288e-05     0.0258685      1.03199     0.00154686     0.112981        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.6044e-05    0.000191444   0.000648003   0.00013965    0.000140727      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00116798      2.17459       47.3541       0.28354       5.84432        100    
reco:pmtracktccalo:Calorimetry                        8.1046e-05    0.00786802     0.127907     0.00111783     0.0205388       100    
reco:pmtracktcpid:Chi2ParticleID                      3.4061e-05    0.000289596   0.00245137    0.000155481   0.000369804      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000191321     1.5381        34.1527      0.339929       3.97412        100    
reco:pmtrajfittccalo:Calorimetry                      8.0303e-05     0.0160768     0.478163      0.0011487     0.0548168       100    
reco:pmtrajfittcpid:Chi2ParticleID                     3.572e-05    0.000373754    0.0041424    0.000160659   0.000581469      100    
reco:blurredcluster:BlurredClustering                 0.00376677      1.04225       7.18515      0.422528       1.39249        100    
reco:emtrkmichelid:EmTrackMichelId                     0.247244       12.1764       152.91        3.8251        22.659         100    
reco:emshower:EMShower                                0.000252317    0.0273654     0.263192     0.00375867     0.0472712       100    
reco:cvnmap:CVNMapper                                 2.6224e-05     0.0133182     0.0431909     0.0115543     0.0113697       100    
reco:cvneva:CVNEvaluator                              1.9253e-05     0.574934      0.925303      0.777969      0.369886        100    
reco:energyrecnumu:EnergyReco                         0.000330271    0.0316005     0.541237     0.00523513     0.0771874       100    
reco:energyrecnue:EnergyReco                          0.000169952   0.00205879     0.0228058    0.000677195     0.00361        100    
reco:energyrecnc:EnergyReco                            0.0022353    0.00421605     0.0276927    0.00275414    0.00394014       100    
reco:energyrecnumurange:EnergyReco                    0.000174346    0.0301327     0.535317     0.00278589     0.0782606       100    
reco:energyrecnumumcs:EnergyReco                      0.00125333     0.0311373     0.543484     0.00476343     0.0776653       100    
reco:opdec:Deconvolution                               0.206929      0.495968      0.920776      0.491027      0.120285        100    
reco:ophitspe:OpHitFinderDeco                          0.484984       1.59765       2.80169       1.55588      0.523822        100    
reco:opflash:OpFlashFinder                            0.000273766   0.00144105    0.00418047     0.001325     0.000690568      100    
reco:rns:RandomNumberSaver                            1.7857e-05    3.24543e-05   0.000325407   2.8441e-05    3.11261e-05      100    
reco:anglereconue:NuAngularReco                       0.000137291   0.00142646     0.0190332    0.000336231   0.00288662       100    
reco:anglereconumu:NuAngularReco                      8.4555e-05    0.00129882     0.0188646    0.00024182     0.002848        100    
reco:anglereconuepfps:NuAngularReco                   0.000128539    0.0014149     0.0183753    0.000347038   0.00282914       100    
reco:anglereconumupfps:NuAngularReco                  0.000121977   0.00137693     0.0188449    0.000329633   0.00285308       100    
[art]:TriggerResults:TriggerResultInserter            1.1093e-05    1.43531e-05   4.6676e-05    1.29765e-05   4.55065e-06      100    
end_path:out1:RootOutput                               2.61e-06     4.81937e-06   1.9313e-05    3.3125e-06    2.84571e-06      100    
end_path:out1:RootOutput(write)                        0.0155636     0.234492       0.92632      0.237046      0.156982        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8361.28 MB
  Peak resident set size usage (VmHWM): 2266.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2_reco_2024-11-22T_222008Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_468_20231202T171110Z_gen_g4_detsim_hitreco__20240507T204823Z_reco2_reco_data_2024-11-22T_222008Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:38:16 UTC       justIN version: 01.01.09