justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301435.180@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301435.180@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:01:06
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:12:12
From worker nodeHostnametds211.pic.es
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:13:27
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2.root
JobscriptExit code0
Real time56m (3376s)
CPU time45m (2740s = 81%)
Outputting started2024-11-22 23:09:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2.root
Finished2024-11-22 23:12:12
Saved logsjustin-logs:301435.180-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Module  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:36 CET run: 50640579 subRun: 1 event: 62400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2816, 4172, 2343
minwire 0: 1126
minwire 1: 680
minwire 2: 1128
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00409436, 0.989815, 0.00609032, 
Output 1: 0.148156, 0.579035, 0.22196, 0.0508492, 
Output 2: 0.0280075, 0.971993, 

809
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3443!
23-Nov-2024 00:09:43 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2_reco_data_2024-11-22T_221330Z.root"
23-Nov-2024 00:09:43 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/20/52/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.1915        27.4605       450.45        10.4978       60.4654        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0459301     0.0834755     0.377572      0.0794066     0.0377685       100    
reco:linecluster:LineCluster                           0.408531      0.688217       9.04038      0.434758       1.09356        100    
reco:trajcluster:TrajCluster                           0.134212       1.38357       64.6713      0.144883       6.86192        100    
reco:pandora:StandardPandora                            1.33878       2.11442       20.4045       1.52968       2.50538        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000137655   0.00547666     0.120986     0.00136991     0.0143401       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000185703    0.0124462     0.325637     0.00285897     0.0368408       100    
reco:pandoracalo:Calorimetry                          0.000106088    0.0215495     0.541728     0.000914806    0.0797175       100    
reco:pandorapid:Chi2ParticleID                        4.2081e-05    0.000152272   0.00112652    0.00012878    0.000133459      100    
reco:trkshowersplit:TrackShowerHits                   0.000112685    0.0201137     0.700093     0.000655853    0.0876822       100    
reco:pmtrack:PMAlgTrackMaker                          0.00128014      2.15338       47.0788      0.148271       7.29713        100    
reco:pmtrackcalo:Calorimetry                          8.9372e-05    0.00831423     0.332911     0.000767774    0.0353179       100    
reco:pmtrackpid:Chi2ParticleID                        3.7195e-05    0.000245145    0.0024075    0.000131079   0.000364943      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000191217     1.81492       46.9706       0.21391       5.87873        100    
reco:pmtrajfitcalo:Calorimetry                        7.9423e-05     0.0215547     0.540956     0.00104391     0.0781337       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.6292e-05    0.00016506    0.000666015   0.000134304   0.000114074      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00112588      2.87239       83.7204      0.165107       10.3756        100    
reco:pmtracktccalo:Calorimetry                        8.6938e-05    0.00659874     0.173038     0.000846411    0.0231701       100    
reco:pmtracktcpid:Chi2ParticleID                      3.5925e-05    0.000223467   0.00197073    0.00012727    0.000289941      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00019023      1.29942       25.6379       0.25651       3.42613        100    
reco:pmtrajfittccalo:Calorimetry                      8.1283e-05     0.0141107     0.448166     0.00104573     0.0539674       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.5963e-05    0.000311791   0.00307222     0.0001437    0.000502642      100    
reco:blurredcluster:BlurredClustering                  0.0106678      0.97326       7.98228      0.511502       1.39005        100    
reco:emtrkmichelid:EmTrackMichelId                     0.228602       10.8805       152.852       3.15815       22.8254        100    
reco:emshower:EMShower                                0.00025677     0.0252331     0.262518     0.00410132     0.0458337       100    
reco:cvnmap:CVNMapper                                 2.6606e-05     0.0136037     0.067176      0.0118006     0.012421        100    
reco:cvneva:CVNEvaluator                              2.0656e-05     0.564818       0.98477      0.768263      0.373807        100    
reco:energyrecnumu:EnergyReco                         0.000362132    0.0549761      2.9436      0.00414809     0.299287        100    
reco:energyrecnue:EnergyReco                          0.00018206    0.00178162     0.0368617    0.000506926   0.00429411       100    
reco:energyrecnc:EnergyReco                           0.00218286    0.00388157     0.0403833     0.0026165    0.00453101       100    
reco:energyrecnumurange:EnergyReco                    0.000231092    0.0514449      2.74831     0.00253394     0.280554        100    
reco:energyrecnumumcs:EnergyReco                      0.000933465    0.0501006      2.44773     0.00305549     0.251988        100    
reco:opdec:Deconvolution                               0.207926      0.495986       1.09515      0.496796      0.143849        100    
reco:ophitspe:OpHitFinderDeco                          0.539401       1.59378       2.69698       1.62465       0.52703        100    
reco:opflash:OpFlashFinder                            0.000294464   0.00145789    0.00422005    0.00145723    0.000698307      100    
reco:rns:RandomNumberSaver                            1.7925e-05    4.45338e-05   0.000571886   3.1688e-05    7.76482e-05      100    
reco:anglereconue:NuAngularReco                       0.000145798   0.00120758      0.02572     0.000350379   0.00301974       100    
reco:anglereconumu:NuAngularReco                      8.7127e-05    0.00104115     0.0259118    0.000207179   0.00302409       100    
reco:anglereconuepfps:NuAngularReco                   0.000132317   0.00117756     0.0255018    0.000322234   0.00299814       100    
reco:anglereconumupfps:NuAngularReco                  0.000126764   0.00111814     0.0256277    0.000289878    0.0030187       100    
[art]:TriggerResults:TriggerResultInserter            1.1056e-05    1.43281e-05   4.1734e-05    1.33685e-05   4.4665e-06       100    
end_path:out1:RootOutput                               2.496e-06    5.3341e-06    2.6773e-05    4.2615e-06    3.57801e-06      100    
end_path:out1:RootOutput(write)                        0.0187816     0.222155      0.929054      0.235296      0.152617        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8357.97 MB
  Peak resident set size usage (VmHWM): 2262.27 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2_reco_2024-11-22T_221330Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_623_20231207T205205Z_gen_g4_detsim_hitreco__20240510T054003Z_reco2_reco_data_2024-11-22T_221330Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:36:18 UTC       justIN version: 01.01.09