justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301435.54@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301435.54@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:01:05
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:02:37
From worker nodeHostnametds211.pic.es
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:05:17
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2.root
JobscriptExit code0
Real time54m (3297s)
CPU time44m (2688s = 81%)
Outputting started2024-11-22 23:00:16
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2.root
Finished2024-11-22 23:02:37
Saved logsjustin-logs:301435.54-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

024 23:58:36 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:36 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:36 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:00:09 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:00:09 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:00:09 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:00:09 CET run: 74521450 subRun: 1 event: 97800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2994, 5666, 2401
minwire 0: 399
minwire 1: 1625
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0129224, 0.979662, 0.00741568, 
Output 1: 0.116475, 0.747319, 0.106341, 0.0298645, 
Output 2: 0.458373, 0.541627, 

830
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3071!
23-Nov-2024 00:00:15 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2_reco_data_2024-11-22T_220520Z.root"
23-Nov-2024 00:00:15 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/16/1e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.38277       26.9386       309.192       9.83602       50.4579        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0452064     0.0821176     0.359045      0.0810266     0.0364605       100    
reco:linecluster:LineCluster                           0.267738      0.613587       10.4835      0.437721       1.0456         100    
reco:trajcluster:TrajCluster                           0.133986      0.842573       28.2718      0.143905       3.15736        100    
reco:pandora:StandardPandora                           0.149093       1.89141       12.1747       1.47602       1.57965        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000138992   0.00590207     0.104452     0.00152516      0.01323        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000186876    0.0133754     0.263155     0.00292237     0.034029        100    
reco:pandoracalo:Calorimetry                          9.9652e-05     0.0230924     0.796247     0.00111526     0.0921646       100    
reco:pandorapid:Chi2ParticleID                        4.0298e-05    0.000166202   0.000984384   0.000123725   0.000159801      100    
reco:trkshowersplit:TrackShowerHits                   6.2827e-05     0.0138235     0.338856     0.000653904    0.0470839       100    
reco:pmtrack:PMAlgTrackMaker                          0.00121705      2.22075       48.9574      0.247535       6.53217        100    
reco:pmtrackcalo:Calorimetry                          8.3782e-05    0.00999073     0.396669     0.000809355    0.0413411       100    
reco:pmtrackpid:Chi2ParticleID                        3.5098e-05    0.00025892    0.00201497    0.000128824   0.000351236      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000195095     1.95777       43.504       0.191033       5.68882        100    
reco:pmtrajfitcalo:Calorimetry                        7.6374e-05     0.0234465     0.795729      0.0013579     0.0923436       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.3786e-05    0.000175662   0.000873095   0.000138018   0.000144258      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00112858      2.54244       52.1523      0.180698       7.44376        100    
reco:pmtracktccalo:Calorimetry                        8.5341e-05    0.00759619     0.220605     0.00075072     0.025208        100    
reco:pmtracktcpid:Chi2ParticleID                      3.5504e-05    0.000244945   0.00150115    0.000133727   0.000285507      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000185683     1.52528       20.3983      0.250035       3.39378        100    
reco:pmtrajfittccalo:Calorimetry                      7.9722e-05     0.0133724     0.336616     0.000850427    0.0428172       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4205e-05    0.000314336   0.00252024    0.00013331    0.000456849      100    
reco:blurredcluster:BlurredClustering                 0.000115105    0.925966       6.41549      0.476972       1.15401        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000132974     11.2389       139.622       3.07354       21.5872        100    
reco:emshower:EMShower                                0.000199241    0.0261403     0.294061     0.00301882     0.0480766       100    
reco:cvnmap:CVNMapper                                 2.3574e-05     0.0104502     0.0450551     0.0109978    0.00949913       100    
reco:cvneva:CVNEvaluator                              1.8459e-05     0.508969       0.96475      0.743569       0.38479        100    
reco:energyrecnumu:EnergyReco                         0.000348645    0.0613201      2.88484     0.00455802     0.314605        100    
reco:energyrecnue:EnergyReco                          0.000155488   0.00212773     0.0384786    0.000774524   0.00442245       100    
reco:energyrecnc:EnergyReco                           0.00210999    0.00406913     0.0410925     0.002631     0.00460207       100    
reco:energyrecnumurange:EnergyReco                    0.00023075     0.0594946      2.92489     0.00253451     0.316476        100    
reco:energyrecnumumcs:EnergyReco                      0.000849767    0.0606072      2.84059     0.00335873     0.310667        100    
reco:opdec:Deconvolution                               0.139932      0.497577       2.3767       0.484996      0.232859        100    
reco:ophitspe:OpHitFinderDeco                          0.428051       1.53328       2.64882       1.48342      0.555119        100    
reco:opflash:OpFlashFinder                            0.000228941   0.00134626    0.00338128    0.00125968    0.000661935      100    
reco:rns:RandomNumberSaver                            1.7991e-05    3.21648e-05   0.000303493   2.70025e-05   2.89193e-05      100    
reco:anglereconue:NuAngularReco                       0.000132871   0.00139899     0.0327146    0.000357837    0.0036652       100    
reco:anglereconumu:NuAngularReco                      8.1619e-05     0.0012685     0.0320559    0.000224501   0.00361696       100    
reco:anglereconuepfps:NuAngularReco                   0.000125481   0.00138976     0.032206     0.000334339   0.00362355       100    
reco:anglereconumupfps:NuAngularReco                  0.000117224   0.00135702     0.0324213    0.000304347   0.00365447       100    
[art]:TriggerResults:TriggerResultInserter            1.0694e-05    1.37361e-05   5.2295e-05    1.27245e-05   4.5689e-06       100    
end_path:out1:RootOutput                               2.518e-06    4.93756e-06   1.8539e-05    3.9435e-06    3.01568e-06      100    
end_path:out1:RootOutput(write)                        0.0114388     0.213393      0.944936      0.229396      0.162045        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8353.08 MB
  Peak resident set size usage (VmHWM): 2265.25 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2_reco_2024-11-22T_220520Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_977_20231205T081310Z_gen_g4_detsim_hitreco__20240509T222246Z_reco2_reco_data_2024-11-22T_220520Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:05:24 UTC       justIN version: 01.01.09