justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.182@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.182@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-23 00:26:41
From worker nodeHostnametds211.pic.es
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:31:27
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2.root
JobscriptExit code0
Real time46m (2809s)
CPU time46m (2810s = 100%)
Outputting started2024-11-23 00:18:17
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2.root
Finished2024-11-23 00:26:41
Saved logsjustin-logs:301492.182-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
1st wire C:0 T:21 P:2 W:1079 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:18:07 CET run: 50571149 subRun: 1 event: 93600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 118, 123, 106
minwire 0: 2447
minwire 1: 698
minwire 2: 2065
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.555162, 0.00553946, 0.439298, 
Output 1: 0.181905, 0.598522, 0.197441, 0.022132, 
Output 2: 0.147679, 0.852321, 

444
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1454!
23-Nov-2024 01:18:16 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2_reco_data_2024-11-22T_233220Z.root"
23-Nov-2024 01:18:16 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/6d/22/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.24469       26.6951       583.353       7.17527       69.4551        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00084093     0.0169089     0.228004       0.01736      0.0227787       100    
reco:linecluster:LineCluster                           0.0099463     0.516433       44.1414      0.0166114      4.39351        100    
reco:trajcluster:TrajCluster                          0.000881908     1.36341       78.3399     0.00898379      8.42693        100    
reco:pandora:StandardPandora                          0.00909626      2.02221       34.3121       1.33603       3.54826        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000114272   0.00560823     0.0937298    0.00106726     0.014284        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000164143    0.0100672     0.152848     0.00225694     0.0231693       100    
reco:pandoracalo:Calorimetry                          9.1854e-05     0.0230508      1.17169     0.000771239    0.121606        100    
reco:pandorapid:Chi2ParticleID                        3.8972e-05    0.000151824   0.00153211    0.000112117   0.000166955      100    
reco:trkshowersplit:TrackShowerHits                   8.4395e-05     0.0199219     0.853806     0.000471752    0.0961362       100    
reco:pmtrack:PMAlgTrackMaker                          0.00110125      2.54305       104.962      0.130355       11.205         100    
reco:pmtrackcalo:Calorimetry                           7.874e-05    0.00991025     0.263548     0.000770511    0.0379639       100    
reco:pmtrackpid:Chi2ParticleID                        3.3758e-05    0.000257924   0.00295366    0.000119605   0.000415585      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000177063     2.04743       58.0576      0.179302       6.70183        100    
reco:pmtrajfitcalo:Calorimetry                        7.3081e-05     0.0231695      1.10144     0.00106909     0.115678        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.2329e-05    0.000168823   0.000876517   0.000133663   0.00013726       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00101709      2.82925       81.5024      0.142471       10.7174        100    
reco:pmtracktccalo:Calorimetry                        7.8923e-05    0.00634219     0.149411     0.000647872    0.0202611       100    
reco:pmtracktcpid:Chi2ParticleID                      3.2673e-05    0.000235899   0.00190665    0.00012368    0.000306316      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000187545     1.34915       26.4026      0.179445       3.48544        100    
reco:pmtrajfittccalo:Calorimetry                      7.4257e-05     0.0156089     0.581143     0.000823776    0.0654274       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.2802e-05    0.000324353   0.00384202    0.000138304   0.000530461      100    
reco:blurredcluster:BlurredClustering                 0.00840793     0.881674       6.50252      0.471474       1.15602        100    
reco:emtrkmichelid:EmTrackMichelId                     0.111805       10.8225       142.065       2.40407       22.4327        100    
reco:emshower:EMShower                                0.000244866    0.0230488     0.264978     0.00345602     0.0399505       100    
reco:cvnmap:CVNMapper                                 2.5197e-05     0.0101465     0.0367817     0.010519     0.00851968       100    
reco:cvneva:CVNEvaluator                              1.8808e-05     0.520706       0.88722      0.724355       0.35968        100    
reco:energyrecnumu:EnergyReco                         0.000336674    0.0348343      1.92679     0.00433907     0.194777        100    
reco:energyrecnue:EnergyReco                          0.000163852   0.00200815     0.0314171    0.000497687   0.00455696       100    
reco:energyrecnc:EnergyReco                            0.0020495    0.00403467     0.0362476    0.00253633    0.00506789       100    
reco:energyrecnumurange:EnergyReco                    0.00021403     0.0336224      1.91373     0.00234725     0.193962        100    
reco:energyrecnumumcs:EnergyReco                      0.000860759    0.0352107      1.9731      0.00288161     0.199337        100    
reco:opdec:Deconvolution                              0.00854549      0.16696      0.458726      0.162924      0.0800443       100    
reco:ophitspe:OpHitFinderDeco                           0.03862       1.13308       2.63421       1.15555      0.540463        100    
reco:opflash:OpFlashFinder                            0.000219408   0.00130641    0.00357795    0.00126459    0.000657177      100    
reco:rns:RandomNumberSaver                            1.6965e-05    2.76374e-05   0.000267622   2.46005e-05   2.50163e-05      100    
reco:anglereconue:NuAngularReco                       0.000138573   0.00136325     0.0270397    0.000278512   0.00379655       100    
reco:anglereconumu:NuAngularReco                      8.0331e-05    0.00124493     0.0268378    0.000185321   0.00372999       100    
reco:anglereconuepfps:NuAngularReco                   0.000124292   0.00135296     0.0270263    0.000285508   0.00370765       100    
reco:anglereconumupfps:NuAngularReco                  0.000115491   0.00131326     0.0270554    0.000269051   0.00374088       100    
[art]:TriggerResults:TriggerResultInserter             9.877e-06    1.26284e-05   5.8554e-05    1.17565e-05   4.92491e-06      100    
end_path:out1:RootOutput                               2.489e-06    4.38221e-06   2.1664e-05     3.773e-06    2.26721e-06      100    
end_path:out1:RootOutput(write)                        0.0109403     0.216334      0.893251      0.229165      0.156838        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8345.33 MB
  Peak resident set size usage (VmHWM): 2259.32 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2_reco_2024-11-22T_233220Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_935_20231202T191413Z_gen_g4_detsim_hitreco__20240508T063952Z_reco2_reco_data_2024-11-22T_233220Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:36:32 UTC       justIN version: 01.01.09