justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108513.166@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108513.166@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:15:41
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2024-11-22 23:51:37
From worker nodeHostnamecn015.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:37:20
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2.root
JobscriptExit code0
Real time1h (4226s)
CPU time1h (3885s = 91%)
Outputting started2024-11-22 23:47:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2.root
Finished2024-11-22 23:51:37
Saved logsjustin-logs:108513.166-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Hit sorting problem.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:47:32 GMT run: 6404651 subRun: 1 event: 14700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 402, 111, 243
minwire 0: 2134
minwire 1: 772
minwire 2: 2261
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00397621, 5.18773e-05, 0.995972, 
Output 1: 0.303922, 0.553786, 0.135257, 0.00703444, 
Output 2: 0.994565, 0.00543477, 

494
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1467!
22-Nov-2024 23:47:45 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2_reco_data_2024-11-22T_223724Z.root"
22-Nov-2024 23:47:45 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/c0/be/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.87494       39.4048       921.322       12.5921       106.038        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00243867     0.121161      0.936129      0.0355435     0.174199        100    
reco:linecluster:LineCluster                           0.0213518      1.02442       38.8541      0.0776069      4.52841        100    
reco:trajcluster:TrajCluster                          0.00390757      1.49582       90.5378      0.0185622      9.44204        100    
reco:pandora:StandardPandora                            1.15923       3.08225       68.9174       1.66828       8.32953        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000131985    0.0083208     0.150972     0.00203922      0.0219         100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000163664    0.0173961     0.318052     0.00387917     0.049354        100    
reco:pandoracalo:Calorimetry                          9.5937e-05     0.0403339      1.71738     0.00138803      0.21029        100    
reco:pandorapid:Chi2ParticleID                        3.5317e-05    0.000187999   0.00180969    0.000135213   0.000218696      100    
reco:trkshowersplit:TrackShowerHits                   9.1415e-05     0.031885       1.40358     0.00092714      0.16429        100    
reco:pmtrack:PMAlgTrackMaker                          0.00115011      3.18202       130.687       0.16709       14.0433        100    
reco:pmtrackcalo:Calorimetry                          7.9234e-05     0.0106236     0.318457     0.000898638    0.0377621       100    
reco:pmtrackpid:Chi2ParticleID                        3.2071e-05    0.000281737   0.00270092    0.000141368   0.000391687      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000177283     2.47149       74.7685      0.335309       10.1698        100    
reco:pmtrajfitcalo:Calorimetry                        6.2382e-05     0.0470022      2.46641     0.00166719     0.272586        100    
reco:pmtrajfitpid:Chi2ParticleID                       2.555e-05    0.000195869   0.00145606    0.000150892   0.000184776      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000933762     3.76996       153.008      0.262858       16.4021        100    
reco:pmtracktccalo:Calorimetry                         6.709e-05     0.0088318     0.223319     0.00111948     0.0293625       100    
reco:pmtracktcpid:Chi2ParticleID                      2.6719e-05    0.000277186   0.00297202    0.000146557   0.000431386      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000168144     2.00542       60.6012      0.296992       6.90513        100    
reco:pmtrajfittccalo:Calorimetry                      5.7711e-05     0.0221237      1.11319     0.00133788     0.117143        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5276e-05    0.000361731   0.00589242    0.00016266    0.000690714      100    
reco:blurredcluster:BlurredClustering                  0.0102951      1.10866       6.75982      0.533169       1.41012        100    
reco:emtrkmichelid:EmTrackMichelId                     0.278964       16.2897       279.589       5.05936       35.8394        100    
reco:emshower:EMShower                                0.000220958    0.0306809     0.473935     0.00408467     0.0692585       100    
reco:cvnmap:CVNMapper                                 2.0558e-05     0.0142298     0.0535263     0.0143671    0.00985342       100    
reco:cvneva:CVNEvaluator                              1.5114e-05     0.801556       1.28181      0.877141       0.4428         100    
reco:energyrecnumu:EnergyReco                         0.000326696    0.0397207      1.04659     0.00524971     0.127472        100    
reco:energyrecnue:EnergyReco                          0.000134575   0.00245027     0.0545029    0.000562344   0.00702921       100    
reco:energyrecnc:EnergyReco                           0.00173359    0.00443117     0.0548813     0.0029398    0.00691159       100    
reco:energyrecnumurange:EnergyReco                    0.000259828    0.0402054      1.36349     0.00283071     0.153899        100    
reco:energyrecnumumcs:EnergyReco                      0.000924783    0.0424182      1.43183     0.00417962     0.159542        100    
reco:opdec:Deconvolution                               0.0262296     0.441228       2.59508      0.252057       0.45605        100    
reco:ophitspe:OpHitFinderDeco                          0.201619       2.97585       7.82415       2.58465       1.56287        100    
reco:opflash:OpFlashFinder                            0.000268845   0.00150355     0.003676     0.00142961    0.000687827      100    
reco:rns:RandomNumberSaver                            1.7366e-05    3.24226e-05   0.000245866   2.97955e-05   2.30295e-05      100    
reco:anglereconue:NuAngularReco                       0.000138522   0.00203959     0.0473091    0.000394715   0.00618712       100    
reco:anglereconumu:NuAngularReco                      6.3337e-05    0.00181402     0.0447118    0.000251057   0.00593388       100    
reco:anglereconuepfps:NuAngularReco                   0.000108882   0.00193325     0.0449978    0.000369769    0.0059664       100    
reco:anglereconumupfps:NuAngularReco                  9.2625e-05    0.00188759     0.0450047    0.000335283    0.0059662       100    
[art]:TriggerResults:TriggerResultInserter             8.624e-06    1.29281e-05   5.0984e-05    1.1855e-05    4.7899e-06       100    
end_path:out1:RootOutput                               2.231e-06    4.58161e-06   1.4572e-05    3.5825e-06    2.31647e-06      100    
end_path:out1:RootOutput(write)                        0.0132959     0.262185        1.136       0.226563      0.193053        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 17043.9 MB
  Peak resident set size usage (VmHWM): 2410.88 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2_reco_2024-11-22T_223724Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_146_20231202T092203Z_gen_g4_detsim_hitreco__20240507T212845Z_reco2_reco_data_2024-11-22T_223724Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 17:30:59 UTC       justIN version: 01.01.09