justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108511.81@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108511.81@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:09:40
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2024-11-22 23:18:32
From worker nodeHostnamecn014.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:30:29
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2.root
JobscriptExit code0
Real time46m (2783s)
CPU time42m (2521s = 90%)
Outputting started2024-11-22 23:16:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2.root
Finished2024-11-22 23:18:32
Saved logsjustin-logs:108511.81-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
1st wire C:0 T:23 P:2 W:690 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:16:42 GMT run: 6404651 subRun: 1 event: 76300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 86, 172, 96
minwire 0: 2751
minwire 1: 627
minwire 2: 2665
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0233383, 3.84183e-05, 0.976623, 
Output 1: 0.48118, 0.386847, 0.126541, 0.00543274, 
Output 2: 0.9846, 0.0154001, 

432
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1362!
22-Nov-2024 23:16:52 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2_reco_data_2024-11-22T_223033Z.root"
22-Nov-2024 23:16:52 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/c0/e0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.96313        25.4         486.807       12.6262       53.4686        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00266794     0.104263      0.831679      0.0254382     0.157022        100    
reco:linecluster:LineCluster                           0.0195172     0.405224       4.22759      0.0730734      0.83818        100    
reco:trajcluster:TrajCluster                          0.00432476     0.525781       29.0508      0.0211323      3.02843        100    
reco:pandora:StandardPandora                            1.18501       2.78429       115.753       1.36925       11.3967        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000130064   0.00547377     0.119481     0.00171467     0.0136835       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000162039    0.0099532     0.095225     0.00281316     0.0175683       100    
reco:pandoracalo:Calorimetry                          9.5722e-05     0.0106969     0.392842     0.00114702     0.0430811       100    
reco:pandorapid:Chi2ParticleID                        3.6916e-05    0.000159755   0.00171993    0.000120875   0.000180854      100    
reco:trkshowersplit:TrackShowerHits                   0.00011852     0.0143823     0.592066     0.000773432    0.0663588       100    
reco:pmtrack:PMAlgTrackMaker                          0.00116536      1.24031       35.4839      0.214974       4.22552        100    
reco:pmtrackcalo:Calorimetry                          8.8288e-05    0.00681056     0.297684      0.0011434     0.0305042       100    
reco:pmtrackpid:Chi2ParticleID                        3.2528e-05    0.000233519   0.00250362    0.000139844   0.000322852      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000196959     1.32436       30.4121      0.261226       3.77188        100    
reco:pmtrajfitcalo:Calorimetry                        6.1319e-05     0.0105458     0.338448     0.00155148     0.0378407       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.6613e-05    0.000175955   0.00083676    0.000148198   0.000130078      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00102721      1.73599       64.0294      0.233986       6.85253        100    
reco:pmtracktccalo:Calorimetry                        7.3058e-05    0.00515957     0.201547     0.00097119     0.0203585       100    
reco:pmtracktcpid:Chi2ParticleID                      3.0105e-05    0.000230399   0.00279621    0.000141232   0.000314602      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000189053     1.07851       20.3361      0.284906       2.58018        100    
reco:pmtrajfittccalo:Calorimetry                      6.1914e-05     0.0103548     0.416125     0.00131278     0.0441209       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.6462e-05    0.000297687   0.00272814    0.000170944   0.000397836      100    
reco:blurredcluster:BlurredClustering                  0.0150206     0.936621       6.01423      0.533918       1.12068        100    
reco:emtrkmichelid:EmTrackMichelId                     0.299996       11.5451       172.503       4.71326       21.4946        100    
reco:emshower:EMShower                                0.000244715    0.0238398     0.300415     0.00344762     0.0455021       100    
reco:cvnmap:CVNMapper                                  2.071e-05     0.0139352     0.0453832     0.0139422    0.00952656       100    
reco:cvneva:CVNEvaluator                              1.6223e-05     0.666985       1.21158      0.781034      0.357956        100    
reco:energyrecnumu:EnergyReco                         0.000267893    0.0206301     0.254085     0.00504886     0.0474205       100    
reco:energyrecnue:EnergyReco                          0.000136182   0.00162542     0.0428434    0.000491913   0.00457235       100    
reco:energyrecnc:EnergyReco                           0.00173725    0.00334276     0.0444297    0.00223259    0.00459892       100    
reco:energyrecnumurange:EnergyReco                    0.000201402     0.0181       0.250576     0.00203481     0.0463706       100    
reco:energyrecnumumcs:EnergyReco                       0.0011225     0.0200226     0.250861     0.00329445     0.0488267       100    
reco:opdec:Deconvolution                               0.0280027     0.390333       1.89707      0.243316      0.394928        100    
reco:ophitspe:OpHitFinderDeco                          0.249804       2.26579       5.47335       2.17119      0.966384        100    
reco:opflash:OpFlashFinder                            0.000312787    0.0012985    0.00451565    0.00119714    0.000552919      100    
reco:rns:RandomNumberSaver                            1.7798e-05    2.95738e-05   0.000283365   2.55695e-05   2.62702e-05      100    
reco:anglereconue:NuAngularReco                       0.000147873   0.00139999     0.0369505    0.00038159    0.00409645       100    
reco:anglereconumu:NuAngularReco                      6.6834e-05    0.00118098     0.036134     0.000209897   0.00399603       100    
reco:anglereconuepfps:NuAngularReco                   0.000109188   0.00128891     0.0362568    0.000297039   0.00401686       100    
reco:anglereconumupfps:NuAngularReco                  9.5531e-05     0.0012582     0.0364231    0.000292213   0.00402701       100    
[art]:TriggerResults:TriggerResultInserter             8.453e-06    1.2468e-05    5.4843e-05    1.1826e-05    5.50934e-06      100    
end_path:out1:RootOutput                               2.28e-06     3.82155e-06   1.7417e-05     3.109e-06    1.85853e-06      100    
end_path:out1:RootOutput(write)                        0.017708      0.212381      0.791811      0.209578      0.123033        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16891.1 MB
  Peak resident set size usage (VmHWM): 2254.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2_reco_2024-11-22T_223033Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_762_20231202T103619Z_gen_g4_detsim_hitreco__20240507T214716Z_reco2_reco_data_2024-11-22T_223033Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 17:30:45 UTC       justIN version: 01.01.09