justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 106585.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID106585.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4212
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-21 21:26:34
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce03
Last heartbeat2024-11-21 22:27:40
From worker nodeHostnamedune001-3221983.0-lcg2614.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-21 21:28:40
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2.root
JobscriptExit code0
Real time58m (3494s)
CPU time1h (4142s = 118%)
Outputting started2024-11-21 22:26:55
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04212/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2.root
Finished2024-11-21 22:27:40
Saved logsjustin-logs:106585.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

@BeginModule  21-Nov-2024 22:26:41 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  21-Nov-2024 22:26:41 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  21-Nov-2024 22:26:41 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  21-Nov-2024 22:26:41 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  21-Nov-2024 22:26:49 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  21-Nov-2024 22:26:49 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  21-Nov-2024 22:26:49 UTC run: 74481119 subRun: 1 event: 3200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 377, 365, 316
minwire 0: 515
minwire 1: 2311
minwire 2: 233
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00787991, 0.988151, 0.00396878, 
Output 1: 0.00181126, 0.997685, 0.000495629, 7.91449e-06, 
Output 2: 0.993779, 0.00622104, 

489
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1605!
21-Nov-2024 22:26:54 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2_reco_data_2024-11-21T_212847Z.root"
21-Nov-2024 22:26:54 UTC  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/ee/36/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.521336       33.6267       1357.34       9.02748       136.416        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00459793    0.00825548     0.0195125    0.00839525    0.00270146       100    
reco:linecluster:LineCluster                           0.023186       0.75727       64.1656      0.0513846      6.37953        100    
reco:trajcluster:TrajCluster                           0.0111972      1.54228       126.129      0.0204696      12.5699        100    
reco:pandora:StandardPandora                           0.0256756      3.59874       184.14        1.4138        18.2103        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000175664   0.00591513     0.180651     0.00135699     0.0190554       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000243346    0.0102864     0.115353     0.00310006     0.017986        100    
reco:pandoracalo:Calorimetry                          0.000129853    0.0376248      2.61749     0.000917292    0.261642        100    
reco:pandorapid:Chi2ParticleID                        4.9661e-05    0.00019368    0.00311626    0.000142159   0.000315763      100    
reco:trkshowersplit:TrackShowerHits                   8.1122e-05     0.0381076      2.40083     0.000676382    0.241856        100    
reco:pmtrack:PMAlgTrackMaker                          0.00168157      3.58673       205.715       0.19118       20.6754        100    
reco:pmtrackcalo:Calorimetry                          9.6283e-05     0.0114442     0.661771     0.000892792    0.0662612       100    
reco:pmtrackpid:Chi2ParticleID                        3.7161e-05    0.000315431   0.00617362    0.000153784   0.000665929      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000263576     4.38376       303.054      0.216875       30.1315        100    
reco:pmtrajfitcalo:Calorimetry                        8.6302e-05     0.0361451      2.58109     0.00138773     0.257232        100    
reco:pmtrajfitpid:Chi2ParticleID                       3.635e-05    0.000207436   0.00145076    0.000162384   0.000184217      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00139977      3.45092       168.31       0.197095       17.1457        100    
reco:pmtracktccalo:Calorimetry                        9.2602e-05    0.00590976     0.231558     0.00113505     0.0236536       100    
reco:pmtracktcpid:Chi2ParticleID                      3.7591e-05    0.000275092   0.00345975    0.000160224   0.000394876      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000239446     1.84117       66.8099       0.24501       6.93389        100    
reco:pmtrajfittccalo:Calorimetry                      8.3672e-05     0.0148618     0.724766      0.0011589     0.0739096       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.5791e-05    0.000371029   0.00447584    0.000167494   0.000584792      100    
reco:blurredcluster:BlurredClustering                 0.000196594     1.02992       7.04255      0.484802       1.44455        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000142943     9.62855       210.975       2.58626       23.8645        100    
reco:emshower:EMShower                                0.000291457    0.0286874     0.408988     0.00764972     0.0535416       100    
reco:cvnmap:CVNMapper                                 2.3501e-05    0.00802421     0.0398238    0.00624594    0.00850729       100    
reco:cvneva:CVNEvaluator                              1.7761e-05     0.827546       1.80324       1.22675      0.616714        100    
reco:energyrecnumu:EnergyReco                         0.00041496     0.0330235     0.832597     0.00407048     0.112286        100    
reco:energyrecnue:EnergyReco                          0.000144874   0.00189606     0.0476637    0.000517557   0.00506863       100    
reco:energyrecnc:EnergyReco                           0.00209093    0.00488929     0.0546847    0.00373238    0.00548906       100    
reco:energyrecnumurange:EnergyReco                    0.000198695    0.0308814     0.801887      0.0035091     0.110474        100    
reco:energyrecnumumcs:EnergyReco                      0.00136124     0.0314269     0.799967     0.00412866     0.107123        100    
reco:opdec:Deconvolution                               0.0532908     0.197177      0.424987      0.185877      0.0734536       100    
reco:ophitspe:OpHitFinderDeco                          0.320231       2.20098       4.93548       1.9456       0.962148        100    
reco:opflash:OpFlashFinder                            0.000388249   0.00156988    0.00720321    0.00131979    0.000906568      100    
reco:rns:RandomNumberSaver                            2.0121e-05    3.69786e-05   0.000426151   3.12155e-05   4.0071e-05       100    
reco:anglereconue:NuAngularReco                       0.000165814   0.00133877     0.037056     0.000414395    0.0038821       100    
reco:anglereconumu:NuAngularReco                      7.5862e-05    0.00106036      0.03659     0.000236765   0.00377659       100    
reco:anglereconuepfps:NuAngularReco                   0.000136844   0.00121885     0.0364685    0.000367589   0.00384471       100    
reco:anglereconumupfps:NuAngularReco                  0.000113303   0.00112782     0.0365041    0.000312312   0.00375942       100    
[art]:TriggerResults:TriggerResultInserter             9.54e-06     1.79581e-05   0.000107563    1.671e-05    1.01433e-05      100    
end_path:out1:RootOutput                               3.57e-06     7.19907e-06    4.163e-05    6.2505e-06    4.48098e-06      100    
end_path:out1:RootOutput(write)                        0.0279663     0.264128       1.6781       0.278164      0.211827        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39564.4 MB
  Peak resident set size usage (VmHWM): 2382.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2_reco_2024-11-21T_212847Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_31_20231201T114051Z_gen_g4_detsim_hitreco__20240507T194537Z_reco2_reco_data_2024-11-21T_212847Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-22 01:25:14 UTC       justIN version: 01.01.09