justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.176@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.176@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:17:23
From worker nodeHostnamedune001-2994188.0-lcg2724.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:33
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2.root
JobscriptExit code0
Real time47m (2852s)
CPU time48m (2917s = 102%)
Outputting started2024-11-23 00:12:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2.root
Finished2024-11-23 00:17:23
Saved logsjustin-logs:301491.176-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

bRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
1st wire C:0 T:9 P:2 W:524 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:11:56 UTC run: 74517882 subRun: 1 event: 12700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 146, 250, 171
minwire 0: 1007
minwire 1: 2014
minwire 2: 633
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.269471, 0.00385673, 0.726672, 
Output 1: 0.273872, 0.662791, 0.0610096, 0.00232699, 
Output 2: 0.472844, 0.527156, 

616
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2154!
23-Nov-2024 00:12:04 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2_reco_data_2024-11-22T_232437Z.root"
23-Nov-2024 00:12:04 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/f8/73/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.768418       27.2824       850.972       9.51407       88.733         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00121558     0.130892      0.560703      0.087992      0.109885        100    
reco:linecluster:LineCluster                            0.04595       1.0212        63.0798      0.221672       6.27392        100    
reco:trajcluster:TrajCluster                          0.000829552     1.47737       106.025      0.0912744      10.633         100    
reco:pandora:StandardPandora                           0.176745       2.65974       90.6661       1.31896       9.21364        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000124808   0.00732548     0.257605     0.00171517     0.0267853       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000183167    0.013921      0.250879     0.00278658     0.0313455       100    
reco:pandoracalo:Calorimetry                          9.1138e-05     0.029313       1.9211      0.000995527    0.192542        100    
reco:pandorapid:Chi2ParticleID                        3.4412e-05    0.000205741    0.0026423    0.000128123   0.000309379      100    
reco:trkshowersplit:TrackShowerHits                   6.1563e-05     0.0343224      2.11628     0.000684058    0.214953        100    
reco:pmtrack:PMAlgTrackMaker                          0.00128047      3.42377       191.503      0.187073       19.2914        100    
reco:pmtrackcalo:Calorimetry                          6.7943e-05     0.0125465     0.696075     0.000842135    0.0704593       100    
reco:pmtrackpid:Chi2ParticleID                         2.658e-05    0.000257241   0.00333216    0.000150291   0.000395983      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000218049     1.73851       49.0286      0.223981       5.66139        100    
reco:pmtrajfitcalo:Calorimetry                         6.658e-05     0.0231995      1.33622     0.00129276     0.135257        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7522e-05    0.000182956   0.000674077   0.000147508   0.000127931      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000990594     2.98663       148.195      0.152419       15.1034        100    
reco:pmtracktccalo:Calorimetry                        6.6971e-05    0.00572155     0.131407     0.000925532    0.016585        100    
reco:pmtracktcpid:Chi2ParticleID                      2.5618e-05    0.000229908   0.00164355    0.000143923   0.000256164      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000155635     1.49589       48.2897      0.230009       5.15882        100    
reco:pmtrajfittccalo:Calorimetry                      5.7116e-05     0.0130162      0.60042     0.00104423     0.062795        100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.656e-05    0.000299962   0.00321493    0.000161062   0.000437282      100    
reco:blurredcluster:BlurredClustering                 0.000206412    0.977564       5.61025      0.506819       1.23931        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000101973     8.5536        134.699       2.23707       18.9687        100    
reco:emshower:EMShower                                0.000150437    0.0214519     0.237889     0.00302294     0.0450349       100    
reco:cvnmap:CVNMapper                                 1.6836e-05    0.00815252     0.0348389    0.00508898    0.00865313       100    
reco:cvneva:CVNEvaluator                              1.5944e-05     0.514744      0.999081      0.642536      0.368524        100    
reco:energyrecnumu:EnergyReco                         0.000300103    0.0238723     0.479159     0.00658887     0.0645273       100    
reco:energyrecnue:EnergyReco                          9.7237e-05     0.0018413     0.0394147    0.000413103   0.00522996       100    
reco:energyrecnc:EnergyReco                           0.00132852    0.00381221     0.0437453     0.0025133    0.00563401       100    
reco:energyrecnumurange:EnergyReco                    0.000153862    0.0200145     0.485811     0.00238318     0.0636209       100    
reco:energyrecnumumcs:EnergyReco                      0.000928151    0.0209878     0.464513     0.00296393     0.0616604       100    
reco:opdec:Deconvolution                               0.0820504     0.273117       1.04104      0.243113      0.152142        100    
reco:ophitspe:OpHitFinderDeco                          0.148534       1.55971       3.21925       1.5192       0.690222        100    
reco:opflash:OpFlashFinder                            0.000102344   0.00144495    0.00526072    0.00131476    0.000788677      100    
reco:rns:RandomNumberSaver                            1.8888e-05    3.82309e-05   0.00031829    3.1748e-05    3.05446e-05      100    
reco:anglereconue:NuAngularReco                       0.000168584    0.0018286     0.0540512    0.000452888    0.0062615       100    
reco:anglereconumu:NuAngularReco                       6.609e-05    0.00158695     0.0541041    0.000214559   0.00623985       100    
reco:anglereconuepfps:NuAngularReco                   0.000117678    0.0017006     0.0536084    0.000357078   0.00620716       100    
reco:anglereconumupfps:NuAngularReco                  8.9936e-05    0.00161493     0.0530569    0.000266848   0.00617977       100    
[art]:TriggerResults:TriggerResultInserter             8.984e-06    1.35614e-05   4.9495e-05    1.2599e-05    4.37645e-06      100    
end_path:out1:RootOutput                               3.355e-06    5.68532e-06   2.9094e-05    4.7825e-06    3.38054e-06      100    
end_path:out1:RootOutput(write)                        0.0124929     0.218568       1.3464       0.226548      0.183059        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40291.1 MB
  Peak resident set size usage (VmHWM): 2504.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2_reco_2024-11-22T_232437Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_126_20231204T140303Z_gen_g4_detsim_hitreco__20240509T215704Z_reco2_reco_data_2024-11-22T_232437Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:42:17 UTC       justIN version: 01.01.09