justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301700.91@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301700.91@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 04:20:24
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce506
Last heartbeat2024-11-23 05:04:42
From worker nodeHostnameb9p07p3554.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 04:22:59
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2.root
JobscriptExit code0
Real time41m (2487s)
CPU time43m (2631s = 105%)
Outputting started2024-11-23 05:04:27
Output files
Finished2024-11-23 05:04:42
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

40)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 13 with KE=0.0740832 GeV, E=0.179742 GeV, p2=0.0211433
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:04:22 CET run: 50577113 subRun: 1 event: 52500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:04:22 CET run: 50577113 subRun: 1 event: 52500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:04:22 CET run: 50577113 subRun: 1 event: 52500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 06:04:22 CET run: 50577113 subRun: 1 event: 52500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 06:04:23 CET run: 50577113 subRun: 1 event: 52500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 61, 60, 65
minwire 0: 742
minwire 1: 2360
minwire 2: 101
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.058174, 0.106306, 0.83552, 
Output 1: 0.92531, 0.07298, 0.00144051, 0.000269409, 
Output 2: 0.95488, 0.0451202, 

339
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 915!
23-Nov-2024 06:04:26 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2_reco_data_2024-11-23T_042304Z.root"
23-Nov-2024 06:04:26 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/1f/fb/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.517578       22.4675       510.431       8.73496       57.6661        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0167127     0.0476257      0.34392      0.0411403     0.0447447       100    
reco:linecluster:LineCluster                           0.0947017     0.387252       10.0165      0.173207       1.24177        100    
reco:trajcluster:TrajCluster                           0.0476603     0.855724       39.8223      0.068692       4.48484        100    
reco:pandora:StandardPandora                           0.0543131      1.68159       41.3171      0.960977       4.2598         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000121091   0.00452192     0.114918     0.00177301     0.0127868       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000155932   0.00817382     0.0697832    0.00338194     0.0130225       100    
reco:pandoracalo:Calorimetry                          8.8231e-05     0.0136405     0.441994     0.00141582     0.0567689       100    
reco:pandorapid:Chi2ParticleID                         3.272e-05    0.000127909   0.00138139    9.9871e-05    0.000143468      100    
reco:trkshowersplit:TrackShowerHits                   0.000106571    0.020779      0.827933     0.000899933    0.0976199       100    
reco:pmtrack:PMAlgTrackMaker                          0.000966008     2.16298       85.1777      0.253393       9.10277        100    
reco:pmtrackcalo:Calorimetry                          5.9811e-05    0.00902834     0.398513     0.000954149    0.0422596       100    
reco:pmtrackpid:Chi2ParticleID                         2.241e-05    0.00023218    0.00290639    0.000118231   0.000398621      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000160641     1.28811       27.1455      0.316281       3.38518        100    
reco:pmtrajfitcalo:Calorimetry                         5.429e-05     0.0128637     0.359548     0.00153107     0.0487296       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.2441e-05    0.000145238   0.000779367   0.000128656   0.000109804      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000742947     2.93409       119.73       0.319549       13.1573        100    
reco:pmtracktccalo:Calorimetry                        5.8091e-05    0.00640736      0.27784     0.00109968     0.0285612       100    
reco:pmtracktcpid:Chi2ParticleID                       2.272e-05    0.000217568   0.00267079    0.000142281   0.000311479      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000126442     1.37144       39.636       0.333746       4.37302        100    
reco:pmtrajfittccalo:Calorimetry                       5.385e-05     0.0119809     0.458231     0.00103098     0.0501179       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.1821e-05    0.000288359   0.00313611    0.000149421   0.000445084      100    
reco:blurredcluster:BlurredClustering                 8.5091e-05     0.909148       9.08844      0.449678       1.31229        100    
reco:emtrkmichelid:EmTrackMichelId                     8.53e-05       8.17544       131.72        2.88407        16.84         100    
reco:emshower:EMShower                                0.000139141    0.0199807     0.254994     0.00328566     0.0340222       100    
reco:cvnmap:CVNMapper                                  1.564e-05    0.00797234     0.0332382    0.00578455    0.00702769       100    
reco:cvneva:CVNEvaluator                               1.312e-05     0.603501       1.1837       0.712466       0.31062        100    
reco:energyrecnumu:EnergyReco                         0.000262723    0.0255541     0.669384     0.00395483     0.0787661       100    
reco:energyrecnue:EnergyReco                          0.000124571   0.00142616     0.0421156    0.000478124   0.00436994       100    
reco:energyrecnc:EnergyReco                           0.00147117    0.00319385     0.0457211    0.00219108    0.00463152       100    
reco:energyrecnumurange:EnergyReco                    0.000114201    0.0236544     0.655639     0.00231937     0.0775958       100    
reco:energyrecnumumcs:EnergyReco                      0.000948178    0.0252229     0.672579     0.00329161     0.079226        100    
reco:opdec:Deconvolution                               0.060697      0.259814      0.467281      0.259538      0.0746411       100    
reco:ophitspe:OpHitFinderDeco                          0.140861       1.39772       3.3584        1.35728      0.542436        100    
reco:opflash:OpFlashFinder                            0.000111811    0.001111     0.00391849    0.00105891    0.000525688      100    
reco:rns:RandomNumberSaver                             1.619e-05    2.82861e-05   0.000284793   2.5285e-05    2.66315e-05      100    
reco:anglereconue:NuAngularReco                       0.000147561   0.00133727     0.0574743    0.000355808   0.00581951       100    
reco:anglereconumu:NuAngularReco                      6.9581e-05    0.00119926     0.0581222    0.000205972   0.00588852       100    
reco:anglereconuepfps:NuAngularReco                   0.000110221   0.00130696     0.0579773    0.000320193   0.00586773       100    
reco:anglereconumupfps:NuAngularReco                  9.8291e-05    0.00125116     0.057432     0.000251647   0.00581657       100    
[art]:TriggerResults:TriggerResultInserter             7.72e-06     1.04456e-05    3.396e-05     9.57e-06     3.46442e-06      100    
end_path:out1:RootOutput                               2.49e-06     4.47774e-06    1.603e-05     4.075e-06    1.91965e-06      100    
end_path:out1:RootOutput(write)                        0.0103462     0.189839       1.1456       0.179224       0.13925        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 22617.7 MB
  Peak resident set size usage (VmHWM): 3039.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2_reco_2024-11-23T_042304Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_524_20231204T014815Z_gen_g4_detsim_hitreco__20240509T215642Z_reco2_reco_data_2024-11-23T_042304Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:39:30 UTC       justIN version: 01.01.09