justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.33@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.33@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:03:24
From worker nodeHostnamedune001-2994632.0-lcg2721.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:48
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2.root
JobscriptExit code0
Real time32m (1974s)
CPU time33m (1996s = 101%)
Outputting started2024-11-22 23:57:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2.root
Finished2024-11-23 00:03:24
Saved logsjustin-logs:301492.33-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:30 UTC run: 66006610 subRun: 1 event: 103000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:31 UTC run: 66006610 subRun: 1 event: 103000
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:31 UTC run: 66006610 subRun: 1 event: 103000
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:31 UTC run: 66006610 subRun: 1 event: 103000
Hit sorting problem.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:57:31 UTC run: 66006610 subRun: 1 event: 103000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:57:31 UTC run: 66006610 subRun: 1 event: 103000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:57:32 UTC run: 66006610 subRun: 1 event: 103000
1st wire C:0 T:11 P:2 W:494 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 619, 187, 344
minwire 0: 941
minwire 1: 1447
minwire 2: 1130
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00691455, 8.82211e-06, 0.993077, 
Output 1: 0.141835, 0.834645, 0.0226425, 0.000877924, 
Output 2: 0.997085, 0.00291478, 

579
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2038!
22-Nov-2024 23:57:42 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2_reco_data_2024-11-22T_232452Z.root"
22-Nov-2024 23:57:42 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/a0/67/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.377926       18.4519       179.657       9.27437       28.6877        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00236341     0.0997991     0.452739      0.0816885     0.0748343       100    
reco:linecluster:LineCluster                          0.00881023     0.229561       1.26894      0.193349      0.191214        100    
reco:trajcluster:TrajCluster                          0.00113316     0.287979       5.47053      0.0693094     0.784178        100    
reco:pandora:StandardPandora                           0.0359187      1.65678       15.1058       1.27712       1.78075        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000133741   0.00523403     0.0858006    0.00210461     0.0119805       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00019263     0.0156715     0.316204     0.00339051     0.0396274       100    
reco:pandoracalo:Calorimetry                          0.000110857    0.0120553     0.305804     0.00147013     0.0389382       100    
reco:pandorapid:Chi2ParticleID                        4.0761e-05    0.000174353   0.00235202    0.000137372   0.000243124      100    
reco:trkshowersplit:TrackShowerHits                   6.8934e-05     0.0128725     0.301871     0.00077222     0.0432176       100    
reco:pmtrack:PMAlgTrackMaker                          0.000912475     1.46106       19.8577       0.2064        3.6028         100    
reco:pmtrackcalo:Calorimetry                          6.0741e-05    0.00651625     0.114385      0.0009188     0.0175889       100    
reco:pmtrackpid:Chi2ParticleID                        2.4216e-05    0.000233176   0.00162094    0.000156986   0.00026297       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000180522     1.4363        17.1591      0.318182       3.06386        100    
reco:pmtrajfitcalo:Calorimetry                        4.3236e-05     0.0110786     0.272393      0.0017762     0.0332535       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.1813e-05    0.000183778   0.000850021   0.000149515   0.000140187      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000812985     1.42992       27.5208      0.202855       3.65979        100    
reco:pmtracktccalo:Calorimetry                        4.6039e-05    0.00486178     0.0988616    0.00100021     0.0125517       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8919e-05    0.000215737   0.00184453    0.000147583   0.000251812      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000148294     1.09482       14.7739      0.280038       2.43921        100    
reco:pmtrajfittccalo:Calorimetry                      4.1693e-05    0.00824579     0.177186     0.00124008     0.0245248       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7987e-05    0.000291237    0.0026749    0.000168729   0.000397762      100    
reco:blurredcluster:BlurredClustering                 0.000208294    0.890684       7.07093      0.391847       1.30727        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000130086     7.04411       71.2754       2.77646       12.2209        100    
reco:emshower:EMShower                                0.000178839    0.023572      0.269172     0.00267612     0.0425399       100    
reco:cvnmap:CVNMapper                                 2.0671e-05    0.00711346     0.0426304     0.0045876    0.00778415       100    
reco:cvneva:CVNEvaluator                              1.7206e-05     0.529852      0.984627       0.66501      0.368922        100    
reco:energyrecnumu:EnergyReco                         0.000328045    0.0287161     0.550968     0.00584848     0.0901227       100    
reco:energyrecnue:EnergyReco                          0.000129115   0.00160002     0.0297597    0.000559964   0.00383889       100    
reco:energyrecnc:EnergyReco                           0.00148182    0.00357106     0.0331403    0.00261533    0.00401003       100    
reco:energyrecnumurange:EnergyReco                     0.0001788     0.0239674     0.533931      0.0024516     0.0860154       100    
reco:energyrecnumumcs:EnergyReco                       0.0012187     0.0282079     0.694879     0.00313451     0.104116        100    
reco:opdec:Deconvolution                               0.0292102     0.294551       1.26655      0.257498      0.171838        100    
reco:ophitspe:OpHitFinderDeco                          0.161523       1.59011       3.13463       1.61722      0.681676        100    
reco:opflash:OpFlashFinder                            0.000372822   0.00139164    0.00549424    0.00129425    0.000684978      100    
reco:rns:RandomNumberSaver                            1.8097e-05    3.37925e-05   0.000366402   2.77815e-05   3.4886e-05       100    
reco:anglereconue:NuAngularReco                       0.000163607   0.00115618     0.0172904    0.000415431   0.00232205       100    
reco:anglereconumu:NuAngularReco                      5.8679e-05    0.000901757    0.0170897    0.000217353   0.00229614       100    
reco:anglereconuepfps:NuAngularReco                   0.000124027   0.00105959     0.0176898    0.000346918   0.00241827       100    
reco:anglereconumupfps:NuAngularReco                  7.7206e-05    0.000942588    0.0173704    0.000282796   0.00229198       100    
[art]:TriggerResults:TriggerResultInserter             8.964e-06    1.41368e-05   9.3121e-05    1.27995e-05   8.57036e-06      100    
end_path:out1:RootOutput                               3.135e-06    5.13535e-06   3.0285e-05     4.326e-06    2.80635e-06      100    
end_path:out1:RootOutput(write)                        0.024125      0.204316      0.598616      0.222999      0.127807        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40107 MB
  Peak resident set size usage (VmHWM): 2319.3 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2_reco_2024-11-22T_232452Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1029_20231203T025300Z_gen_g4_detsim_hitreco__20240508T065021Z_reco2_reco_data_2024-11-22T_232452Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:07:54 UTC       justIN version: 01.01.09