justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108551.34@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108551.34@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:16:35
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:44
From worker nodeHostnamedune001-2994631.0-lcg2607.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:34:21
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2.root
JobscriptExit code0
Real time44m (2656s)
CPU time56m (3392s = 127%)
Outputting started2024-11-23 00:18:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2.root
Finished2024-11-23 00:26:44
Saved logsjustin-logs:108551.34-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

---------------------------------------------------

Found: 2212 with KE=0.308793 GeV, E=1.24706 GeV, p2=0.674816
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:18:31 UTC run: 6453326 subRun: 1 event: 16400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 38, 32, 34
minwire 0: 1164
minwire 1: 1714
minwire 2: 1054
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.970659, 0.00212987, 0.0272106, 
Output 1: 0.391467, 0.60594, 0.00200305, 0.000589632, 
Output 2: 0.980011, 0.0199892, 

323
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 725!
23-Nov-2024 00:18:37 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2_reco_data_2024-11-22T_233426Z.root"
23-Nov-2024 00:18:37 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/aa/83/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.418259       24.9131       298.916       12.0899       43.9595        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00183171      0.13245      0.717662      0.0943255     0.128164        100    
reco:linecluster:LineCluster                           0.0326707     0.376067       3.56168      0.265368       0.47937        100    
reco:trajcluster:TrajCluster                          0.00156949     0.590532       19.3493      0.0970616      2.42945        100    
reco:pandora:StandardPandora                           0.0275973      2.0495        20.0794       1.53882       2.4622         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000183536    0.005776      0.0968138    0.00166996     0.0133866       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000249228    0.0119619     0.253594     0.00328343     0.0281047       100    
reco:pandoracalo:Calorimetry                          0.000139645    0.016604      0.446177     0.00115747     0.058612        100    
reco:pandorapid:Chi2ParticleID                        5.2961e-05    0.000210481   0.00174309    0.000172226   0.00019869       100    
reco:trkshowersplit:TrackShowerHits                   0.000122134    0.0212147     0.667277     0.000718929    0.0894829       100    
reco:pmtrack:PMAlgTrackMaker                          0.00173391      1.94564       41.0334      0.169623       5.88238        100    
reco:pmtrackcalo:Calorimetry                          0.000104954   0.00833062     0.256552     0.000983067    0.0313942       100    
reco:pmtrackpid:Chi2ParticleID                        4.1551e-05    0.000342663   0.00350117    0.000188561   0.000513342      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000253708     2.00932       49.1975      0.298916       6.01693        100    
reco:pmtrajfitcalo:Calorimetry                        8.7143e-05     0.0153382     0.303343     0.00169191     0.0472981       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.6091e-05    0.000242526   0.000950281   0.000195511   0.000175178      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00129671      2.03274       34.1201      0.211572       5.81404        100    
reco:pmtracktccalo:Calorimetry                        8.9163e-05    0.00548653     0.0925263    0.000957176    0.0140372       100    
reco:pmtracktcpid:Chi2ParticleID                      3.5891e-05    0.000295349   0.00214309    0.000189971   0.000322716      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000209077     1.37286       18.5887      0.351922       2.96396        100    
reco:pmtrajfittccalo:Calorimetry                      8.3443e-05     0.0100248     0.197155     0.00117463     0.0306551       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4271e-05    0.000376078   0.00297178    0.000222218   0.000477773      100    
reco:blurredcluster:BlurredClustering                 0.000184596     1.12527       6.69873      0.605618       1.45982        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000141545     9.0612        116.443       2.57381       17.1024        100    
reco:emshower:EMShower                                0.000198277    0.0294068     0.216335     0.00239867     0.0498801       100    
reco:cvnmap:CVNMapper                                 2.2961e-05    0.00926168     0.0405454    0.00643779    0.00929912       100    
reco:cvneva:CVNEvaluator                               1.873e-05      0.91403       1.78018       1.26864      0.612458        100    
reco:energyrecnumu:EnergyReco                         0.000396653    0.0280949      0.4544      0.00532356     0.0668111       100    
reco:energyrecnue:EnergyReco                          0.000145734   0.00202488     0.0305446    0.000772771   0.00405839       100    
reco:energyrecnc:EnergyReco                           0.00194818    0.00475186     0.0300617     0.0037175    0.00386992       100    
reco:energyrecnumurange:EnergyReco                    0.000211017    0.0256097     0.461877     0.00357916     0.0666497       100    
reco:energyrecnumumcs:EnergyReco                      0.00228685     0.0266195     0.470161     0.00443673     0.0637932       100    
reco:opdec:Deconvolution                               0.0210067     0.399228       2.67755      0.329441      0.410871        100    
reco:ophitspe:OpHitFinderDeco                          0.0334157      2.39397       4.38959       2.44973       1.03552        100    
reco:opflash:OpFlashFinder                            0.000234748    0.0017706     0.0080129    0.00173169    0.000971754      100    
reco:rns:RandomNumberSaver                            2.3171e-05    4.62109e-05   0.000479115   3.97015e-05   4.5613e-05       100    
reco:anglereconue:NuAngularReco                       0.000200016   0.00138328     0.0197437    0.000524292   0.00291657       100    
reco:anglereconumu:NuAngularReco                      9.7283e-05    0.00109297     0.0179104    0.000284759   0.00272096       100    
reco:anglereconuepfps:NuAngularReco                   0.000166085   0.00126135     0.0176413    0.000452479   0.00271372       100    
reco:anglereconumupfps:NuAngularReco                  0.000142825   0.00116892     0.0179436    0.000372237   0.00271448       100    
[art]:TriggerResults:TriggerResultInserter            1.0421e-05    1.85458e-05   6.9552e-05    1.70155e-05   6.85551e-06      100    
end_path:out1:RootOutput                               3.24e-06     4.74737e-06   2.3301e-05    4.3355e-06    2.4865e-06       100    
end_path:out1:RootOutput(write)                        0.0174722     0.278934      0.868752      0.310502      0.171871        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39307.3 MB
  Peak resident set size usage (VmHWM): 2143.78 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2_reco_2024-11-22T_233426Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_163_20231206T233120Z_gen_g4_detsim_hitreco__20240510T024312Z_reco2_reco_data_2024-11-22T_233426Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:08:50 UTC       justIN version: 01.01.09