justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108544.102@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108544.102@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:01:33
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:19:45
From worker nodeHostnamedune001-3355103.0-lcg2675.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:18:04
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2.root
JobscriptExit code0
Real time54m (3270s)
CPU time1h (4142s = 126%)
Outputting started2024-11-23 00:12:34
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2.root
Finished2024-11-23 00:19:45
Saved logsjustin-logs:108544.102-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

00
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:30 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:31 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:31 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:31 UTC run: 6409602 subRun: 1 event: 51000
Comparing two wires in the same plane: return failure
%MSG
181
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 464!
23-Nov-2024 00:12:33 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2_reco_data_2024-11-22T_231810Z.root"
23-Nov-2024 00:12:33 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/f7/9c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.1539        31.1869       470.954       12.839        59.6189        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00134069     0.0958002     0.489224      0.0736828     0.0709117       100    
reco:linecluster:LineCluster                           0.0472061     0.319983       4.05368       0.23173      0.470326        100    
reco:trajcluster:TrajCluster                          0.00677558     0.735767       31.859       0.115571       3.33875        100    
reco:pandora:StandardPandora                           0.178688       2.30982       39.804        1.47156       4.40483        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000148339   0.00758771      0.18055     0.00243972     0.0202531       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00030281     0.0200874     0.318549     0.00539398     0.0465346       100    
reco:pandoracalo:Calorimetry                          0.000134494    0.020964      0.611844     0.00198376     0.0817044       100    
reco:pandorapid:Chi2ParticleID                        4.1148e-05    0.000222823   0.00157787    0.000181487   0.000202414      100    
reco:trkshowersplit:TrackShowerHits                   0.000129424    0.0254359      1.08816     0.00156343     0.115928        100    
reco:pmtrack:PMAlgTrackMaker                          0.00114897      2.79793       71.4361      0.397664       9.03745        100    
reco:pmtrackcalo:Calorimetry                          7.4721e-05     0.013677      0.563029     0.00169162     0.0582696       100    
reco:pmtrackpid:Chi2ParticleID                        2.9175e-05    0.000367804   0.00408809    0.000205242   0.000509267      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000280969     2.36498       49.5933      0.561854       6.0982         100    
reco:pmtrajfitcalo:Calorimetry                        0.000103175    0.0210872     0.600955     0.00279003     0.074056        100    
reco:pmtrajfitpid:Chi2ParticleID                       3.68e-05     0.00025539    0.000928208   0.000222364   0.000165775      100    
reco:pmtracktc:PMAlgTrackMaker                         0.0013543      3.11028       63.4857      0.423665       9.0437         100    
reco:pmtracktccalo:Calorimetry                        9.6601e-05    0.00850231     0.153393     0.00162665     0.020832        100    
reco:pmtracktcpid:Chi2ParticleID                       3.737e-05    0.000328085   0.00239305    0.00021504    0.000350134      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000227318     1.99215       37.6257      0.503103       5.06473        100    
reco:pmtrajfittccalo:Calorimetry                      8.6503e-05     0.0170155      0.4833      0.00187924     0.0620398       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.8402e-05    0.00045174    0.00441759    0.000223571   0.000680964      100    
reco:blurredcluster:BlurredClustering                 0.000163879     1.28418       9.50904      0.663104       1.7572         100    
reco:emtrkmichelid:EmTrackMichelId                     0.119055       11.7247       150.487       4.30391       20.8847        100    
reco:emshower:EMShower                                0.00036668     0.0377552     0.484822      0.0106714     0.0689027       100    
reco:cvnmap:CVNMapper                                 2.7322e-05     0.011407      0.0520532    0.00784438     0.0098618       100    
reco:cvneva:CVNEvaluator                              1.9377e-05      1.04183       1.54274       1.28327      0.502986        100    
reco:energyrecnumu:EnergyReco                         0.000506925    0.0493093     0.923349     0.00551497     0.135401        100    
reco:energyrecnue:EnergyReco                          0.000171142   0.00206775     0.0366993    0.000729418   0.00459918       100    
reco:energyrecnc:EnergyReco                           0.00187904    0.00503572     0.0383788    0.00374392    0.00465262       100    
reco:energyrecnumurange:EnergyReco                    0.000261713    0.0461716     0.913401     0.00328969      0.13276        100    
reco:energyrecnumumcs:EnergyReco                      0.00200106     0.0478899     0.912433     0.00552375     0.132637        100    
reco:opdec:Deconvolution                               0.0988487     0.325584      0.817308      0.312802      0.123109        100    
reco:ophitspe:OpHitFinderDeco                          0.209517       2.42683       4.72864       2.38067      0.978757        100    
reco:opflash:OpFlashFinder                            0.000338818   0.00169823    0.00617264    0.00160511    0.000823725      100    
reco:rns:RandomNumberSaver                            2.0689e-05    3.59103e-05   0.000391417   3.0728e-05    3.65775e-05      100    
reco:anglereconue:NuAngularReco                       0.000192672    0.0019061     0.0509728    0.000572723   0.00547737       100    
reco:anglereconumu:NuAngularReco                      8.6032e-05    0.00163512     0.0478903    0.000354728   0.00519308       100    
reco:anglereconuepfps:NuAngularReco                   0.000139252   0.00187477     0.0484907    0.000532212   0.00529267       100    
reco:anglereconumupfps:NuAngularReco                  0.000109576   0.00172188     0.0489926    0.000435386   0.00529069       100    
[art]:TriggerResults:TriggerResultInserter             9.357e-06    1.60245e-05   5.8019e-05    1.4723e-05    5.76619e-06      100    
end_path:out1:RootOutput                               2.825e-06    4.37509e-06    2.136e-05     3.983e-06    2.02457e-06      100    
end_path:out1:RootOutput(write)                        0.0224604     0.310196       1.40431      0.311758      0.189972        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39403.1 MB
  Peak resident set size usage (VmHWM): 2253.37 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2_reco_2024-11-22T_231810Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6409602_509_20231202T150611Z_gen_g4_detsim_hitreco__20240508T025727Z_reco2_reco_data_2024-11-22T_231810Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:26:47 UTC       justIN version: 01.01.09