justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301489.23@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301489.23@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:05:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:17:49
From worker nodeHostnamedune001-3355046.0-lcg2669.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:17:29
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2.root
JobscriptExit code0
Real time50m (3033s)
CPU time1h (3744s = 123%)
Outputting started2024-11-23 00:08:02
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2.root
Finished2024-11-23 00:17:48
Saved logsjustin-logs:301489.23-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ailure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:07:52 UTC run: 50602992 subRun: 1 event: 700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:07:52 UTC run: 50602992 subRun: 1 event: 700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:07:52 UTC run: 50602992 subRun: 1 event: 700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:07:53 UTC run: 50602992 subRun: 1 event: 700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:07:53 UTC run: 50602992 subRun: 1 event: 700
1st wire C:0 T:10 P:2 W:800 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 57, 51, 50
minwire 0: 1079
minwire 1: 1760
minwire 2: 767
Used alternate method to get min and max wires due to vertex determination failure: 40, 239
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 146, 345
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 154, 353
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.997011, 0.000309474, 0.00267907, 
Output 1: 0.895831, 0.102032, 0.00201093, 0.000126793, 
Output 2: 0.998252, 0.00174821, 

517
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1739!
23-Nov-2024 00:08:01 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2_reco_data_2024-11-22T_231734Z.root"
23-Nov-2024 00:08:01 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/5e/67/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.294046       28.9273       405.614       11.9668       56.8823        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0219659     0.0930052     0.405671      0.0726044     0.0677057       100    
reco:linecluster:LineCluster                           0.0229108     0.418176       9.92715      0.232993       1.14987        100    
reco:trajcluster:TrajCluster                           0.0013949     0.629048       16.4858      0.105659       2.26111        100    
reco:pandora:StandardPandora                           0.0476971      2.48976       48.4917       1.51703       5.34378        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000131498   0.00673835     0.093046     0.00187577     0.0148941       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000192663    0.0118264     0.105742     0.00302804     0.0195616       100    
reco:pandoracalo:Calorimetry                          0.000105639    0.020341      0.619729      0.0012514     0.0800766       100    
reco:pandorapid:Chi2ParticleID                        3.9315e-05    0.000208335   0.00192959    0.000149617   0.000215314      100    
reco:trkshowersplit:TrackShowerHits                   9.2415e-05     0.0242892     0.805275     0.000962478     0.09287        100    
reco:pmtrack:PMAlgTrackMaker                          0.00106613      2.62077       74.8353      0.279086       8.94591        100    
reco:pmtrackcalo:Calorimetry                          7.0823e-05     0.0104173      0.27478     0.000989059    0.0357426       100    
reco:pmtrackpid:Chi2ParticleID                        2.9345e-05    0.000365094   0.00349747    0.000190098   0.000543887      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000237477     2.18142       46.591       0.330618       6.29946        100    
reco:pmtrajfitcalo:Calorimetry                        6.4301e-05     0.020251      0.620097     0.00168291     0.0803515       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7601e-05    0.000240185   0.00101539    0.00019403    0.000173454      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000905516     2.58319       43.0761      0.227773       6.79044        100    
reco:pmtracktccalo:Calorimetry                        6.7488e-05    0.00619144     0.0797322    0.00108961     0.0135306       100    
reco:pmtracktcpid:Chi2ParticleID                      2.6499e-05    0.000359205   0.00455051    0.000196891   0.000534523      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000168037     1.76883       40.5082       0.28299       4.91083        100    
reco:pmtrajfittccalo:Calorimetry                      6.0985e-05     0.0152597     0.436608     0.00118419     0.0540379       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5989e-05    0.000442829   0.00473067    0.000198239   0.00069294       100    
reco:blurredcluster:BlurredClustering                 0.000200988     1.26868       8.82512      0.649192       1.61708        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000157958     10.698        114.698       3.12699       20.2765        100    
reco:emshower:EMShower                                0.000242417     0.03249      0.241213     0.00879525     0.0491771       100    
reco:cvnmap:CVNMapper                                 2.3725e-05    0.00983811     0.0484483    0.00598346     0.0105932       100    
reco:cvneva:CVNEvaluator                              1.7072e-05     0.884321       1.55826       1.22562      0.590675        100    
reco:energyrecnumu:EnergyReco                         0.00036649     0.0489416     0.748906     0.00456992     0.138293        100    
reco:energyrecnue:EnergyReco                          0.000145915   0.00209735     0.0288499    0.000638633   0.00416646       100    
reco:energyrecnc:EnergyReco                           0.00164141    0.00483235     0.0296203    0.00358217    0.00421083       100    
reco:energyrecnumurange:EnergyReco                    0.000198164    0.0469026     0.722696     0.00333754     0.136984        100    
reco:energyrecnumumcs:EnergyReco                      0.000882652    0.0500526     0.761283     0.00402677     0.141162        100    
reco:opdec:Deconvolution                               0.0249799     0.371353       2.57761      0.325937      0.301906        100    
reco:ophitspe:OpHitFinderDeco                          0.0186204      2.32531       5.27834       2.18209       1.06209        100    
reco:opflash:OpFlashFinder                            0.000177324   0.00166454    0.00666047    0.00141406    0.000961774      100    
reco:rns:RandomNumberSaver                            2.0167e-05    4.08469e-05   0.000438937   3.27865e-05   4.15938e-05      100    
reco:anglereconue:NuAngularReco                       0.000199436   0.00165572     0.028759     0.000393556   0.00391974       100    
reco:anglereconumu:NuAngularReco                      9.2404e-05    0.00141289     0.0279931    0.00027079    0.00383758       100    
reco:anglereconuepfps:NuAngularReco                   0.000168297    0.0015657     0.028214     0.000386353   0.00384229       100    
reco:anglereconumupfps:NuAngularReco                  0.000142208   0.00149699     0.0290968    0.000326645   0.00390946       100    
[art]:TriggerResults:TriggerResultInserter             9.297e-06    1.63811e-05   6.6125e-05    1.4808e-05    6.60964e-06      100    
end_path:out1:RootOutput                               3.477e-06    5.42593e-06   2.4857e-05     4.914e-06    2.67604e-06      100    
end_path:out1:RootOutput(write)                        0.0186465     0.272943       1.0297       0.281622       0.19579        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39573.9 MB
  Peak resident set size usage (VmHWM): 2410.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2_reco_2024-11-22T_231734Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602992_6_20231205T112632Z_gen_g4_detsim_hitreco__20240510T031126Z_reco2_reco_data_2024-11-22T_231734Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:38:41 UTC       justIN version: 01.01.09