justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301451.16@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301451.16@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:37:24
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2024-11-22 23:51:14
From worker nodeHostnamecn055.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:56:59
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2.root
JobscriptExit code0
Real time48m (2908s)
CPU time40m (2433s = 83%)
Outputting started2024-11-22 23:45:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2.root
Finished2024-11-22 23:51:14
Saved logsjustin-logs:301451.16-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ne: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:43:11 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:43:11 GMT run: 50577091 subRun: 1 event: 5100
Track empty.
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:18 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:18 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:18 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:18 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:18 GMT run: 50577091 subRun: 1 event: 5100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 5300, 5781, 3553
minwire 0: 599
minwire 1: 766
minwire 2: 173
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0520639, 0.70938, 0.238556, 
Output 1: 0.361842, 0.446894, 0.14543, 0.0458341, 
Output 2: 0.0819097, 0.91809, 

867
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3331!
22-Nov-2024 23:45:25 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2_reco_data_2024-11-22T_225705Z.root"
22-Nov-2024 23:45:26 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/e9/f5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.22538       25.8575       290.782       12.8835       45.1962        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00210584     0.209176       1.61261      0.108237      0.273182        100    
reco:linecluster:LineCluster                           0.0218257      0.7624        6.03407      0.306107       1.06863        100    
reco:trajcluster:TrajCluster                          0.00451997     0.630084       21.8991      0.0191963      2.81551        100    
reco:pandora:StandardPandora                            1.25572       2.00325       16.1565       1.50364       1.94503        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00013434    0.00459904     0.0629955    0.00144211    0.00995709       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000172483    0.0107179     0.140501     0.00232588     0.0233147       100    
reco:pandoracalo:Calorimetry                          9.3954e-05     0.0133736     0.485006     0.000819918    0.0597841       100    
reco:pandorapid:Chi2ParticleID                        3.7947e-05    0.000142758   0.00151399    0.000115956   0.000159294      100    
reco:trkshowersplit:TrackShowerHits                   9.3386e-05     0.0129699     0.486879     0.000574367    0.0569298       100    
reco:pmtrack:PMAlgTrackMaker                          0.00114355      1.15965       22.5244      0.120139       3.19261        100    
reco:pmtrackcalo:Calorimetry                           7.781e-05     0.0067879     0.207613     0.00090034     0.0234878       100    
reco:pmtrackpid:Chi2ParticleID                        3.0809e-05    0.000213038   0.00209856    0.000132074   0.000297258      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000220962     2.02993       52.8906      0.201911       7.42428        100    
reco:pmtrajfitcalo:Calorimetry                         6.356e-05     0.0134548      0.44822     0.00107691     0.0574758       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.8073e-05    0.000154416   0.000590791   0.000132534   0.000109099      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000976655     1.52562       34.4825      0.157165       4.95828        100    
reco:pmtracktccalo:Calorimetry                        6.9074e-05    0.00533304     0.119318     0.000913621    0.0147246       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7835e-05    0.000211339   0.00183411    0.000135192   0.000276796      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000164573    0.940707       14.9607      0.221926       2.15458        100    
reco:pmtrajfittccalo:Calorimetry                      5.8566e-05     0.0101239     0.277937     0.000911988    0.0366471       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5029e-05    0.000262472   0.00257669    0.000140945   0.000414497      100    
reco:blurredcluster:BlurredClustering                 0.00281532      1.08984       6.91424      0.684501       1.31918        100    
reco:emtrkmichelid:EmTrackMichelId                     0.260819       11.2298       129.88        3.40658       22.0125        100    
reco:emshower:EMShower                                0.000239556    0.0199573     0.144778     0.00517989     0.0311019       100    
reco:cvnmap:CVNMapper                                 1.9758e-05     0.0136478     0.0436087     0.0144863     0.0100838       100    
reco:cvneva:CVNEvaluator                               1.578e-05     0.617707       1.07431      0.824454       0.37793        100    
reco:energyrecnumu:EnergyReco                         0.000276902    0.0253994     0.736072     0.00437977     0.0904923       100    
reco:energyrecnue:EnergyReco                          0.000128819   0.00145353     0.0190788    0.000441723   0.00316782       100    
reco:energyrecnc:EnergyReco                           0.00181759    0.00307955     0.0194661    0.00210719    0.00309394       100    
reco:energyrecnumurange:EnergyReco                    0.000229002    0.0234742     0.735949     0.00204408     0.0903391       100    
reco:energyrecnumumcs:EnergyReco                      0.000929178    0.0245419     0.738288     0.00253733     0.0903572       100    
reco:opdec:Deconvolution                               0.0382873     0.782776       4.47614      0.489507      0.798484        100    
reco:ophitspe:OpHitFinderDeco                          0.402817        2.483        6.80077       2.46597       1.22553        100    
reco:opflash:OpFlashFinder                            0.000319413   0.00126649    0.00448967    0.00122908    0.000675773      100    
reco:rns:RandomNumberSaver                            1.9713e-05    3.23528e-05   0.000295206   2.7208e-05    2.75311e-05      100    
reco:anglereconue:NuAngularReco                       0.000156314   0.00116335     0.0153184    0.00032275    0.00260607       100    
reco:anglereconumu:NuAngularReco                      6.4102e-05    0.000938052    0.0142919    0.00017085    0.00248653       100    
reco:anglereconuepfps:NuAngularReco                   0.000109942   0.00104635     0.0144815    0.000272395   0.00248295       100    
reco:anglereconumupfps:NuAngularReco                  8.9292e-05     0.0010071     0.0149952    0.000237919   0.00250777       100    
[art]:TriggerResults:TriggerResultInserter             9.401e-06    1.24635e-05   5.5034e-05    1.1242e-05    5.2142e-06       100    
end_path:out1:RootOutput                               3.036e-06    4.98911e-06   1.9126e-05    4.2035e-06    2.10075e-06      100    
end_path:out1:RootOutput(write)                        0.0184046     0.196205      0.717072      0.205396      0.128805        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16928.9 MB
  Peak resident set size usage (VmHWM): 2292.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2_reco_2024-11-22T_225705Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577091_50_20231203T172609Z_gen_g4_detsim_hitreco__20240509T205617Z_reco2_reco_data_2024-11-22T_225705Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 17:40:24 UTC       justIN version: 01.01.09