justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91726.135@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91726.135@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-06 04:14:48
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-11-06 09:20:00
From worker nodeHostnamewn1205250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 04:18:16
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2.root
JobscriptExit code0
Real time5h (18068s)
CPU time4h (17035s = 94%)
Outputting started2024-11-06 09:19:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03932/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2.root
Finished2024-11-06 09:20:00
Saved logsjustin-logs:91726.135-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Module  06-Nov-2024 09:19:11 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 09:19:11 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 09:19:11 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 09:19:11 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 09:19:16 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 09:19:16 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 09:19:16 GMT run: 6491894 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 112, 91, 103
minwire 0: 1344
minwire 1: 1079
minwire 2: 1537
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000278723, 0.999045, 0.000676137, 
Output 1: 0.0311639, 0.967263, 0.00156539, 7.38542e-06, 
Output 2: 0.999068, 0.00093155, 

420
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1245!
06-Nov-2024 09:19:22 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2_reco_data_2024-11-06T_041823Z.root"
06-Nov-2024 09:19:22 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/f1/e3/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.44766       176.998       11967.4       14.781        1194.04        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                  0.02704      0.0693401     0.430042      0.0649705     0.0497014       100    
reco:linecluster:LineCluster                           0.243438       1.20113       45.5285      0.283741       5.11428        100    
reco:trajcluster:TrajCluster                           0.0779513      3.4995        127.613      0.0947642      15.6051        100    
reco:pandora:StandardPandora                           0.0965046      115.731       11097.9       1.95104       1103.83        100    
reco:pandoraTrack:LArPandoraTrackCreation              0.0001587     0.0149579      0.19942     0.00235601     0.0376769       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000243059    0.0215983     0.316549     0.00405689     0.0454895       100    
reco:pandoracalo:Calorimetry                          0.000130216    0.0589373      1.33812     0.00179053     0.221888        100    
reco:pandorapid:Chi2ParticleID                        4.9864e-05    0.000287874   0.00315733    0.000180821   0.000372895      100    
reco:trkshowersplit:TrackShowerHits                   0.00013237     0.0641316      1.55157     0.00109848      0.23806        100    
reco:pmtrack:PMAlgTrackMaker                          0.00158008      7.82476       199.421      0.217525       27.3143        100    
reco:pmtrackcalo:Calorimetry                          9.5961e-05     0.0287716     0.553205     0.00142846     0.0952937       100    
reco:pmtrackpid:Chi2ParticleID                        4.0506e-05    0.00058359     0.0063893    0.000200589   0.00114974       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000255422     6.94941       243.393      0.341162       28.2058        100    
reco:pmtrajfitcalo:Calorimetry                         8.46e-05      0.0549841      1.32444     0.00244459     0.198129        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.5076e-05    0.000312322   0.00174113    0.000193465    0.0003117       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00137807      8.54784       149.01       0.311131       27.5702        100    
reco:pmtracktccalo:Calorimetry                        9.9548e-05     0.0182951     0.365096     0.00162035     0.0525076       100    
reco:pmtracktcpid:Chi2ParticleID                      3.6319e-05    0.000516881   0.00494975    0.00020973    0.000871489      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00024892      4.18746       60.9453      0.440589       11.461         100    
reco:pmtrajfittccalo:Calorimetry                      8.2125e-05     0.046245      0.932949     0.00168217      0.16112        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.3974e-05    0.000721274   0.00770121    0.000228482   0.00135998       100    
reco:blurredcluster:BlurredClustering                  0.0113168      1.92718       14.8303      0.661568       2.9311         100    
reco:emtrkmichelid:EmTrackMichelId                     0.056197       21.8269       226.501       4.33161       46.2189        100    
reco:emshower:EMShower                                0.000319383    0.0652444     0.618521      0.0134841     0.112318        100    
reco:cvnmap:CVNMapper                                 2.8554e-05    0.00872028     0.0712498    0.00912049     0.0102517       100    
reco:cvneva:CVNEvaluator                              2.3083e-05      1.05875       2.65333       1.42678      0.813597        100    
reco:energyrecnumu:EnergyReco                         0.000424942    0.0662968      1.43716      0.0077831     0.221711        100    
reco:energyrecnue:EnergyReco                          0.000193656   0.00489048     0.0582717    0.000982188    0.0109778       100    
reco:energyrecnc:EnergyReco                           0.00277287    0.00878313     0.065426     0.00448566     0.0119994       100    
reco:energyrecnumurange:EnergyReco                    0.000375529    0.0627936      1.43301     0.00444207     0.220961        100    
reco:energyrecnumumcs:EnergyReco                      0.00253765     0.0641934      1.43658      0.0060832     0.215792        100    
reco:opdec:Deconvolution                               0.0881108     0.442992       1.08814      0.429447      0.158399        100    
reco:ophitspe:OpHitFinderDeco                          0.319597       2.73275       5.59261       2.63835       1.2184         100    
reco:opflash:OpFlashFinder                            0.000245484   0.00204023    0.00694327    0.00183046    0.00111883       100    
reco:rns:RandomNumberSaver                            1.9988e-05    3.53411e-05   0.000490265   2.9796e-05    4.61088e-05      100    
reco:anglereconue:NuAngularReco                       0.000210988   0.00338689     0.0475858    0.000441853   0.00848975       100    
reco:anglereconumu:NuAngularReco                      9.2234e-05     0.0031989     0.0470199    0.000274563   0.00843863       100    
reco:anglereconuepfps:NuAngularReco                   0.000150203   0.00335343     0.0469125    0.000416045   0.00844386       100    
reco:anglereconumupfps:NuAngularReco                  0.000151496   0.00330279     0.0464678    0.000374051   0.00838162       100    
[art]:TriggerResults:TriggerResultInserter            1.1311e-05    1.84445e-05   0.00010615    1.62655e-05   1.1374e-05       100    
end_path:out1:RootOutput                               3.437e-06    4.77978e-06   3.0036e-05     4.519e-06    2.57956e-06      100    
end_path:out1:RootOutput(write)                        0.0223625     0.389678       1.73028      0.367247      0.343653        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21805.5 MB
  Peak resident set size usage (VmHWM): 2352.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2_reco_2024-11-06T_041823Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_366_20231208T004237Z_gen_g4_detsim_hitreco__20240510T030804Z_reco2_reco_data_2024-11-06T_041823Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 10:27:07 UTC       justIN version: 01.01.09