justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91657.102@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91657.102@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-06 02:00:16
SiteCZ_FZU
EntryNova_CZ_FZU_osgce1
Last heartbeat2024-11-06 09:21:02
From worker nodeHostnamemff-magic12.farm.particle.cz
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 02:02:39
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2.root
JobscriptExit code0
Real time7h (26264s)
CPU time7h (25819s = 98%)
Outputting started2024-11-06 09:20:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03932/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2.root
Finished2024-11-06 09:21:02
Saved logsjustin-logs:91657.102-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 10:19:51 CET run: 6210996 subRun: 1 event: 9800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2293, 3836, 1900
minwire 0: 1798
minwire 1: 303
minwire 2: 1672
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00763188, 0.985106, 0.00726202, 
Output 1: 0.224991, 0.609623, 0.143835, 0.0215509, 
Output 2: 0.100064, 0.899936, 

809
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3117!
06-Nov-2024 10:20:12 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2_reco_data_2024-11-06T_020244Z.root"
06-Nov-2024 10:20:12 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/67/56/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.16884       130.001       8100.18       18.1734       625.481        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00258147     0.0217232     0.157149      0.0172509     0.0183484       200    
reco:linecluster:LineCluster                          0.00284666      2.13987       152.845      0.0592047      12.3913        200    
reco:trajcluster:TrajCluster                          0.00218323      5.54821       265.166      0.0260763      26.8324        200    
reco:pandora:StandardPandora                           0.0274598      47.0037       7280.32       2.49433       514.399        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.00027586     0.0272994     0.912726     0.00375442     0.0934854       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000380874    0.0269662     0.444388     0.00671055     0.051262        200    
reco:pandoracalo:Calorimetry                          0.000198001    0.126619       5.52052     0.00249898       0.535         200    
reco:pandorapid:Chi2ParticleID                        7.9624e-05    0.000381554   0.00318614    0.000279529   0.000385768      200    
reco:trkshowersplit:TrackShowerHits                   0.000132067    0.108386       3.3721      0.00164305     0.409257        200    
reco:pmtrack:PMAlgTrackMaker                          0.00263191      11.0087       362.833      0.382351       40.848         200    
reco:pmtrackcalo:Calorimetry                          0.000192838     0.06481       3.0806      0.00198682     0.299212        200    
reco:pmtrackpid:Chi2ParticleID                         7.601e-05    0.000801808     0.01141     0.000302732   0.00158565       200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000472386     7.8175        183.321      0.575174       27.0055        200    
reco:pmtrajfitcalo:Calorimetry                        0.000178328    0.128888       5.43692     0.00288254     0.538109        200    
reco:pmtrajfitpid:Chi2ParticleID                      7.2203e-05    0.000423476   0.00258099    0.000304985   0.000397074      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00242217      12.7627       445.648      0.451461       47.319         200    
reco:pmtracktccalo:Calorimetry                        0.000204086    0.0318326      1.10098     0.00203856     0.118889        200    
reco:pmtracktcpid:Chi2ParticleID                      7.9052e-05    0.00104277     0.0552434    0.000301903   0.00428791       200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000435735     5.39719       126.934      0.552902       15.9343        200    
reco:pmtrajfittccalo:Calorimetry                      0.000158424    0.100939       4.64944     0.00255654     0.435563        200    
reco:pmtrajfittcpid:Chi2ParticleID                     7.079e-05    0.000958077    0.0124352    0.00031974     0.001868        200    
reco:blurredcluster:BlurredClustering                 0.00015661      1.95783       16.9849      0.893389       2.95881        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000244211     30.3913       509.993       6.47628       69.6301        200    
reco:emshower:EMShower                                0.000382806    0.0826456      1.30702      0.0146235      0.16684        200    
reco:cvnmap:CVNMapper                                 4.2269e-05     0.0279058     0.106338      0.0296705     0.0219499       200    
reco:cvneva:CVNEvaluator                              2.6859e-05      1.37613       7.29167       1.74873      0.951128        200    
reco:energyrecnumu:EnergyReco                         0.000453653    0.154069       4.97016     0.00981995     0.517192        200    
reco:energyrecnue:EnergyReco                          0.000239717   0.00765337     0.246328      0.001174      0.025294        200    
reco:energyrecnc:EnergyReco                           0.00280625     0.010995      0.249456     0.00453075     0.0260192       200    
reco:energyrecnumurange:EnergyReco                    0.000305243    0.146456       4.73279     0.00429199     0.515639        200    
reco:energyrecnumumcs:EnergyReco                      0.00237462     0.153943       4.76804     0.00609674     0.536905        200    
reco:opdec:Deconvolution                               0.0055476       0.308       0.727216      0.302333      0.130544        200    
reco:ophitspe:OpHitFinderDeco                          0.0292597      2.53472       5.5356        2.48858       1.10943        200    
reco:opflash:OpFlashFinder                            0.00026663    0.00297789     0.0436489    0.00261865    0.00314368       200    
reco:rns:RandomNumberSaver                            2.5609e-05    0.000135909    0.0140823    6.19475e-05   0.000989455      200    
reco:anglereconue:NuAngularReco                       0.000220259   0.00625208     0.239328     0.000826572    0.0221609       200    
reco:anglereconumu:NuAngularReco                      0.000121598   0.00592384     0.231721     0.000479743    0.0224309       200    
reco:anglereconuepfps:NuAngularReco                   0.000183304   0.00597986     0.227556     0.000729314    0.0211223       200    
reco:anglereconumupfps:NuAngularReco                  0.000171691   0.00604481     0.219127     0.000609618    0.0223769       200    
[art]:TriggerResults:TriggerResultInserter            1.5238e-05    2.7389e-05    0.000113827   2.6568e-05    8.81825e-06      200    
end_path:out1:RootOutput                               3.019e-06    8.65128e-06   3.7555e-05     8.316e-06    4.66311e-06      200    
end_path:out1:RootOutput(write)                        0.0190464     0.499016       3.25796      0.453594      0.454157        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9840.44 MB
  Peak resident set size usage (VmHWM): 2628.87 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2_reco_2024-11-06T_020244Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_48_20231120T135553Z_gen_g4_detsim_hitreco__20240507T181302Z_reco2_reco_data_2024-11-06T_020244Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 10:50:17 UTC       justIN version: 01.01.09