justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.113@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.113@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:12:58
From worker nodeHostnameb9p09p0373.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:10
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2.root
JobscriptExit code0
Real time44m (2649s)
CPU time34m (2085s = 78%)
Outputting started2024-11-23 00:08:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2.root
Finished2024-11-23 00:12:58
Saved logsjustin-logs:301491.113-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

BeginModule  23-Nov-2024 01:07:24 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:07:24 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:08:13 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:08:13 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:08:13 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:08:13 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:08:13 CET run: 6494524 subRun: 1 event: 42700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2937, 3313, 1791
minwire 0: 397
minwire 1: 2503
minwire 2: 50
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0163879, 0.930087, 0.0535248, 
Output 1: 0.144025, 0.542889, 0.224413, 0.0886731, 
Output 2: 0.0995752, 0.900425, 

775
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2808!
23-Nov-2024 01:08:19 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2_reco_data_2024-11-22T_233225Z.root"
23-Nov-2024 01:08:19 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/b1/a4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.580583       18.9782       122.069       10.3192       22.1955        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0169504     0.0424864     0.0907271     0.0417093     0.0129423       100    
reco:linecluster:LineCluster                           0.0964616     0.210774      0.836706      0.183016       0.10648        100    
reco:trajcluster:TrajCluster                           0.0478354     0.239081       4.6024       0.0596364     0.615823        100    
reco:pandora:StandardPandora                           0.0691041      1.81644       33.458        1.30784       3.29723        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000149672   0.00427519     0.0292095    0.00162843    0.00623191       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000229432    0.0122214     0.155222     0.00373784     0.0243156       100    
reco:pandoracalo:Calorimetry                          0.000127931   0.00892699     0.142316     0.00119261     0.0222627       100    
reco:pandorapid:Chi2ParticleID                        4.6501e-05    0.00018468    0.00185426    0.000148537   0.000190567      100    
reco:trkshowersplit:TrackShowerHits                   0.000100051   0.00961827     0.184375     0.000738043    0.0270221       100    
reco:pmtrack:PMAlgTrackMaker                          0.00109055      1.20688       14.7142      0.214183       2.44307        100    
reco:pmtrackcalo:Calorimetry                          6.6391e-05    0.00452147     0.0491636    0.00107168    0.00805455       100    
reco:pmtrackpid:Chi2ParticleID                         2.552e-05     0.0002495    0.00138853    0.000165962   0.000256478      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000231742     1.18545       18.664       0.307995       2.53431        100    
reco:pmtrajfitcalo:Calorimetry                        7.4131e-05    0.00864533     0.164816     0.00153107     0.0218749       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.996e-05    0.000190757   0.000568536   0.000163517   0.000119479      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00112521      1.45574       22.8775      0.285727       3.10983        100    
reco:pmtracktccalo:Calorimetry                        6.5791e-05    0.00364405     0.0292612    0.00109189    0.00549119       100    
reco:pmtracktcpid:Chi2ParticleID                       2.943e-05    0.000237719   0.00165707    0.000168157   0.000231591      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000182752     1.02452       8.16565       0.35027       1.61129        100    
reco:pmtrajfittccalo:Calorimetry                      7.2941e-05    0.00654715     0.089556     0.00142404     0.014486        100    
reco:pmtrajfittcpid:Chi2ParticleID                     3.066e-05    0.000304697   0.00246269    0.000184802   0.000359446      100    
reco:blurredcluster:BlurredClustering                 0.000121401     0.78924       3.85302      0.448001      0.843475        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000122351     7.47848       46.6658       3.27119       10.2092        100    
reco:emshower:EMShower                                0.000176672    0.0205485     0.198993     0.00354859     0.0322829       100    
reco:cvnmap:CVNMapper                                  2.077e-05     0.013743      0.0371008     0.0161398     0.0090572       100    
reco:cvneva:CVNEvaluator                               1.859e-05     0.696799       1.25096      0.901873      0.420755        100    
reco:energyrecnumu:EnergyReco                         0.000340283    0.0226914     0.282739     0.00458727     0.0496369       100    
reco:energyrecnue:EnergyReco                          0.000123071    0.0014472    0.00993166    0.00054792    0.00208498       100    
reco:energyrecnc:EnergyReco                           0.00144283    0.00403642     0.0142367    0.00324699    0.00240751       100    
reco:energyrecnumurange:EnergyReco                    0.000155552    0.0216167     0.278931     0.00284357     0.0522766       100    
reco:energyrecnumumcs:EnergyReco                      0.00109144     0.0230659     0.286702      0.004133      0.0530231       100    
reco:opdec:Deconvolution                               0.0657058     0.291436      0.490909      0.280098      0.0811761       100    
reco:ophitspe:OpHitFinderDeco                          0.143085       2.12495       3.90771       2.08586      0.842687        100    
reco:opflash:OpFlashFinder                            0.000136681   0.00147811    0.00538409     0.0014392    0.000696262      100    
reco:rns:RandomNumberSaver                             2.014e-05    4.1655e-05    0.000409194   3.80855e-05   3.75961e-05      100    
reco:anglereconue:NuAngularReco                       0.000173082   0.00103497    0.00726571    0.000407019   0.00146051       100    
reco:anglereconumu:NuAngularReco                       6.35e-05     0.000830414   0.00708537    0.000241438   0.00141568       100    
reco:anglereconuepfps:NuAngularReco                   0.000136721   0.00101538     0.0074265    0.000389274   0.00145496       100    
reco:anglereconumupfps:NuAngularReco                  0.000104911   0.000928724   0.00745068    0.000320748    0.0014536       100    
[art]:TriggerResults:TriggerResultInserter             8.89e-06     1.43511e-05    5.006e-05    1.3425e-05    5.10973e-06      100    
end_path:out1:RootOutput                               3.34e-06     7.14229e-06    2.193e-05     7.31e-06     1.90252e-06      100    
end_path:out1:RootOutput(write)                        0.0105154     0.241734      0.588985      0.268567      0.131795        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21411.9 MB
  Peak resident set size usage (VmHWM): 1935.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2_reco_2024-11-22T_233225Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6494524_426_20231208T070238Z_gen_g4_detsim_hitreco__20240510T054935Z_reco2_reco_data_2024-11-22T_233225Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:10:01 UTC       justIN version: 01.01.09