justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108513.74@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108513.74@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:15:41
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:33:07
From worker nodeHostnametds211.pic.es
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:35:29
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2.root
JobscriptExit code0
Real time57m (3420s)
CPU time57m (3446s = 100%)
Outputting started2024-11-22 23:32:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2.root
Finished2024-11-22 23:33:07
Saved logsjustin-logs:108513.74-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0 CET run: 6410210 subRun: 1 event: 62500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:32:20 CET run: 6410210 subRun: 1 event: 62500
1st wire C:0 T:6 P:2 W:520 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:32:20 CET run: 6410210 subRun: 1 event: 62500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:32:20 CET run: 6410210 subRun: 1 event: 62500
1st wire C:0 T:6 P:2 W:539 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:32:20 CET run: 6410210 subRun: 1 event: 62500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:32:26 CET run: 6410210 subRun: 1 event: 62500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:32:26 CET run: 6410210 subRun: 1 event: 62500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 183, 162, 169
minwire 0: 584
minwire 1: 1594
minwire 2: 149
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.988185, 0.00426274, 0.00755181, 
Output 1: 0.267376, 0.69018, 0.0411561, 0.00128756, 
Output 2: 0.994729, 0.00527146, 

456
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1535!
23-Nov-2024 00:32:29 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2_reco_data_2024-11-22T_223532Z.root"
23-Nov-2024 00:32:29 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/1b/06/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.67012       33.0291       861.157       8.66151       100.137        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00128228     0.0156071     0.0301914     0.0193458    0.00880074       100    
reco:linecluster:LineCluster                           0.0110818     0.595449       43.7991      0.0199982      4.45018        100    
reco:trajcluster:TrajCluster                          0.00118068      1.26982       48.0375      0.0109176      5.68848        100    
reco:pandora:StandardPandora                            1.14476       4.42163       226.565       1.28949       22.6944        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000145956   0.00831898     0.181086     0.00136751     0.0257042       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000191852    0.0116196     0.137407      0.0026523     0.0222076       100    
reco:pandoracalo:Calorimetry                          0.000112508    0.041297       1.89756     0.000902398    0.211188        100    
reco:pandorapid:Chi2ParticleID                        4.7666e-05    0.000177624   0.00157043    0.000137557   0.000188026      100    
reco:trkshowersplit:TrackShowerHits                   0.000132488    0.0321227      1.19693     0.000652306    0.143933        100    
reco:pmtrack:PMAlgTrackMaker                          0.00124624      3.30495       134.361      0.152409       14.7263        100    
reco:pmtrackcalo:Calorimetry                          8.7772e-05     0.0121149     0.266385     0.000858856    0.0419037       100    
reco:pmtrackpid:Chi2ParticleID                         3.83e-05     0.000288515   0.00246146    0.000154941   0.000469556      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000208999     2.67938       75.7007      0.311247       9.85661        100    
reco:pmtrajfitcalo:Calorimetry                        8.4619e-05     0.0426047      1.96046     0.00117708     0.216397        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.9177e-05    0.000201437   0.000978738   0.000157707   0.000174983      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00112741      2.91836       73.3193      0.219188       9.91612        100    
reco:pmtracktccalo:Calorimetry                         8.894e-05    0.00863107     0.213063     0.000827938    0.0274021       100    
reco:pmtracktcpid:Chi2ParticleID                      3.7621e-05    0.000275016    0.0024383    0.000156001   0.000394779      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000205025     1.74185       35.5549      0.263585       5.22195        100    
reco:pmtrajfittccalo:Calorimetry                      8.6122e-05     0.0232869     0.792982     0.00107684     0.0986715       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.7139e-05    0.000370531   0.00451836    0.000165006   0.00070884       100    
reco:blurredcluster:BlurredClustering                 0.00786331      1.02334       9.80261      0.481502       1.60209        100    
reco:emtrkmichelid:EmTrackMichelId                     0.273602       12.6204       197.869       3.25663       29.7179        100    
reco:emshower:EMShower                                0.000270546    0.0265225     0.330223     0.00465799     0.0533355       100    
reco:cvnmap:CVNMapper                                 2.8091e-05     0.0142625     0.0578235     0.0112177     0.0124891       100    
reco:cvneva:CVNEvaluator                              2.0666e-05     0.529966      0.861221      0.711039      0.331933        100    
reco:energyrecnumu:EnergyReco                         0.000294377    0.0298194      1.42816      0.0035676     0.147638        100    
reco:energyrecnue:EnergyReco                          0.000175607   0.00274882     0.0547432    0.000557953   0.00800619       100    
reco:energyrecnc:EnergyReco                           0.00214427    0.00478694     0.0560898    0.00258364    0.00807048       100    
reco:energyrecnumurange:EnergyReco                    0.000185268    0.0287134      1.48212     0.00229788     0.152675        100    
reco:energyrecnumumcs:EnergyReco                      0.00150745     0.0299925      1.46336     0.00328966      0.15078        100    
reco:opdec:Deconvolution                               0.0217178     0.188679      0.585435      0.184337      0.0936981       100    
reco:ophitspe:OpHitFinderDeco                          0.109496       1.15656       2.47896       1.16721      0.524018        100    
reco:opflash:OpFlashFinder                            0.000281221   0.00142516    0.00443355    0.00136732    0.000691066      100    
reco:rns:RandomNumberSaver                            2.0345e-05    3.53896e-05   0.000332709   3.2003e-05    3.21104e-05      100    
reco:anglereconue:NuAngularReco                       0.000160579   0.00212683     0.0479196    0.000352494   0.00694255       100    
reco:anglereconumu:NuAngularReco                      9.0954e-05    0.00197165     0.0470128    0.000255531   0.00687647       100    
reco:anglereconuepfps:NuAngularReco                   0.000146519   0.00211067     0.0472611    0.000351371   0.00688555       100    
reco:anglereconumupfps:NuAngularReco                  0.000129448   0.00205481     0.0471635    0.000331785   0.00688368       100    
[art]:TriggerResults:TriggerResultInserter            1.0936e-05    1.54417e-05   6.1468e-05    1.3897e-05    6.0659e-06       100    
end_path:out1:RootOutput                               2.746e-06    5.24141e-06   2.0004e-05     4.739e-06    2.38455e-06      100    
end_path:out1:RootOutput(write)                        0.0169172      0.2334        1.08807      0.233671      0.176832        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8632.98 MB
  Peak resident set size usage (VmHWM): 2537.24 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2_reco_2024-11-22T_223532Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_624_20231203T080202Z_gen_g4_detsim_hitreco__20240508T060400Z_reco2_reco_data_2024-11-22T_223532Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-27 03:29:25 UTC       justIN version: 01.01.09