Jobsub ID 87045.67@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 87045.67@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3836 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-10-26 01:48:05 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce2 |
| Last heartbeat | 2024-10-26 07:13:17 |
| From worker node | Hostname | mahagon21.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-26 02:48:14 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15874s) |
| CPU time | 4h (15770s = 99%) |
| Outputting started | 2024-10-26 07:12:48 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2.root
|
| Finished | 2024-10-26 07:13:17 |
| Saved logs | justin-logs:87045.67-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
Cannot attach back to inner node of other track.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 26-Oct-2024 09:12:13 CEST run: 6209163 subRun: 1 event: 68400
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 817, 813, 490
minwire 0: 448
minwire 1: 1958
minwire 2: 121
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.109808, 0.885453, 0.00473888,
Output 1: 0.714387, 0.241046, 0.0374387, 0.00712777,
Output 2: 0.800112, 0.199888,
566
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1897!
26-Oct-2024 09:12:41 CEST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2_reco_data_2024-10-26T_024820Z.root"
26-Oct-2024 09:12:41 CEST Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/c4/ab/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.190138 78.3658 2824.27 14.8354 297.233 200
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00221394 0.0235118 0.288464 0.0213229 0.0209808 200
reco:linecluster:LineCluster 0.0033004 1.25241 63.8907 0.0491357 7.24149 200
reco:trajcluster:TrajCluster 0.00171298 3.71504 216.356 0.0260341 19.577 200
reco:pandora:StandardPandora 0.0216157 16.9942 1577.33 2.50363 127.728 200
reco:pandoraTrack:LArPandoraTrackCreation 0.00018017 0.018507 0.678826 0.00370285 0.0629728 200
reco:pandoraShower:LArPandoraModularShowerCreation 0.000247838 0.032922 1.06481 0.0063402 0.0918317 200
reco:pandoracalo:Calorimetry 0.000129063 0.0677513 2.81077 0.00231869 0.313691 200
reco:pandorapid:Chi2ParticleID 5.5054e-05 0.000306813 0.00281014 0.000241075 0.000312822 200
reco:trkshowersplit:TrackShowerHits 0.000166564 0.076793 3.34816 0.00156882 0.349847 200
reco:pmtrack:PMAlgTrackMaker 0.00185666 8.06708 280.559 0.488513 30.8853 200
reco:pmtrackcalo:Calorimetry 9.8896e-05 0.040412 2.41455 0.00176448 0.209202 200
reco:pmtrackpid:Chi2ParticleID 4.3572e-05 0.000590962 0.00951447 0.000232309 0.00115019 200
reco:pmtrajfit:PMAlgTrajFitter 0.000316517 7.52293 487.892 0.637408 38.9226 200
reco:pmtrajfitcalo:Calorimetry 9.2394e-05 0.0650704 2.77175 0.00285658 0.297379 200
reco:pmtrajfitpid:Chi2ParticleID 4.0446e-05 0.000343131 0.00261741 0.00023894 0.00035253 200
reco:pmtracktc:PMAlgTrackMaker 0.00145524 8.61424 329.521 0.464055 32.5775 200
reco:pmtracktccalo:Calorimetry 9.1212e-05 0.0241722 1.35583 0.00190055 0.108227 200
reco:pmtracktcpid:Chi2ParticleID 4.238e-05 0.000527168 0.0112652 0.000249345 0.00101606 200
reco:pmtrajfittc:PMAlgTrajFitter 0.000246295 4.19105 99.7279 0.603122 12.8287 200
reco:pmtrajfittccalo:Calorimetry 9.3025e-05 0.0499323 2.17081 0.00227018 0.210626 200
reco:pmtrajfittcpid:Chi2ParticleID 4.0436e-05 0.000707378 0.0074364 0.000263191 0.00120819 200
reco:blurredcluster:BlurredClustering 0.000141086 1.83577 18.6701 0.75072 2.70939 200
reco:emtrkmichelid:EmTrackMichelId 0.000186051 21.3718 410.109 4.87128 48.3142 200
reco:emshower:EMShower 0.000272214 0.0593137 0.941601 0.0112353 0.116969 200
reco:cvnmap:CVNMapper 2.8634e-05 0.0229321 0.0921983 0.0251071 0.0173475 200
reco:cvneva:CVNEvaluator 2.0499e-05 1.08343 2.44534 1.31755 0.620339 200
reco:energyrecnumu:EnergyReco 0.00039768 0.0941141 3.28315 0.0112133 0.354337 200
reco:energyrecnue:EnergyReco 0.000197392 0.00563522 0.161057 0.00118745 0.0170567 200
reco:energyrecnc:EnergyReco 0.00269919 0.00947857 0.215007 0.00484058 0.0198405 200
reco:energyrecnumurange:EnergyReco 0.000246174 0.0875767 3.19774 0.00439308 0.348706 200
reco:energyrecnumumcs:EnergyReco 0.00167784 0.08784 3.07143 0.00617473 0.336312 200
reco:opdec:Deconvolution 0.00868659 0.261527 0.521074 0.26297 0.10263 200
reco:ophitspe:OpHitFinderDeco 0.00866256 2.21337 5.03495 2.09246 1.00858 200
reco:opflash:OpFlashFinder 0.000300637 0.00255263 0.00938065 0.00238746 0.00135824 200
reco:rns:RandomNumberSaver 2.0268e-05 6.21569e-05 0.0005831 5.6953e-05 4.56644e-05 200
reco:anglereconue:NuAngularReco 0.000197262 0.00485439 0.183877 0.000939592 0.0170509 200
reco:anglereconumu:NuAngularReco 0.000105218 0.00435144 0.180896 0.000430191 0.0167841 200
reco:anglereconuepfps:NuAngularReco 0.000167886 0.00464253 0.183778 0.000663541 0.0170473 200
reco:anglereconumupfps:NuAngularReco 0.000157958 0.0044839 0.17569 0.000534768 0.0165184 200
[art]:TriggerResults:TriggerResultInserter 1.099e-05 2.26189e-05 9.8916e-05 2.0739e-05 9.84006e-06 200
end_path:out1:RootOutput 2.996e-06 7.49279e-06 3.1078e-05 7.5295e-06 3.02518e-06 200
end_path:out1:RootOutput(write) 0.0187028 0.450352 3.99351 0.385375 0.434914 200
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 13430.4 MB
Peak resident set size usage (VmHWM): 2730.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2_reco_2024-10-26T_024820Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209163_341_20231123T012326Z_gen_g4_detsim_hitreco__20240507T174226Z_reco2_reco_data_2024-10-26T_024820Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
