Jobsub ID 301492.163@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 301492.163@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:11:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2024-11-23 00:02:08 |
| From worker node | Hostname | dune001-2995000.0-lcg2706.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:28:53 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 25m (1502s) |
| CPU time | 27m (1638s = 109%) |
| Outputting started | 2024-11-22 23:53:56 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2.root
|
| Finished | 2024-11-23 00:02:08 |
| Saved logs | justin-logs:301492.163-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
23:53:45 UTC run: 6410210 subRun: 1 event: 66300
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:53:45 UTC run: 6410210 subRun: 1 event: 66300
Cannot attach back to inner node of other track.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:53:45 UTC run: 6410210 subRun: 1 event: 66300
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:53:45 UTC run: 6410210 subRun: 1 event: 66300
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 22-Nov-2024 23:53:45 UTC run: 6410210 subRun: 1 event: 66300
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 22-Nov-2024 23:53:51 UTC run: 6410210 subRun: 1 event: 66300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 22-Nov-2024 23:53:51 UTC run: 6410210 subRun: 1 event: 66300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 22-Nov-2024 23:53:51 UTC run: 6410210 subRun: 1 event: 66300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 565, 521, 517
minwire 0: 728
minwire 1: 1206
minwire 2: 835
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.177316, 0.740244, 0.0824397,
Output 1: 0.182909, 0.418697, 0.254166, 0.144229,
Output 2: 0.0401916, 0.959808,
549
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1877!
22-Nov-2024 23:53:55 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2_reco_data_2024-11-22T_232914Z.root"
22-Nov-2024 23:53:55 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/88/f5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.610107 13.7263 94.1743 6.9461 17.3171 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00209268 0.0939195 0.316014 0.0764759 0.0610895 100
reco:linecluster:LineCluster 0.034318 0.275139 1.2221 0.22818 0.186446 100
reco:trajcluster:TrajCluster 0.00130903 0.243479 3.78827 0.0971925 0.554197 100
reco:pandora:StandardPandora 0.0521474 1.39306 4.71985 1.21604 0.635205 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000122694 0.00370419 0.0432942 0.001296 0.00660132 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000170768 0.00767817 0.11944 0.00236668 0.0157064 100
reco:pandoracalo:Calorimetry 9.968e-05 0.00626286 0.104038 0.000854208 0.0163373 100
reco:pandorapid:Chi2ParticleID 3.9329e-05 0.000165831 0.00254639 0.000119535 0.000253629 100
reco:trkshowersplit:TrackShowerHits 5.5874e-05 0.0086073 0.140213 0.000518287 0.0255841 100
reco:pmtrack:PMAlgTrackMaker 0.00127124 0.967569 11.3867 0.129289 2.17396 100
reco:pmtrackcalo:Calorimetry 6.0251e-05 0.00357492 0.0466594 0.000725995 0.00808115 100
reco:pmtrackpid:Chi2ParticleID 2.67e-05 0.000212271 0.00130178 0.00014265 0.00023947 100
reco:pmtrajfit:PMAlgTrajFitter 0.000187342 1.00119 9.4762 0.219325 1.92109 100
reco:pmtrajfitcalo:Calorimetry 5.8118e-05 0.00559901 0.0939611 0.00119616 0.0130068 100
reco:pmtrajfitpid:Chi2ParticleID 2.4427e-05 0.000170587 0.000757582 0.000140406 0.000113202 100
reco:pmtracktc:PMAlgTrackMaker 0.00116235 1.02365 15.156 0.140921 2.4937 100
reco:pmtracktccalo:Calorimetry 6.3937e-05 0.00294004 0.0285414 0.000812836 0.00573829 100
reco:pmtracktcpid:Chi2ParticleID 2.5809e-05 0.000199168 0.00110767 0.000143958 0.000194167 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000167272 0.736811 5.94824 0.161824 1.20819 100
reco:pmtrajfittccalo:Calorimetry 5.4372e-05 0.00416323 0.0618858 0.000993732 0.00924488 100
reco:pmtrajfittcpid:Chi2ParticleID 2.2714e-05 0.000228259 0.00110243 0.000154077 0.000208963 100
reco:blurredcluster:BlurredClustering 0.000271639 0.720039 4.85945 0.35211 0.86845 100
reco:emtrkmichelid:EmTrackMichelId 9.7036e-05 4.82072 38.2764 1.70442 7.30275 100
reco:emshower:EMShower 0.000157858 0.0152289 0.0952271 0.00437633 0.0202963 100
reco:cvnmap:CVNMapper 1.7356e-05 0.00786037 0.0321936 0.0046276 0.00843032 100
reco:cvneva:CVNEvaluator 1.6975e-05 0.487368 0.915442 0.569636 0.306554 100
reco:energyrecnumu:EnergyReco 0.000363048 0.0107243 0.131141 0.00573713 0.0200645 100
reco:energyrecnue:EnergyReco 0.000107081 0.000936281 0.00801306 0.000379797 0.00141256 100
reco:energyrecnc:EnergyReco 0.00130588 0.00266456 0.00936554 0.00236895 0.00141099 100
reco:energyrecnumurange:EnergyReco 0.000137938 0.00772483 0.123965 0.00226279 0.0201986 100
reco:energyrecnumumcs:EnergyReco 0.000839456 0.00887141 0.124582 0.00255153 0.0202768 100
reco:opdec:Deconvolution 0.045967 0.291113 2.64138 0.250743 0.264977 100
reco:ophitspe:OpHitFinderDeco 0.319505 1.37599 3.4571 1.2969 0.64002 100
reco:opflash:OpFlashFinder 0.000401485 0.00123458 0.00601597 0.00115822 0.000663661 100
reco:rns:RandomNumberSaver 1.7286e-05 3.33984e-05 0.000372642 2.8478e-05 3.52171e-05 100
reco:anglereconue:NuAngularReco 0.000171628 0.000908382 0.0107494 0.000352642 0.00170375 100
reco:anglereconumu:NuAngularReco 5.976e-05 0.000683958 0.0105683 0.00017568 0.00157119 100
reco:anglereconuepfps:NuAngularReco 0.000126681 0.000832977 0.0113745 0.000300788 0.0017807 100
reco:anglereconumupfps:NuAngularReco 9.1298e-05 0.000742899 0.0108033 0.000229956 0.00163084 100
[art]:TriggerResults:TriggerResultInserter 8.733e-06 1.54612e-05 0.000143777 1.28945e-05 1.36395e-05 100
end_path:out1:RootOutput 3.375e-06 4.64665e-06 3.0116e-05 4.1265e-06 3.16094e-06 100
end_path:out1:RootOutput(write) 0.0277564 0.192213 0.523351 0.204091 0.111282 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 39972.3 MB
Peak resident set size usage (VmHWM): 2159.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2_reco_2024-11-22T_232914Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_662_20231203T081938Z_gen_g4_detsim_hitreco__20240508T060411Z_reco2_reco_data_2024-11-22T_232914Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
