Jobsub ID 301492.46@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 301492.46@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:11:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2024-11-23 00:26:48 |
| From worker node | Hostname | dune001-2993339.0-lcg2700.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:26:09 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3142s) |
| CPU time | 50m (3033s = 96%) |
| Outputting started | 2024-11-23 00:18:31 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2.root
|
| Finished | 2024-11-23 00:26:48 |
| Saved logs | justin-logs:301492.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
1st wire C:0 T:0 P:2 W:991 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:18:25 UTC run: 6406796 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 97, 121, 81
minwire 0: 777
minwire 1: 3011
minwire 2: 60
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.105371, 0.892462, 0.00216715,
Output 1: 0.848994, 0.149242, 0.0015793, 0.000185016,
Output 2: 0.997118, 0.00288186,
342
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 903!
23-Nov-2024 00:18:30 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2_reco_data_2024-11-22T_232613Z.root"
23-Nov-2024 00:18:30 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/b5/fb/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 2.64542 29.9661 819.756 9.78852 93.0407 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00133672 0.115043 0.47233 0.100453 0.0693279 100
reco:linecluster:LineCluster 0.0526628 0.758526 40.1349 0.240506 4.00631 100
reco:trajcluster:TrajCluster 0.00742597 1.59482 97.7381 0.102131 10.2181 100
reco:pandora:StandardPandora 1.1115 2.79634 89.1875 1.38426 9.20584 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000176094 0.00737682 0.176411 0.00199873 0.0232541 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000225147 0.0108867 0.21378 0.00316546 0.0264669 100
reco:pandoracalo:Calorimetry 0.00011324 0.0267892 1.16745 0.00129555 0.133988 100
reco:pandorapid:Chi2ParticleID 4.1422e-05 0.000185214 0.000965649 0.000145488 0.000150928 100
reco:trkshowersplit:TrackShowerHits 0.000143576 0.0433891 2.49835 0.00099987 0.265431 100
reco:pmtrack:PMAlgTrackMaker 0.00139509 2.9011 101.857 0.18028 12.169 100
reco:pmtrackcalo:Calorimetry 7.7657e-05 0.0122636 0.355461 0.00116455 0.0512912 100
reco:pmtrackpid:Chi2ParticleID 3.0696e-05 0.00033849 0.0036794 0.000181628 0.000579196 100
reco:pmtrajfit:PMAlgTrajFitter 0.000268443 3.24035 149.825 0.322193 15.8264 100
reco:pmtrajfitcalo:Calorimetry 7.5734e-05 0.0258105 1.03169 0.0018147 0.123513 100
reco:pmtrajfitpid:Chi2ParticleID 3.363e-05 0.000226824 0.00113265 0.000184743 0.000190349 100
reco:pmtracktc:PMAlgTrackMaker 0.00121883 3.59501 124.771 0.217333 15.1087 100
reco:pmtracktccalo:Calorimetry 7.7396e-05 0.00763149 0.233436 0.00111505 0.030233 100
reco:pmtracktcpid:Chi2ParticleID 2.9884e-05 0.000296193 0.00327924 0.000188793 0.000463508 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000248923 1.76308 57.1792 0.280441 6.46528 100
reco:pmtrajfittccalo:Calorimetry 7.6575e-05 0.0162337 0.703398 0.00130307 0.0773067 100
reco:pmtrajfittcpid:Chi2ParticleID 3.0586e-05 0.000388191 0.00571875 0.00019013 0.000686603 100
reco:blurredcluster:BlurredClustering 0.0170663 0.927574 9.05331 0.520332 1.45963 100
reco:emtrkmichelid:EmTrackMichelId 0.245604 8.95721 136.241 2.69174 19.9635 100
reco:emshower:EMShower 0.000357887 0.0323656 0.567468 0.00572856 0.0723832 100
reco:cvnmap:CVNMapper 2.9244e-05 0.0125784 0.0512253 0.0115982 0.0109396 100
reco:cvneva:CVNEvaluator 2.0491e-05 0.665479 1.07446 0.849072 0.386822 100
reco:energyrecnumu:EnergyReco 0.000421402 0.0273317 0.770771 0.0086441 0.0966208 100
reco:energyrecnue:EnergyReco 0.000158207 0.00195804 0.0624246 0.000509318 0.00678289 100
reco:energyrecnc:EnergyReco 0.00152779 0.00418759 0.065864 0.00285237 0.00693748 100
reco:energyrecnumurange:EnergyReco 0.000209805 0.0211409 0.630977 0.00254882 0.0856308 100
reco:energyrecnumumcs:EnergyReco 0.00154119 0.0229128 0.639549 0.00312024 0.0858061 100
reco:opdec:Deconvolution 0.0876667 0.307737 0.778749 0.271483 0.142106 100
reco:ophitspe:OpHitFinderDeco 0.483331 1.81115 3.40989 1.76113 0.679502 100
reco:opflash:OpFlashFinder 0.000470636 0.00161914 0.00472326 0.00152756 0.0006399 100
reco:rns:RandomNumberSaver 2.01e-05 4.29166e-05 0.000417427 3.7371e-05 3.96864e-05 100
reco:anglereconue:NuAngularReco 0.000189514 0.00172911 0.0391397 0.000480992 0.00539978 100
reco:anglereconumu:NuAngularReco 7.5393e-05 0.001453 0.039875 0.000255783 0.00541237 100
reco:anglereconuepfps:NuAngularReco 0.000126429 0.00163579 0.0401321 0.000426144 0.00540729 100
reco:anglereconumupfps:NuAngularReco 0.000108423 0.00152848 0.0398924 0.000297912 0.00548504 100
[art]:TriggerResults:TriggerResultInserter 9.404e-06 1.72633e-05 6.9254e-05 1.6865e-05 6.09388e-06 100
end_path:out1:RootOutput 3.525e-06 4.49462e-06 2.5638e-05 4.251e-06 2.1619e-06 100
end_path:out1:RootOutput(write) 0.0362636 0.247904 1.08504 0.245995 0.159261 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40467.6 MB
Peak resident set size usage (VmHWM): 2649.71 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2_reco_2024-11-22T_232613Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406796_35_20231202T131828Z_gen_g4_detsim_hitreco__20240507T222655Z_reco2_reco_data_2024-11-22T_232613Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
