Jobsub ID 108508.82@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 108508.82@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 21:57:10 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce13-multicore |
| Last heartbeat | 2024-11-22 23:11:40 |
| From worker node | Hostname | tds205.pic.es |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 22:18:25 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3015s) |
| CPU time | 41m (2469s = 81%) |
| Outputting started | 2024-11-22 23:08:41 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2.root
|
| Finished | 2024-11-22 23:11:40 |
| Saved logs | justin-logs:108508.82-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:07:52 CET run: 50515284 subRun: 1 event: 25700
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:07:52 CET run: 50515284 subRun: 1 event: 25700
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:07:52 CET run: 50515284 subRun: 1 event: 25700
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:07:52 CET run: 50515284 subRun: 1 event: 25700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:08:31 CET run: 50515284 subRun: 1 event: 25700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:08:32 CET run: 50515284 subRun: 1 event: 25700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:08:32 CET run: 50515284 subRun: 1 event: 25700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1277, 2022, 1344
minwire 0: 2124
minwire 1: 451
minwire 2: 2027
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.0251955, 0.918768, 0.0560367,
Output 1: 0.145461, 0.581728, 0.224519, 0.048292,
Output 2: 0.10098, 0.89902,
746
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2801!
23-Nov-2024 00:08:40 CET Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2_reco_data_2024-11-22T_221829Z.root"
23-Nov-2024 00:08:40 CET Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3f/76/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 1.72092 24.6986 243.445 15.4518 31.0171 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.046961 0.0823323 0.132476 0.0778424 0.0244183 100
reco:linecluster:LineCluster 0.417914 0.504492 3.61091 0.449165 0.330701 100
reco:trajcluster:TrajCluster 0.134751 0.660947 28.4146 0.149821 2.92145 100
reco:pandora:StandardPandora 0.15769 2.5696 10.4145 2.36123 1.05148 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000153242 0.00578036 0.0466978 0.0021951 0.00884697 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000198745 0.0168752 0.41503 0.00477205 0.0451947 100
reco:pandoracalo:Calorimetry 0.000120468 0.0111125 0.27734 0.00164452 0.0327415 100
reco:pandorapid:Chi2ParticleID 4.4533e-05 0.000228921 0.00159319 0.000192646 0.000181381 100
reco:trkshowersplit:TrackShowerHits 0.000123953 0.0102564 0.245198 0.000919953 0.0320913 100
reco:pmtrack:PMAlgTrackMaker 0.00206994 1.56438 27.9521 0.304609 3.6849 100
reco:pmtrackcalo:Calorimetry 0.000147686 0.00570407 0.110234 0.00142755 0.0136125 100
reco:pmtrackpid:Chi2ParticleID 6.12e-05 0.000299917 0.00164633 0.00021549 0.000285379 100
reco:pmtrajfit:PMAlgTrajFitter 0.000266499 1.50186 15.3059 0.432382 2.63508 100
reco:pmtrajfitcalo:Calorimetry 9.1318e-05 0.0106618 0.325289 0.00181081 0.0348715 100
reco:pmtrajfitpid:Chi2ParticleID 3.8303e-05 0.000241447 0.000841406 0.000197943 0.000150354 100
reco:pmtracktc:PMAlgTrackMaker 0.00201928 1.72568 40.6183 0.36289 4.87887 100
reco:pmtracktccalo:Calorimetry 0.000136187 0.00454417 0.0808314 0.00131766 0.00976869 100
reco:pmtracktcpid:Chi2ParticleID 5.6098e-05 0.000272666 0.00105623 0.000200589 0.000206859 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000364466 1.15182 13.5704 0.451399 1.83871 100
reco:pmtrajfittccalo:Calorimetry 0.000128571 0.0090986 0.310028 0.00156235 0.0327015 100
reco:pmtrajfittcpid:Chi2ParticleID 5.2754e-05 0.000349533 0.00342865 0.000214919 0.000427306 100
reco:blurredcluster:BlurredClustering 0.000123354 1.18037 6.90181 0.690029 1.32075 100
reco:emtrkmichelid:EmTrackMichelId 0.0404521 9.016 90.0023 4.48036 13.2586 100
reco:emshower:EMShower 0.000277579 0.0321105 0.210119 0.00454783 0.0508134 100
reco:cvnmap:CVNMapper 2.9775e-05 0.013198 0.0389007 0.0123389 0.00873759 100
reco:cvneva:CVNEvaluator 2.0056e-05 1.01188 14.0793 0.875616 1.40101 100
reco:energyrecnumu:EnergyReco 0.000612825 0.0259315 0.71196 0.0057416 0.0788812 100
reco:energyrecnue:EnergyReco 0.000210637 0.00157908 0.0131536 0.000711577 0.00210454 100
reco:energyrecnc:EnergyReco 0.00231519 0.00406285 0.0169094 0.00343451 0.00215396 100
reco:energyrecnumurange:EnergyReco 0.000449762 0.0243581 0.716903 0.00339114 0.0816636 100
reco:energyrecnumumcs:EnergyReco 0.00143864 0.0268681 0.710936 0.00512719 0.0819493 100
reco:opdec:Deconvolution 0.193957 0.564065 1.06459 0.573623 0.126066 100
reco:ophitspe:OpHitFinderDeco 0.651001 2.58956 4.3711 2.6949 0.828818 100
reco:opflash:OpFlashFinder 0.000419476 0.0019933 0.00660745 0.00189744 0.000903147 100
reco:rns:RandomNumberSaver 2.1262e-05 4.33517e-05 0.000446443 3.88335e-05 4.17689e-05 100
reco:anglereconue:NuAngularReco 0.000181993 0.00127236 0.0137061 0.000500086 0.00204944 100
reco:anglereconumu:NuAngularReco 9.787e-05 0.00110796 0.0143278 0.000378657 0.00206456 100
reco:anglereconuepfps:NuAngularReco 0.000159451 0.00128828 0.0144272 0.000528294 0.00211895 100
reco:anglereconumupfps:NuAngularReco 0.000139714 0.00126817 0.0161205 0.00049352 0.00221258 100
[art]:TriggerResults:TriggerResultInserter 1.184e-05 1.95654e-05 7.7033e-05 1.91565e-05 6.99704e-06 100
end_path:out1:RootOutput 2.885e-06 6.56034e-06 3.6333e-05 5.808e-06 3.82996e-06 100
end_path:out1:RootOutput(write) 0.028325 0.362712 1.11989 0.379108 0.19158 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8154.72 MB
Peak resident set size usage (VmHWM): 2063.32 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2_reco_2024-11-22T_221829Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_256_20231201T115105Z_gen_g4_detsim_hitreco__20240507T185405Z_reco2_reco_data_2024-11-22T_221829Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
