Jobsub ID 108550.144@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 108550.144@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:15:23 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2024-11-23 00:12:20 |
| From worker node | Hostname | dune001-2993530.0-lcg2601.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:33:19 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 33m (2018s) |
| CPU time | 50m (3050s = 151%) |
| Outputting started | 2024-11-23 00:06:57 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2.root
|
| Finished | 2024-11-23 00:12:20 |
| Saved logs | justin-logs:108550.144-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
event: 93200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:35 UTC run: 6406500 subRun: 1 event: 93200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:36 UTC run: 6406500 subRun: 1 event: 93200
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:36 UTC run: 6406500 subRun: 1 event: 93200
Track empty.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:36 UTC run: 6406500 subRun: 1 event: 93200
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:36 UTC run: 6406500 subRun: 1 event: 93200
Cannot attach back to inner node of other track.
%MSG
%MSG-e pma::Track3D: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:06:36 UTC run: 6406500 subRun: 1 event: 93200
Cannot attach back to inner node of other track.
%MSG
%MSG-e WireIDIntersectionCheck: EMShower:emshower@BeginModule 23-Nov-2024 00:06:51 UTC run: 6406500 subRun: 1 event: 93200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 376, 803, 506
minwire 0: 625
minwire 1: 2362
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.345766, 0.577382, 0.0768522,
Output 1: 0.0758563, 0.297459, 0.294813, 0.331871,
Output 2: 0.236573, 0.763427,
523
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1885!
23-Nov-2024 00:06:56 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2_reco_data_2024-11-22T_233324Z.root"
23-Nov-2024 00:06:56 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/42/18/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 2.38413 18.8662 117.299 10.8075 21.326 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00189585 0.0876672 0.30164 0.0656504 0.0542288 100
reco:linecluster:LineCluster 0.0618512 0.255975 0.789267 0.223228 0.144866 100
reco:trajcluster:TrajCluster 0.00704693 0.201692 3.14914 0.0877559 0.404516 100
reco:pandora:StandardPandora 0.941496 1.64833 4.06912 1.52996 0.50427 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000162543 0.00385587 0.0314079 0.00157233 0.00561617 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000235174 0.0134414 0.249556 0.00307681 0.0320201 100
reco:pandoracalo:Calorimetry 0.000123692 0.00660931 0.0900659 0.00120058 0.014198 100
reco:pandorapid:Chi2ParticleID 4.6741e-05 0.000201191 0.00305816 0.000153617 0.00030272 100
reco:trkshowersplit:TrackShowerHits 0.000138903 0.00673891 0.0958323 0.000782349 0.0153848 100
reco:pmtrack:PMAlgTrackMaker 0.00136352 1.02062 12.0539 0.256129 2.0774 100
reco:pmtrackcalo:Calorimetry 7.7042e-05 0.0039212 0.0505055 0.0010711 0.00770274 100
reco:pmtrackpid:Chi2ParticleID 3.7271e-05 0.000236878 0.0012864 0.000181783 0.000214914 100
reco:pmtrajfit:PMAlgTrajFitter 0.000235464 1.15382 14.9012 0.386969 2.07436 100
reco:pmtrajfitcalo:Calorimetry 8.6242e-05 0.00687371 0.124514 0.00162818 0.0153841 100
reco:pmtrajfitpid:Chi2ParticleID 3.767e-05 0.000209951 0.000882326 0.000189298 0.000132648 100
reco:pmtracktc:PMAlgTrackMaker 0.000934856 1.21718 12.0953 0.312925 2.29872 100
reco:pmtracktccalo:Calorimetry 6.8961e-05 0.00368516 0.0427567 0.00104761 0.00722474 100
reco:pmtracktcpid:Chi2ParticleID 2.7191e-05 0.000239408 0.000965597 0.000180538 0.000182623 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000189753 0.834357 9.30905 0.334262 1.36155 100
reco:pmtrajfittccalo:Calorimetry 6.8181e-05 0.0055251 0.0874742 0.00131009 0.0119557 100
reco:pmtrajfittcpid:Chi2ParticleID 3.199e-05 0.000305202 0.00132089 0.000213564 0.000268891 100
reco:blurredcluster:BlurredClustering 0.00504015 1.12362 5.75362 0.572288 1.31121 100
reco:emtrkmichelid:EmTrackMichelId 0.168132 7.57036 59.9124 3.00976 11.1649 100
reco:emshower:EMShower 0.000294945 0.0201792 0.176458 0.00316823 0.0339311 100
reco:cvnmap:CVNMapper 2.905e-05 0.0108771 0.0384903 0.00822428 0.00976296 100
reco:cvneva:CVNEvaluator 1.7541e-05 0.851461 1.38191 1.04217 0.543436 100
reco:energyrecnumu:EnergyReco 0.000368797 0.02151 0.371756 0.00473037 0.0601826 100
reco:energyrecnue:EnergyReco 0.000149662 0.00129111 0.00946155 0.000561095 0.0016258 100
reco:energyrecnc:EnergyReco 0.00182951 0.00378677 0.0132392 0.00340143 0.00170075 100
reco:energyrecnumurange:EnergyReco 0.000159233 0.0197773 0.366637 0.00324305 0.0613428 100
reco:energyrecnumumcs:EnergyReco 0.00114211 0.021389 0.369843 0.00377371 0.0601253 100
reco:opdec:Deconvolution 0.0873036 0.327363 0.714832 0.327454 0.132727 100
reco:ophitspe:OpHitFinderDeco 0.239651 2.1675 4.07456 2.07407 0.920386 100
reco:opflash:OpFlashFinder 0.000373507 0.00164046 0.00752981 0.0014603 0.000881472 100
reco:rns:RandomNumberSaver 2.275e-05 4.67553e-05 0.000510569 4.0265e-05 4.82041e-05 100
reco:anglereconue:NuAngularReco 0.000190024 0.00101708 0.00927309 0.000504794 0.00140601 100
reco:anglereconumu:NuAngularReco 9.3772e-05 0.000766846 0.008872 0.000288825 0.00133117 100
reco:anglereconuepfps:NuAngularReco 0.000174753 0.000959667 0.0089279 0.000432772 0.00140234 100
reco:anglereconumupfps:NuAngularReco 0.000148653 0.000851247 0.0091596 0.000365726 0.00136184 100
[art]:TriggerResults:TriggerResultInserter 9.65e-06 1.80755e-05 7.0942e-05 1.7555e-05 6.95213e-06 100
end_path:out1:RootOutput 3.7e-06 6.11333e-06 3.3611e-05 5.05e-06 3.53252e-06 100
end_path:out1:RootOutput(write) 0.0263829 0.247857 0.563751 0.273538 0.134675 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 39286.3 MB
Peak resident set size usage (VmHWM): 2120.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2_reco_2024-11-22T_233324Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_931_20231202T131246Z_gen_g4_detsim_hitreco__20240507T222524Z_reco2_reco_data_2024-11-22T_233324Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
