Jobsub ID 108593.158@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 108593.158@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4213 |
| Stage ID | 1 |
| User name | ismerio@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-22 23:25:00 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2024-11-23 00:17:33 |
| From worker node | Hostname | dune001-3355377.0-lcg2722.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | finished |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-22 23:37:32 |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 30m (1839s) |
| CPU time | 33m (1983s = 107%) |
| Outputting started | 2024-11-23 00:08:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2.root
|
| Finished | 2024-11-23 00:17:25 |
| Saved logs | justin-logs:108593.158-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
max tdcs due to vertex determination failure: 0, 199
Classifier summary:
Output 0: 0.0365662, 0.932111, 0.0313232,
Output 1: 0.101478, 0.259551, 0.255866, 0.383105,
Output 2: 0.112237, 0.887763,
770
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2785!
Begin processing the 100th record. run: 50574864 subRun: 1 event: 44300 at 23-Nov-2024 00:08:07 UTC
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 23-Nov-2024 00:08:08 UTC run: 50574864 subRun: 1 event: 44300
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfit@BeginModule 23-Nov-2024 00:08:08 UTC run: 50574864 subRun: 1 event: 44300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfit@BeginModule 23-Nov-2024 00:08:08 UTC run: 50574864 subRun: 1 event: 44300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:08:08 UTC run: 50574864 subRun: 1 event: 44300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 00:08:08 UTC run: 50574864 subRun: 1 event: 44300
Comparing two wires in the same plane: return failure
%MSG
300
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 645!
23-Nov-2024 00:08:10 UTC Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2_reco_data_2024-11-22T_233735Z.root"
23-Nov-2024 00:08:10 UTC Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/16/a5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.51062 17.218 431.969 7.83676 46.4346 100
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00122129 0.104333 0.35807 0.0781069 0.0783313 100
reco:linecluster:LineCluster 0.0265555 0.302697 2.63128 0.231882 0.368854 100
reco:trajcluster:TrajCluster 0.000779449 0.452722 20.1242 0.0959424 2.15156 100
reco:pandora:StandardPandora 0.144886 1.85893 41.7173 1.12153 4.53698 100
reco:pandoraTrack:LArPandoraTrackCreation 0.000114964 0.0045538 0.156082 0.00121718 0.0160769 100
reco:pandoraShower:LArPandoraModularShowerCreation 0.000152271 0.0116133 0.280683 0.00213525 0.0399249 100
reco:pandoracalo:Calorimetry 8.5709e-05 0.0101494 0.445112 0.000774426 0.0478889 100
reco:pandorapid:Chi2ParticleID 3.305e-05 0.000135459 0.000950348 0.000113487 0.000116761 100
reco:trkshowersplit:TrackShowerHits 5.7387e-05 0.0130281 0.616691 0.000584098 0.0663719 100
reco:pmtrack:PMAlgTrackMaker 0.000838709 1.22742 44.3016 0.154074 4.93247 100
reco:pmtrackcalo:Calorimetry 4.6941e-05 0.00776149 0.449241 0.000679623 0.0453763 100
reco:pmtrackpid:Chi2ParticleID 1.9349e-05 0.00019277 0.00234965 0.000124112 0.000287739 100
reco:pmtrajfit:PMAlgTrajFitter 0.000131599 0.99696 21.6739 0.210247 2.71133 100
reco:pmtrajfitcalo:Calorimetry 4.0301e-05 0.0104357 0.443926 0.00112922 0.0483783 100
reco:pmtrajfitpid:Chi2ParticleID 1.7947e-05 0.000147697 0.000819289 0.000126612 0.000112672 100
reco:pmtracktc:PMAlgTrackMaker 0.000729753 1.66547 67.4515 0.142566 7.42582 100
reco:pmtracktccalo:Calorimetry 4.8133e-05 0.00849161 0.553979 0.00086627 0.0552606 100
reco:pmtracktcpid:Chi2ParticleID 1.7958e-05 0.000200527 0.00285604 0.000136897 0.000316484 100
reco:pmtrajfittc:PMAlgTrajFitter 0.000117728 1.16385 45.9223 0.232474 4.75754 100
reco:pmtrajfittccalo:Calorimetry 4.0321e-05 0.0100809 0.577299 0.000988806 0.0586276 100
reco:pmtrajfittcpid:Chi2ParticleID 1.7436e-05 0.000236668 0.00283033 0.000152295 0.000351305 100
reco:blurredcluster:BlurredClustering 0.000149817 0.755013 6.71836 0.386916 1.02303 100
reco:emtrkmichelid:EmTrackMichelId 9.9231e-05 6.04519 145.935 2.00793 16.1126 100
reco:emshower:EMShower 0.000150417 0.0196158 0.304441 0.00317388 0.0377884 100
reco:cvnmap:CVNMapper 2.0021e-05 0.00539787 0.0352635 0.00387032 0.00628393 100
reco:cvneva:CVNEvaluator 1.5563e-05 0.469171 0.968728 0.561185 0.302144 100
reco:energyrecnumu:EnergyReco 0.000257679 0.113815 9.44361 0.00576931 0.939534 100
reco:energyrecnue:EnergyReco 9.0847e-05 0.00144461 0.0543105 0.000375693 0.00555328 100
reco:energyrecnc:EnergyReco 0.00129845 0.00299876 0.0568032 0.00210566 0.00567222 100
reco:energyrecnumurange:EnergyReco 0.000126812 0.098211 8.16006 0.00161363 0.812742 100
reco:energyrecnumumcs:EnergyReco 0.000565386 0.0966428 7.93634 0.00252296 0.790308 100
reco:opdec:Deconvolution 0.0280145 0.288633 0.813181 0.258095 0.155378 100
reco:ophitspe:OpHitFinderDeco 0.11457 1.29163 3.29197 1.27054 0.579402 100
reco:opflash:OpFlashFinder 0.000166652 0.00112605 0.00275979 0.00105423 0.000467769 100
reco:rns:RandomNumberSaver 1.6685e-05 2.64151e-05 0.000219282 2.23685e-05 2.08042e-05 100
reco:anglereconue:NuAngularReco 0.000135896 0.00143456 0.0767902 0.000331021 0.00765694 100
reco:anglereconumu:NuAngularReco 4.6601e-05 0.000978411 0.0490651 0.000173181 0.00494948 100
reco:anglereconuepfps:NuAngularReco 9.241e-05 0.0010978 0.0497238 0.00029101 0.0050044 100
reco:anglereconumupfps:NuAngularReco 6.1663e-05 0.00101541 0.0487196 0.000220053 0.0049156 100
[art]:TriggerResults:TriggerResultInserter 7.972e-06 1.12112e-05 3.315e-05 1.0431e-05 3.28021e-06 100
end_path:out1:RootOutput 3.024e-06 4.49175e-06 1.6275e-05 3.976e-06 1.62273e-06 100
end_path:out1:RootOutput(write) 0.0140805 0.17348 1.11613 0.167584 0.130942 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 40358.8 MB
Peak resident set size usage (VmHWM): 2550.98 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2_reco_2024-11-22T_233735Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_442_20231203T155830Z_gen_g4_detsim_hitreco__20240508T033358Z_reco2_reco_data_2024-11-22T_233735Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
