justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254417.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID254417.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3191
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-11 19:30:17
SiteCZ_FZU
EntryNova_CZ_FZU_osgce1
Last heartbeat2024-09-11 19:39:30
From worker nodeHostnamemilan02.farm.particle.cz
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-11 19:30:40
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6407968_580_20231203T051836Z_gen_g4_detsim_hitreco__20240508T050436Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_462_20231201T170316Z_gen_g4_detsim_hitreco__20240507T191300Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571580_486_20231203T022233Z_gen_g4_detsim_hitreco__20240508T071428Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_941_20231202T123336Z_gen_g4_detsim_hitreco__20240507T212842Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515283_442_20231201T112116Z_gen_g4_detsim_hitreco__20240507T185544Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66049673_552_20231207T155116Z_gen_g4_detsim_hitreco__20240510T044641Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74510902_229_20231203T093041Z_gen_g4_detsim_hitreco__20240508T075324Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_466_20231202T062552Z_gen_g4_detsim_hitreco__20240508T034314Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_987_20231204T053434Z_gen_g4_detsim_hitreco__20240509T214229Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_142_20231118T173342Z_gen_g4_detsim_hitreco__20240503T051724Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_73_20231202T180337Z_gen_g4_detsim_hitreco__20240508T063903Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_640_20231207T132841Z_gen_g4_detsim_hitreco__20240510T055944Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_831_20231202T204934Z_gen_g4_detsim_hitreco__20240508T070423Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_662_20231207T033344Z_gen_g4_detsim_hitreco__20240510T060731Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_314_20231207T153501Z_gen_g4_detsim_hitreco__20240510T030224Z_reco2.root
JobscriptExit code0
Real time8m (480s)
CPU time6m (383s = 79%)
Outputting started2024-09-11 19:38:42
Output filesfardet-hd:caf_fd_hd_atmo_3191_20240911T193051Z.root
Finished2024-09-11 19:39:30
Saved logsjustin-logs:254417.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/ad/f4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515283_442_20231201T112116Z_gen_g4_detsim_hitreco__20240507T185544Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/6f/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66049673_552_20231207T155116Z_gen_g4_detsim_hitreco__20240510T044641Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/dc/5f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74510902_229_20231203T093041Z_gen_g4_detsim_hitreco__20240508T075324Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3b/ec/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_466_20231202T062552Z_gen_g4_detsim_hitreco__20240508T034314Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/22/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_987_20231204T053434Z_gen_g4_detsim_hitreco__20240509T214229Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/c1/03/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_142_20231118T173342Z_gen_g4_detsim_hitreco__20240503T051724Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/fe/48/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_73_20231202T180337Z_gen_g4_detsim_hitreco__20240508T063903Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/98/49/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_640_20231207T132841Z_gen_g4_detsim_hitreco__20240510T055944Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/69/95/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_831_20231202T204934Z_gen_g4_detsim_hitreco__20240508T070423Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3f/1e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_662_20231207T033344Z_gen_g4_detsim_hitreco__20240510T060731Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/4c/de/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_314_20231207T153501Z_gen_g4_detsim_hitreco__20240510T030224Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6407968_580_20231203T051836Z_gen_g4_detsim_hitreco__20240508T050436Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_462_20231201T170316Z_gen_g4_detsim_hitreco__20240507T191300Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571580_486_20231203T022233Z_gen_g4_detsim_hitreco__20240508T071428Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_941_20231202T123336Z_gen_g4_detsim_hitreco__20240507T212842Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515283_442_20231201T112116Z_gen_g4_detsim_hitreco__20240507T185544Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66049673_552_20231207T155116Z_gen_g4_detsim_hitreco__20240510T044641Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74510902_229_20231203T093041Z_gen_g4_detsim_hitreco__20240508T075324Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_466_20231202T062552Z_gen_g4_detsim_hitreco__20240508T034314Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_987_20231204T053434Z_gen_g4_detsim_hitreco__20240509T214229Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_142_20231118T173342Z_gen_g4_detsim_hitreco__20240503T051724Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_73_20231202T180337Z_gen_g4_detsim_hitreco__20240508T063903Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_640_20231207T132841Z_gen_g4_detsim_hitreco__20240510T055944Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_831_20231202T204934Z_gen_g4_detsim_hitreco__20240508T070423Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_662_20231207T033344Z_gen_g4_detsim_hitreco__20240510T060731Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_314_20231207T153501Z_gen_g4_detsim_hitreco__20240510T030224Z_reco2.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_01d00/gdml/dune10kt_v5_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 3831 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
 about to do checksum on newfilename caf.root
0/15
mergeMetaCat: don't write out mixed tags dune.workflow
mergeMetaCat: don't write out mixed tags art.last_event
mergeMetaCat: don't write out mixed tags art.first_event
core.file_content_status is missing from fardet-hd:caf.root

retention.status is missing from fardet-hd:caf.root

retention.class is missing from fardet-hd:caf.root

fardet-hd:caf.root  fails basic metadata tests
you could fix this by applying this fix
{
    "core.file_content_status": "good",
    "retention.status": "active",
    "retention.class": "unknown"
}
mergeMetaCat: Checked metadata 0 {'core.file_content_status': 'good', 'retention.status': 'active', 'retention.class': 'unknown'}
processed files
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/cd/cd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6407968_580_20231203T051836Z_gen_g4_detsim_hitreco__20240508T050436Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/cd/a6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_462_20231201T170316Z_gen_g4_detsim_hitreco__20240507T191300Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3e/43/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571580_486_20231203T022233Z_gen_g4_detsim_hitreco__20240508T071428Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/70/2e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_941_20231202T123336Z_gen_g4_detsim_hitreco__20240507T212842Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/ad/f4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515283_442_20231201T112116Z_gen_g4_detsim_hitreco__20240507T185544Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/6f/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66049673_552_20231207T155116Z_gen_g4_detsim_hitreco__20240510T044641Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/dc/5f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74510902_229_20231203T093041Z_gen_g4_detsim_hitreco__20240508T075324Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3b/ec/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_466_20231202T062552Z_gen_g4_detsim_hitreco__20240508T034314Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/22/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_987_20231204T053434Z_gen_g4_detsim_hitreco__20240509T214229Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/c1/03/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_142_20231118T173342Z_gen_g4_detsim_hitreco__20240503T051724Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/fe/48/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_73_20231202T180337Z_gen_g4_detsim_hitreco__20240508T063903Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/98/49/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_640_20231207T132841Z_gen_g4_detsim_hitreco__20240510T055944Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/69/95/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_831_20231202T204934Z_gen_g4_detsim_hitreco__20240508T070423Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3f/1e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_662_20231207T033344Z_gen_g4_detsim_hitreco__20240510T060731Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/4c/de/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_314_20231207T153501Z_gen_g4_detsim_hitreco__20240510T030224Z_reco2.root
all-input-dids.txt
caf.root
caf.root.json
caf_20240911T193051Z.did
caf_20240911T193051Z.file
caf_20240911T193051Z.log
caf_20240911T193051Z.pfns
caf_fd_hd_atmo_3191_20240911T193051Z.root
caf_fd_hd_atmo_3191_20240911T193051Z.root.json
did.list
file.list
flatcaf.root
jobscript.log
justin-processed-pfns.txt
justIN time: 2024-11-17 10:57:44 UTC       justIN version: 01.01.09