justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255635.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID255635.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3214
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-13 01:39:51
SiteCZ_FZU
EntryNova_CZ_FZU_osgce1
Last heartbeat2024-09-13 01:45:09
From worker nodeHostnameminis07.farm.particle.cz
cpuinfoAMD EPYC 7351P 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-13 01:41:26
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_231_20231204T051126Z_gen_g4_detsim_hitreco__20240509T212729Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_569_20231207T032419Z_gen_g4_detsim_hitreco__20240510T024758Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6414162_240_20231203T131849Z_gen_g4_detsim_hitreco__20240508T072505Z_reco2.root
JobscriptExit code0
Real time2m (178s)
CPU time2m (126s = 70%)
Outputting started2024-09-13 01:44:25
Output filesfardet-hd:caf_fd_hd_atmo_3214_20240913T014153Z.root
Finished2024-09-13 01:45:09
Saved logsjustin-logs:255635.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Using CAF fcl: cafmaker_atmos_dune10kt_1x2x6_runreco-nuenergy-nuangular_geov5.fcl
Justin processors: 1
Will use justin-get-file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
now run lar on these files
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/f3/16/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_231_20231204T051126Z_gen_g4_detsim_hitreco__20240509T212729Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/bf/17/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_569_20231207T032419Z_gen_g4_detsim_hitreco__20240510T024758Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/ec/90/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6414162_240_20231203T131849Z_gen_g4_detsim_hitreco__20240508T072505Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_231_20231204T051126Z_gen_g4_detsim_hitreco__20240509T212729Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_569_20231207T032419Z_gen_g4_detsim_hitreco__20240510T024758Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6414162_240_20231203T131849Z_gen_g4_detsim_hitreco__20240508T072505Z_reco2.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_01d00/gdml/dune10kt_v5_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 3831 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
 about to do checksum on newfilename caf.root
0/3
mergeMetaCat: don't write out mixed tags dune.workflow
mergeMetaCat: don't write out mixed tags art.last_event
mergeMetaCat: don't write out mixed tags art.first_event
core.file_content_status is missing from fardet-hd:caf.root

retention.status is missing from fardet-hd:caf.root

retention.class is missing from fardet-hd:caf.root

fardet-hd:caf.root  fails basic metadata tests
you could fix this by applying this fix
{
    "core.file_content_status": "good",
    "retention.status": "active",
    "retention.class": "unknown"
}
mergeMetaCat: Checked metadata 0 {'core.file_content_status': 'good', 'retention.status': 'active', 'retention.class': 'unknown'}
processed files
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/f3/16/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_231_20231204T051126Z_gen_g4_detsim_hitreco__20240509T212729Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/bf/17/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_569_20231207T032419Z_gen_g4_detsim_hitreco__20240510T024758Z_reco2.root
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/ec/90/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6414162_240_20231203T131849Z_gen_g4_detsim_hitreco__20240508T072505Z_reco2.root
all-input-dids.txt
caf.root
caf.root.json
caf_20240913T014153Z.did
caf_20240913T014153Z.file
caf_20240913T014153Z.log
caf_20240913T014153Z.pfns
caf_fd_hd_atmo_3214_20240913T014153Z.root
caf_fd_hd_atmo_3214_20240913T014153Z.root.json
did.list
file.list
flatcaf.root
jobscript.log
justin-processed-pfns.txt
justIN time: 2024-11-17 10:54:16 UTC       justIN version: 01.01.09