Jobsub ID 255635.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	255635.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	3214
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-09-13 01:39:51
Site	CZ_FZU
Entry	Nova_CZ_FZU_osgce1
Last heartbeat	2024-09-13 01:43:21
From worker node	Hostname	milan12.farm.particle.cz
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	Inner Apptainer?	True
Job state	finished
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-09-13 01:41:36
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_363_20231202T115940Z_gen_g4_detsim_hitreco__20240507T212339Z_reco2.root
Jobscript	Exit code	0
	Real time	1m (61s)
	CPU time	0m (39s = 63%)
Outputting started	2024-09-13 01:42:38
Output files	fardet-hd:caf_fd_hd_atmo_3214_20240913T014154Z.root
Finished	2024-09-13 01:43:21
Saved logs	justin-logs:255635.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Using CAF fcl: cafmaker_atmos_dune10kt_1x2x6_runreco-nuenergy-nuangular_geov5.fcl
Justin processors: 1
Will use justin-get-file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
get_file receives:
DB connection lost and cannot reconnect: 'NoneType' object has no attribute 'ping'get-file fails with HTTP code 500 from allocator!
Could not get file
No files available from this stage
Could not get file
now run lar on these files
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/b1/c1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_363_20231202T115940Z_gen_g4_detsim_hitreco__20240507T212339Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_363_20231202T115940Z_gen_g4_detsim_hitreco__20240507T212339Z_reco2.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_01d00/gdml/dune10kt_v5_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 3831 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
 about to do checksum on newfilename caf.root
0/1
core.file_content_status is missing from fardet-hd:caf.root

retention.status is missing from fardet-hd:caf.root

retention.class is missing from fardet-hd:caf.root

fardet-hd:caf.root  fails basic metadata tests
you could fix this by applying this fix
{
    "core.file_content_status": "good",
    "retention.status": "active",
    "retention.class": "unknown"
}
mergeMetaCat: Checked metadata 0 {'core.file_content_status': 'good', 'retention.status': 'active', 'retention.class': 'unknown'}
processed files
root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/b1/c1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_363_20231202T115940Z_gen_g4_detsim_hitreco__20240507T212339Z_reco2.root
all-input-dids.txt
caf.root
caf.root.json
caf_20240913T014154Z.did
caf_20240913T014154Z.file
caf_20240913T014154Z.log
caf_20240913T014154Z.pfns
caf_fd_hd_atmo_3214_20240913T014154Z.root
caf_fd_hd_atmo_3214_20240913T014154Z.root.json
did.list
file.list
flatcaf.root
jobscript.log
justin-processed-pfns.txt