justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 85921.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID85921.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3810
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2024-10-24 09:52:27
SiteUS_Wisconsin
EntryHCCHTPC_US_Wisconsin_osg01_rhel7
Last heartbeat2024-10-24 09:59:26
From worker nodeHostnamee4050
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit82800 (23 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-24 09:58:51
Input filesjustin-tutorial:tut_np02bde_307160042_np02_bde_coldbox_run012352_0054_20211216T000430.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-10-24 09:59:26
Saved logsjustin-logs:85921.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-Oct-2024 04:59:02 CDT JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 15359, largest present: 15359
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  24-Oct-2024 04:59:02 CDT JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i PhotonVisibilityService:  Early 24-Oct-2024 04:59:02 CDT JobSetup
PhotonVisbilityService initializing
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 24-Oct-2024 04:59:02 CDT JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 24-Oct-2024 04:59:02 CDT JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-i RANDOM:  IonAndScint:IonAndScint@Construction 24-Oct-2024 04:59:03 CDT  ModuleConstruction
Instantiated HepJamesRandom engine "IonAndScint:0:NEST" with seed 0.
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@Construction  24-Oct-2024 04:59:03 CDT ModuleConstruction
Seeding HepJamesRandom engine "IonAndScint:NEST" with seed 0.
%MSG
IonAndScint Module Construct
Produce SimEnergyDeposit in volumes: 
 - LArG4DetectorServicevolTPCActive
 - LArG4DetectorServicevolTPCActiveOuter
ScintTimeLAr Tool configure:
Fast rising time: 0, Fast decay time: 6, Slow rising time: 0, Slow decay time: 1600
%MSG-i RANDOM:  PDFastSimPVS:PDFastSim@Construction 24-Oct-2024 04:59:03 CDT  ModuleConstruction
Instantiated HepJamesRandom engine "PDFastSim:0:photon" with seed 0.
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSim@Construction  24-Oct-2024 04:59:03 CDT ModuleConstruction
Seeding HepJamesRandom engine "PDFastSim:photon" with seed 0.
%MSG
%MSG-i RANDOM:  PDFastSimPVS:PDFastSim@Construction 24-Oct-2024 04:59:03 CDT  ModuleConstruction
Instantiated HepJamesRandom engine "PDFastSim:0:scinttime" with seed 0.
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSim@Construction  24-Oct-2024 04:59:03 CDT ModuleConstruction
Seeding HepJamesRandom engine "PDFastSim:scinttime" with seed 0.
%MSG
PDFastSimPVS Module Construct
%MSG-i FastCloning:  RootOutput:out1@Construction 24-Oct-2024 04:59:03 CDT  ModuleConstruction
Initial fast cloning configuration (user-set): true
%MSG
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  24-Oct-2024 04:59:03 CDT ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: g4_stage1.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
Failed to parse the configuration file '/pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_detsim_stage1.fcl' with exception
---- Can't locate or can't open specified file: BEGIN
  /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_detsim_stage1.fcl => /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_detsim_stage1.fcl
---- Can't locate or can't open specified file: END

Art has completed and will exit with status 90.
%MSG-i MF_INIT_OK:  Early 24-Oct-2024 04:59:03 CDT JobSetup
Messagelogger initialization complete.
%MSG

RooFit v3.60 -- Developed by Wouter Verkerke and David Kirkby 
                Copyright (C) 2000-2013 NIKHEF, University of California & Stanford University
                All rights reserved, please read http://roofit.sourceforge.net/license.txt

Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunetpc/v09_09_00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
%MSG-i GeometryCore:  Early 24-Oct-2024 04:59:06 CDT JobSetup
New detector geometry loaded from 
	/cvmfs/dune.opensciencegrid.org/products/dune/dunetpc/v09_09_00/gdml/protodune_v7.gdml
	/cvmfs/dune.opensciencegrid.org/products/dune/dunetpc/v09_09_00/gdml/protodune_v7_nowires.gdml

%MSG
%MSG-i GeometryCore:  Early 24-Oct-2024 04:59:06 CDT JobSetup
Sorting volumes...
%MSG
%MSG-i DuneApaChannelMapAlg:  Early 24-Oct-2024 04:59:06 CDT JobSetup
Initializing channel map...
%MSG
Cryostat 0:
  15360 total channels
  6 APAs
  For all identical APA:
    Number of channels per APA = 2560
    U channels per APA = 800
    V channels per APA = 800
    Z channels per APA = 960
    Pitch in U Plane = 0.4669
    Pitch in V Plane = 0.4669
    Pitch in Z Plane = 0.4792
%MSG-i SimpleChannelStatusService:  Early 24-Oct-2024 04:59:06 CDT JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 15359, largest present: 15359
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  24-Oct-2024 04:59:06 CDT JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i PhotonVisibilityService:  Early 24-Oct-2024 04:59:06 CDT JobSetup
PhotonVisbilityService initializing
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 24-Oct-2024 04:59:06 CDT JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 24-Oct-2024 04:59:06 CDT JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-i RANDOM:  OpDetDigitizerDUNE:opdigi@Construction 24-Oct-2024 04:59:06 CDT  ModuleConstruction
Instantiated HepJamesRandom engine "opdigi:0:" with seed 536556829.
%MSG
%MSG-i FastCloning:  RootOutput:out1@Construction 24-Oct-2024 04:59:07 CDT  ModuleConstruction
Initial fast cloning configuration (user-set): true
%MSG
%MSG-i CRTSimRefactor:  TriggerResultInserter:TriggerResults@Construction  24-Oct-2024 04:59:06 CDT ModuleConstruction

%MSG
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  24-Oct-2024 04:59:07 CDT ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage1.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
Failed to parse the configuration file '/pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage1.fcl' with exception
---- Can't locate or can't open specified file: BEGIN
  /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage1.fcl => /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage1.fcl
---- Can't locate or can't open specified file: END

Art has completed and will exit with status 90.
Failed to parse the configuration file '/pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage2.fcl' with exception
---- Can't locate or can't open specified file: BEGIN
  /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage2.fcl => /pnfs/dune/persistent/users/pmelas/protoDUNE_refactored_reco_35ms_sce_datadriven_stage2.fcl
---- Can't locate or can't open specified file: END

Art has completed and will exit with status 90.
=== Start last 100 lines of lar log file ===
Failed to parse the configuration file '/exp/dune/app/users/pmelas/v09_09_00/runMyModule22.fcl' with exception
---- Can't locate or can't open specified file: BEGIN
  /exp/dune/app/users/pmelas/v09_09_00/runMyModule22.fcl => /exp/dune/app/users/pmelas/v09_09_00/runMyModule22.fcl
---- Can't locate or can't open specified file: END

Art has completed and will exit with status 90.
=== End last 100 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_09_00/bin/extractor_prod.py", line 426, in <module>
    main()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_09_00/bin/extractor_prod.py", line 373, in main
    mddict = expSpecificMetadata.getmetadata()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_09_00/bin/extractor_prod.py", line 344, in getmetadata
    jobt = self.get_job(proc)
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_09_00/bin/extractor_prod.py", line 69, in get_job
    raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 84
-rw-r--r-- 1 slot1_14 slot1_14 28672 Oct 24 04:59 mem.db
-rw-r--r-- 1 slot1_14 slot1_14 19681 Oct 24 04:59 jobscript.log
-rw-r--r-- 1 slot1_14 slot1_14 16384 Oct 24 04:59 time.db
-rw-r--r-- 1 slot1_14 slot1_14   519 Oct 24 04:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 slot1_14 slot1_14   519 Oct 24 04:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 slot1_14 slot1_14   381 Oct 24 04:59 myAnaOutput_2024-10-24T_095856Z.log
-rw-r--r-- 1 slot1_14 slot1_14   182 Oct 24 04:58 all-input-dids.txt
-rw-r--r-- 1 slot1_14 slot1_14     0 Oct 24 04:59 myAnaOutput_2024-10-24T_095856Z.root.ext.json
-rw-r--r-- 1 slot1_14 slot1_14     0 Oct 24 04:59 myAnaOutput_2024-10-24T_095856Z.root.json
justIN time: 2024-11-23 19:25:14 UTC       justIN version: 01.01.09