justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278826.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID278826.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3783
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit36000 (10 hours)
Submitted time2024-10-23 11:18:22
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod02
Last heartbeat2024-10-23 12:10:18
From worker nodeHostnamewm07.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-23 11:19:52
Input filesmonte-carlo-003783-000020
JobscriptExit code0
Real time49m (2987s)
CPU time42m (2541s = 85%)
Outputting started2024-10-23 12:09:39
Output files
Finished2024-10-23 12:10:18
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = 000020
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
../justin-jobscript: line 85: r: command not found
DUNESW_DIR:         /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/dunesw/v09_91_04d00
PROTODUNEANA_DIR:   /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/protoduneana/v09_91_04d00
DUNERECO_DIR:       /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/dunereco/v09_91_04d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/duneprototypes/v09_91_04d00
FHICL_FILE_PATH:    /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/dunereco/v09_91_04d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/protoduneana/v09_91_04d00/job:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/duneprototypes/v09_91_04d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d7817767375ece34d2dee858f2723cd85f7b7834/dunesw/v09_91_04d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v09_91_04d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_08/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v09_91_04d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_04d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_01/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v09_18_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v09_06_09/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v09_23_06/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_22_11/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v09_09_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v09_11_11/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v09_15_11/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v09_25_06/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v09_44_02/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_01/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v09_19_06/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_06/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v09_10_06/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v09_16_06/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v09_17_06/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v09_11_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v09_13_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
lar exit code 0
.:
total 3957892
-rw-r--r--. 1 job0034 job0034 1324493975 Oct 23 13:09 pdvd_electron_1GeV_mod_reco_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034 1324483070 Oct 23 12:50 pdvd_electron_1GeV_std_reco_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034 1316439015 Oct 23 12:31 pdvd_electron_1GeV_detsim_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034   52843198 Oct 23 12:21 pdvd_electron_1GeV_g4_stage2_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034   28819123 Oct 23 12:20 pdvd_electron_1GeV_g4_stage1_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034    3455140 Oct 23 13:09 Pandora_Events.pndr
-rw-r--r--. 1 job0034 job0034     572015 Oct 23 12:31 wcls-sim-drift-simchannel.log
-rw-r--r--. 1 job0034 job0034     545846 Oct 23 13:09 pdvd_electron_1GeV_mod_reco_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034     543746 Oct 23 12:50 pdvd_electron_1GeV_std_reco_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034     217088 Oct 23 13:09 mem.db
-rw-r--r--. 1 job0034 job0034      89525 Oct 23 12:20 pdvd_electron_1GeV_g4_stage1_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034      87074 Oct 23 12:20 pdvd_electron_1GeV_gen_2024-10-23T_111959Z.root
-rw-r--r--. 1 job0034 job0034      86598 Oct 23 12:31 pdvd_electron_1GeV_detsim_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034      32768 Oct 23 13:09 time.db
-rw-r--r--. 1 job0034 job0034      24703 Oct 23 12:20 pdvd_electron_1GeV_gen_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034      22715 Oct 23 12:21 pdvd_electron_1GeV_g4_stage2_2024-10-23T_111959Z.log
-rw-r--r--. 1 job0034 job0034       3973 Oct 23 13:09 jobscript.log
-rw-r--r--. 1 job0034 job0034       1591 Oct 23 13:09 Pandora_Geometry.xml
-rw-r--r--. 1 job0034 job0034        519 Oct 23 12:31 pdvd_electron_1GeV_detsim_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034        519 Oct 23 12:20 pdvd_electron_1GeV_g4_stage1_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034        519 Oct 23 12:21 pdvd_electron_1GeV_g4_stage2_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034        519 Oct 23 12:20 pdvd_electron_1GeV_gen_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034        519 Oct 23 13:09 pdvd_electron_1GeV_mod_reco_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034        519 Oct 23 12:50 pdvd_electron_1GeV_std_reco_2024-10-23T_111959Z_hist.root
-rw-r--r--. 1 job0034 job0034         52 Oct 23 12:19 all-input-dids.txt
-rw-r--r--. 1 job0034 job0034          7 Oct 23 13:09 justin-processed-pfns.txt
-rw-r--r--. 1 job0034 job0034          0 Oct 23 12:50 debugprod.log
justIN time: 2024-11-23 23:31:12 UTC       justIN version: 01.01.09