justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 94192.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID94192.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4002
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-11 07:40:54
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-11-11 08:12:54
From worker nodeHostnamer21-n18.ph.liv.ac.uk
cpuinfoIntel(R) Xeon(R) CPU X5650 @ 2.67GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-11 07:42:08
Input filespdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root
JobscriptExit code0
Real time30m (1827s)
CPU time20m (1216s = 66%)
Outputting started2024-11-11 08:12:36
Output files
Finished2024-11-11 08:12:54
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s/larsoft.opensciencegrid.org/products/cetlib/v3_16_00
ROOT_INC=/cvmfs/larsoft.opensciencegrid.org/products/root/v6_26_06b/Linux64bit+3.10-2.17-e26-p3913-prof/include
HUB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hub/v2_14_2
GEANT4REWEIGHT_DIR=/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_00
DUNERECO_VERSION=v09_81_00d01
NLOHMANN_JSON_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/nlohmann_json/v3_10_4_1/Linux64bit+3.10-2.17-e26-prof/lib64
LARPANDORA_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_21_12/slf7.x86_64.e26.prof/lib
IFDH_ART_INC=/cvmfs/larsoft.opensciencegrid.org/products/ifdh_art/v2_15_06/slf7.x86_64.e26.prof/inc
MARLEY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/marley/v1_2_0i/Linux64bit+3.10-2.17-e26-prof/lib
SETUP_LAREVT=larevt v09_09_07 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
HDF5_INC=/cvmfs/larsoft.opensciencegrid.org/products/hdf5/v1_12_2a/Linux64bit+3.10-2.17-e26-prof/include
SETUP_CANVAS=canvas v3_14_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_1_0/include
SETUP_TBB=tbb v2021_7_0 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26
PYTHIA_INC=/cvmfs/larsoft.opensciencegrid.org/products/pythia/v6_4_28w/Linux64bit+3.10-2.17-e26-prof/include
SETUP_DUNESW=dunesw v09_81_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/27210e1ddd13bdb8421f162d87b8743ac12095a3 -q e26:prof
PERL_MM_OPT=INSTALL_BASE=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_06/slf7.x86_64/CPAN
GIT_EXEC_PATH=/cvmfs/larsoft.opensciencegrid.org/products/git/v2_45_1/Linux64bit+3.10-2.17/libexec/git-core
PROTODUNEANA_INC=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/27210e1ddd13bdb8421f162d87b8743ac12095a3/protoduneana/v09_81_00d01/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v09_81_00d01/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v09_81_00d01
WIRECELL_LIB=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_24_3/Linux64bit+3.10-2.17-e26-prof/lib64
TRITON_INC=/cvmfs/larsoft.opensciencegrid.org/products/triton/v2_25_0b/Linux64bit+3.10-2.17-e26/include
LIBJPEG_TURBO_INC=/cvmfs/larsoft.opensciencegrid.org/products/libjpeg_turbo/v2_1_0/Linux64bit+3.10-2.17/include
LAREVENTDISPLAY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v09_10_11/slf7.x86_64.e26.prof/lib
PPFX_VERSION=v02_18_03
NUG4_VERSION=v1_15_02
SETUP_LARDATAALG=lardataalg v09_16_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
LARCOREALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v09_12_01/include
G4PARTICLEHPDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4tendl/v1_3_2/G4TENDL1.3.2
SETUP_LARANA=larana v09_14_11 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_LARSOFT=larsoft v09_81_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_CETLIB=cetlib v3_16_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_FHICLCPP=fhiclcpp v4_17_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
OPENBLAS_INC=/cvmfs/larsoft.opensciencegrid.org/products/openblas/v0_3_21/Linux64bit+3.10-2.17-e26/include
PYTHON_INCLUDE=/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_13/Linux64bit+3.10-2.17/include/python3.9
_=/usr/bin/env
Justin specific env vars
JUSTIN_SCOPE=usertests
JUSTIN_WALL_SECONDS=80000
JUSTIN_ALLOCATOR=https://justin-allocator-pro.dune.hep.ac.uk/api/allocator/
JUSTIN_SITE_NAME=UK_Liverpool
JUSTIN_SAM_WEB_URI=https://justin.dune.hep.ac.uk/api/samweb/94192.2@justin-prod-sched02.dune.hep.ac.uk/WLsnwD4DDU1DbJTLQUCVDk4THwQnJmPKabqtxOBUUWlNcl9iB-lCd6TJxKJsewfimssRN9Zqzz64WJckR8OptA
JUSTIN_PROCESSORS=1
JUSTIN_JOBSCRIPT_SECRET=WLsnwD4DDU1DbJTLQUCVDk4THwQnJmPKabqtxOBUUWlNcl9iB-lCd6TJxKJsewfimssRN9Zqzz64WJckR8OptA
JUSTIN_PATH=/home
JUSTIN_TIMESTAMP=1731310928
JUSTIN_JOBSUB_ID=94192.2@justin-prod-sched02.dune.hep.ac.uk
JUSTIN_WORKFLOW_ID=4002
JUSTIN_STAGE_ID=1
JUSTIN_RSS_MIB=3999
Will use justin-get-file
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/8b/f0/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/00/ba/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/c3/68/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/a2/71/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/79/d4/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 1
Stdout b''
Stderr b'No files available from this stage\n'
root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/8b/f0/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/00/ba/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/c3/68/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/a2/71/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/79/d4/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root
Files retrieved: 5
PFN list:
root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/8b/f0/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/00/ba/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/c3/68/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/a2/71/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/79/d4/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root
Running pdspana
Ran successfully
Forming metadata
formed
{
  "parents": [
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_21640501_134_20210630T052322Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45717331_48_20210702T202541Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46312891_131_20210702T221615Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_45710411_38_20210703T070847Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_46266471_0_20210709T000909Z.root"
    }
  ],
  "metadata": {
    "core.application": "protoduneana.pdspana",
    "core.application.family": "protoduneana",
    "core.application.name": "pdspana",
    "core.application.version": "v09_81_00d01",
    "core.data_tier": "root-tuple-virtual",
    "core.file_format": "root",
    "dune.fcl_version_tag": "v09_81_00d01",
    "dune.fcl_name": "pduneana_Prod4a_MC_sce.fcl",
    "core.runs": [
      46312891,
      45717331,
      45710411,
      46266471,
      21640501
    ],
    "core.runs_subruns": [
      4631289100416,
      4571733100362,
      4571041100230,
      4626647100227,
      2164050100383
    ],
    "beam.polarity": 1,
    "core.group": "dune",
    "dune_mc.detector_type": "protoDUNE SP",
    "dune_mc.electron_lifetime": "35ms",
    "dune_mc.generators": "beam_cosmics",
    "dune_mc.liquid_flow": "no",
    "dune_mc.space_charge": "yes",
    "dune_mc.with_cosmics": 1,
    "core.run_type": "protodune-sp",
    "core.file_type": "mc",
    "core.data_stream": "out1",
    "core.event_count": 18
  }
}
justIN time: 2024-11-17 05:21:33 UTC       justIN version: 01.01.09