Workflow 5418, Stage 1

Priority	50
Processors	1
Wall seconds	80000
Image	/cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest
RSS bytes	2097152000 (2000 MiB)
Max distance for inputs	100.0
Enabled input RSEs	CERN_PDUNE_EOS, DUNE_CA_SFU, DUNE_CERN_EOS, DUNE_ES_PIC, DUNE_FR_CCIN2P3_DISK, DUNE_IN_TIFR, DUNE_IT_INFN_CNAF, DUNE_UK_GLASGOW, DUNE_UK_LANCASTER_CEPH, DUNE_UK_MANCHESTER_CEPH, DUNE_US_BNL_SDCC, DUNE_US_FNAL_DISK_STAGE, FNAL_DCACHE, FNAL_DCACHE_STAGING, FNAL_DCACHE_TEST, MONTECARLO, NIKHEF, PRAGUE, QMUL, RAL-PP, RAL_ECHO, SURFSARA, T3_US_NERSC
Enabled output RSEs	CERN_PDUNE_EOS, DUNE_CA_SFU, DUNE_CERN_EOS, DUNE_ES_PIC, DUNE_FR_CCIN2P3_DISK, DUNE_IN_TIFR, DUNE_IT_INFN_CNAF, DUNE_UK_GLASGOW, DUNE_UK_LANCASTER_CEPH, DUNE_UK_MANCHESTER_CEPH, DUNE_US_BNL_SDCC, DUNE_US_FNAL_DISK_STAGE, FNAL_DCACHE, FNAL_DCACHE_STAGING, FNAL_DCACHE_TEST, NIKHEF, PRAGUE, QMUL, RAL-PP, RAL_ECHO, SURFSARA, T3_US_NERSC
Enabled sites	BR_CBPF, CA_SFU, CA_Victoria, CERN, CH_UNIBE-LHEP, ES_CIEMAT, ES_PIC, FR_CCIN2P3, IN_TIFR, IT_CNAF, NL_NIKHEF, NL_SURFsara, UK_Brunel, UK_Durham, UK_Edinburgh, UK_Glasgow, UK_Imperial, UK_Lancaster, UK_Manchester, UK_Oxford, UK_RAL-PPD, UK_RAL-Tier1, UK_Sheffield, US_Caltech, US_Colorado, US_FNAL-FermiGrid, US_FNAL-T1, US_Michigan, US_MIT, US_Nebraska, US_NotreDame, US_PuertoRico, US_SU-ITS, US_Swan, US_UChicago, US_UConn-HPC, US_UCSD, US_Wisconsin
Scope	usertests
Events for this stage

Output patterns

	Destination	Pattern	Lifetime	For next stage	RSE expression
1	https://fndcadoor.fnal.gov:2880/dune/scratch/users/wforeman/dune-blipreco/out/helloworld2/05418/1/1	*.txt

Environment variables

Name	Value
INPUT_TAR_DIR_LOCAL	/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/968dc4ab1e9622f0bb8f7ff9254bd2fcc246aa66

File states

Total files	Finding	Unallocated	Allocated	Outputting	Processed	Not found	Failed
10	0	0	0	0	1	0	9

Job states

Total	Submitted	Started	Processing	Outputting	Finished	Notused	Aborted	Stalled	Jobscript error	Outputting failed	None processed
77	0	0	0	0	23	0	54	0	0	0	0

RSEs used

Name	Inputs	Outputs
MONTECARLO	55	0
None	0	3

Stats of processed input files as CSV or JSON, and of uploaded output files as CSV or JSON (up to 10000 files included)

File reset events, by site

Site	Allocated	Outputting
UK_RAL-Tier1	15	0
NL_NIKHEF	7	0
CH_UNIBE-LHEP	7	0
FR_CCIN2P3	6	0
UK_Lancaster	3	0
UK_Sheffield	2	0
ES_CIEMAT	2	0
UK_Oxford	2	0
US_PuertoRico	1	0

Jobscript

#!/bin/sh
: <<'EOF'

Hello World jobscript for justIN

Submit a workflow like this to run 10 jobs:

justin simple-workflow --monte-carlo 10 --jobscript hello-world.jobscript


Or like this to run jobs and put the output file into Rucio-managed storage:

justin simple-workflow \
     --monte-carlo 10 \
     --jobscript hello-world.jobscript \
     --description 'Hello World!!!' \
     --scope usertests \
     --output-pattern 'hello-world-*.txt:output-test-01'

EOF

# Try to get an unprocessed file from this stage
did_pfn_rse=`$JUSTIN_PATH/justin-get-file`

if [ "$did_pfn_rse" != "" ] ; then
  did=`echo $did_pfn_rse | cut -f1 -d' '`
  pfn=`echo $did_pfn_rse | cut -f2 -d' '`
  rse=`echo $did_pfn_rse | cut -f3 -d' '`

  # We say we processed whatever we were given
  echo "$pfn" > justin-processed-pfns.txt
  
  # Look at the file in cvmfs
  echo "Contents of $INPUT_TAR_DIR_LOCAL/*"
  ls -l $INPUT_TAR_DIR_LOCAL/*.fcl

  # Hello world
  echo "Hello world $pfn" 
  echo "Hello world $pfn" >hello-world-`date +%s.%N.txt`

fi
exit 0