justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

6th January: justIN upgraded to 01.02 - please report any problems in #computing-operations or #user_grid_usage on Slack

Jobsub ID 132581.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID132581.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4798
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-01-22 10:41:41
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-01-22 12:01:46
From worker nodeHostnameheplnc095.pp.rl.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-01-22 10:43:24
Input filesvd-protodune:np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936.hdf5
JobscriptExit code0
Real time1h (4612s)
CPU time1h (4021s = 87%)
Outputting started2025-01-22 12:00:16
Output filesusertests:np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco.root
Finished2025-01-22 12:01:46
Saved logsjustin-logs:132581.2-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in desired window for channel 2174
wclsFrameSaver: no samples within desired window for channel 2174
wclsFrameSaver: no samples within desired window for channel 2174
wclsFrameSaver: no samples within desired window for channel 2175
wclsFrameSaver: no samples within desired window for channel 2175
wclsFrameSaver: no samples within desired window for channel 2175
wclsFrameSaver: no samples within desired window for channel 2175
wclsFrameSaver: no samples within desired window for channel 2175
wclsFrameSaver: no samples within desired window for channel 2176
wclsFrameSaver: no samples within desired window for channel 2177
wclsFrameSaver: no samples within desired window for channel 2178
wclsFrameSaver: no samples within desired window for channel 2179
wclsFrameSaver: no samples within desired window for channel 2447
wclsFrameSaver: no samples within desired window for channel 2447
wclsFrameSaver: no samples within desired window for channel 2447
wclsFrameSaver: no samples within desired window for channel 2447
wclsFrameSaver: no samples within desired window for channel 2453
wclsFrameSaver: no samples within desired window for channel 2453
wclsFrameSaver: no samples within desired window for channel 2465
wclsFrameSaver: no samples within desired window for channel 2781
wclsFrameSaver: no samples within desired window for channel 4279
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4280
wclsFrameSaver: no samples within desired window for channel 4281
wclsFrameSaver: no samples within desired window for channel 4281
wclsFrameSaver: no samples within desired window for channel 4282
wclsFrameSaver: no samples within desired window for channel 4282
wclsFrameSaver: no samples within desired window for channel 4282
wclsFrameSaver: no samples within desired window for channel 5267
wclsFrameSaver: no samples within desired window for channel 5267
wclsFrameSaver: no samples within desired window for channel 5560
FrameSaver: q=11322.8 n=1887 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 0 XUs and 0 XVs -> 0 XUVs
C:0 T:1 0 XUs and 0 XVs -> 0 XUVs
C:0 T:2 0 XUs and 0 XVs -> 0 XUVs
C:0 T:3 0 XUs and 0 XVs -> 0 XUVs
0 XUVs total
0 collection wire objects
0 potential space points
Neighbour search...
0 tests to find 0 neighbours
Iterating with no regularization...
Begin: 0
0 0
1 0
2 0
3 0
4 0
5 0
6 0
7 0
8 0
9 0
10 0
11 0
12 0
13 0
14 0
15 0
16 0
17 0
18 0
19 0
20 0
21 0
22 0
23 0
24 0
25 0
26 0
27 0
28 0
29 0
30 0
31 0
32 0
33 0
34 0
35 0
36 0
37 0
38 0
39 0
40 0
41 0
42 0
43 0
44 0
45 0
46 0
47 0
48 0
49 0
50 0
51 0
52 0
53 0
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
Now with regularization...
Begin: 0
0 0
1 0
2 0
3 0
4 0
5 0
6 0
7 0
8 0
9 0
10 0
11 0
12 0
13 0
14 0
15 0
16 0
17 0
18 0
19 0
20 0
21 0
22 0
23 0
24 0
25 0
26 0
27 0
28 0
29 0
30 0
31 0
32 0
33 0
34 0
35 0
36 0
37 0
38 0
39 0
40 0
41 0
42 0
43 0
44 0
45 0
46 0
47 0
48 0
49 0
50 0
51 0
52 0
53 0
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
22-Jan-2025 12:00:05 GMT  Closed output file "np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco.root"

=================================================================================================================================
TimeTracker printout (sec)                         Min           Avg           Max         Median          RMS         nEvts   
=================================================================================================================================
Full event                                       105.637       124.433       289.031       109.441       38.7806        36     
---------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.135e-05    9.20282e-05   0.000642193   6.0686e-05    9.80212e-05      36     
reco:rns:RandomNumberSaver                     3.3066e-05    9.20238e-05   0.00142991    4.49065e-05   0.000226989      36     
reco:tpcrawdecoder:PDVDTPCReader                 15.8858       17.133        19.1165       17.0339      0.851064        36     
reco:wclsdatavd:WireCellToolkit                  87.1302       104.857       266.424       90.1251       37.7224        36     
reco:gaushit:GausHitFinder                     0.00193184    0.00378114    0.00922618    0.00307402    0.00187678       36     
reco:reco3d:SpacePointSolver                   0.000163647   0.00133466    0.00463778    0.00122315    0.000739082      36     
reco:hitpdune:DisambigFromSpacePoints          0.000200719   0.00057189    0.00796628    0.000340888   0.00125747       36     
reco:pandora:StandardPandora                   0.00127248      0.05642       1.86194      0.0037105     0.305219        36     
reco:pandoraTrack:LArPandoraTrackCreation      0.00012739    0.000298285   0.00398112    0.000167809   0.000626745      36     
reco:pandoraShower:LArPandoraShowerCreation    0.00012269    0.00020102     0.0016559    0.000150857   0.000247784      36     
reco:pandoraStdcalo:Calorimetry                0.000127385   0.000274459   0.00315375    0.000173738     0.00049        36     
reco:pandoraGnocalo:GnocchiCalorimetry         0.000115832   0.000224468   0.00292685    0.000136178   0.00045857       36     
[art]:TriggerResults:TriggerResultInserter     1.6929e-05    2.77805e-05   0.000149475   2.2421e-05    2.14229e-05      36     
end_path:rootout:RootOutput                     4.185e-06    9.2715e-06    4.3646e-05     8.344e-06    6.20992e-06      36     
end_path:rootout:RootOutput(write)               2.11762       2.36743       4.25442       2.25951      0.448645        36     
=================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3790.18 MB
  Peak resident set size usage (VmHWM): 1936.88 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
mv: missing destination file operand after 'np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco_hists.root'
Try 'mv --help' for more information.
Output files:
\tReco: np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco.root
\tHists: np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco.root
Ran successfully
{
  "name": "np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_02_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "protodunevd_data_reco.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1737547207.0,
    "core.end_time": 1737547207.0,
    "core.events": [
      433,
      434,
      435,
      436,
      437,
      438,
      439,
      440,
      441,
      442,
      443,
      444,
      445,
      446,
      447,
      448,
      449,
      450,
      451,
      452,
      453,
      454,
      455,
      456,
      457,
      458,
      459,
      460,
      461,
      462,
      463,
      464,
      465,
      466,
      467,
      468
    ],
    "core.event_count": 36,
    "core.first_event_number": 433,
    "core.last_event_number": 468,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35327
    ],
    "core.runs_subruns": [
      3532700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936_pdvd_bde_reco_hists.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_02_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "protodunevd_data_reco.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1737547207.0,
    "core.end_time": 1737547207.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35327
    ],
    "core.runs_subruns": [
      3532700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035327_0012_dataflow0_datawriter_0_20250122T095936.hdf5"
    }
  ]
}
justIN time: 2025-01-22 14:02:34 UTC       justIN version: 01.02.00