justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244659.165@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244659.165@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 01:07:13
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2024-08-19 02:12:22
From worker nodeHostnamewn-snel-016.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 01:11:28
Input fileshd-protodune:np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617.hdf5
JobscriptExit code0
Real time59m (3556s)
CPU time53m (3211s = 90%)
Outputting started2024-08-19 02:10:57
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup_hists.root
Finished2024-08-19 02:12:22
Saved logsjustin-logs:244659.165-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

traces tagged "wiener"
FrameSaver: q=903100 n=657080 tag=wiener
1566 hits in TPC 0
2923 hits in TPC 1
5845 hits in TPC 2
2830 hits in TPC 3
2072 hits in TPC 4
4209 hits in TPC 5
4220 hits in TPC 6
2395 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 87 XUs and 73 XVs -> 2 XUVs
C:0 T:2 29596 XUs and 16939 XVs -> 1149 XUVs
C:0 T:3 63 XUs and 97 XVs -> 8 XUVs
C:0 T:4 154 XUs and 270 XVs -> 48 XUVs
C:0 T:5 8870 XUs and 8282 XVs -> 319 XUVs
C:0 T:6 6405 XUs and 8414 XVs -> 552 XUVs
C:0 T:7 282 XUs and 409 XVs -> 40 XUVs
2118 XUVs total
980 collection wire objects
2118 potential space points
Neighbour search...
38600 tests to find 24226 neighbours
Iterating with no regularization...
Begin: 1.50117e+07
0 1.4293e+07
1 1.42641e+07
2 1.42599e+07
Now with regularization...
Begin: 1.35902e+07
0 1.35881e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  2   event 266714 TrkackID 4 startx, y, z 39.2926 590.521 312.048  wireno, peakt tpcno 433 7.86811 5 dist 0min T, max_T1.61454 715.403
no of hits closeby  2   event 266714 TrkackID 4 startx, y, z 39.2926 590.521 312.048  wireno, peakt tpcno 433 7.86811 5 dist 0min T, max_T1.61454 715.403
19-Aug-2024 04:10:34 CEST  Closed output file "np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup.root"
19-Aug-2024 04:10:34 CEST  Closed input file "np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              53.0987       78.3292       115.955       77.5233       14.711         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00043188    0.00180017    0.00311743    0.00195314    0.000782595      30     
produce:fembfilter:PDHDFEMBFilter                      0.490108      0.569038      0.938133      0.525186      0.0982269       30     
produce:wclsdatahd:WireCellToolkit                      27.5609       28.7226       30.1435       28.6683      0.588965        30     
produce:gaushit:GausHitFinder                          0.344754       0.57919      0.774797      0.584267      0.100793        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000274304   0.00039449    0.000710472   0.000358366   0.000111847      30     
produce:reco3d:SpacePointSolver                        0.180528      0.862162       2.47352      0.779294      0.588254        30     
produce:hitpdune:DisambigFromSpacePoints               0.158699      0.418063       1.0066       0.408538      0.150413        30     
produce:pandora:StandardPandora                         4.69978       15.6985       38.0366       15.2008       8.18324        30     
produce:pandoraWriter:StandardPandora                  0.0786437     0.144194      0.274147      0.140222      0.0379316       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.492175       1.1106        2.34159       1.00093      0.449309        30     
produce:pandoraShower:LArPandoraShowerCreation         0.469447       1.12038       2.91578       1.02195      0.530708        30     
produce:pandoracalo:Calorimetry                        0.269051      0.520561       1.00131      0.489177      0.160548        30     
produce:pandoracalonosce:Calorimetry                   0.240264      0.477156      0.940225       0.45205      0.152737        30     
produce:pandorapid:Chi2ParticleID                     0.00121314    0.00167523     0.003212     0.00161721    0.000364672      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.374125       0.98115       2.59684      0.888286      0.447848        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.366271      0.951835       2.53721      0.863911       0.43512        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.080336      0.114575      0.166841      0.114273      0.0213063       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.028603      0.0408846     0.0601586     0.0409615    0.00741987       30     
produce:emtrkmichelid:EmTrackMichelId                   15.4305       23.9024       35.0555       24.3443       4.2059         30     
[art]:TriggerResults:TriggerResultInserter            1.9096e-05    2.53538e-05   7.7125e-05    2.24675e-05   1.07939e-05      30     
end_path:out1:RootOutput                               4.228e-06    5.7364e-06    2.2362e-05    5.0645e-06    3.12334e-06      30     
end_path:michelremoving:michelremoving                 0.0239668     0.081113      0.479541      0.0372887     0.101443        30     
end_path:michelremovinggnocchi:michelremoving          0.0238055     0.0796348     0.475629      0.0363007     0.100317        30     
end_path:calibanagnocchi:CalibAnaTree                  0.358375      0.718457       1.40041      0.661806      0.255019        30     
end_path:out1:RootOutput(write)                         0.82385       1.11936       1.3563         1.156       0.139907        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4940.66 MB
  Peak resident set size usage (VmHWM): 2620.25 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup.root
\tHists: np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724031047.0,
    "core.end_time": 1724033435.0,
    "core.events": [
      266402,
      266410,
      266418,
      266426,
      266434,
      266442,
      266450,
      266458,
      266466,
      266474,
      266482,
      266490,
      266498,
      266506,
      266514,
      266522,
      266530,
      266538,
      266546,
      266554,
      266562,
      266570,
      266578,
      266586,
      266594,
      266602,
      266610,
      266618,
      266706,
      266714
    ],
    "core.event_count": 30,
    "core.first_event_number": 266402,
    "core.last_event_number": 266714,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617_reco_stage1_reco_stage2_20240819T021034_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724031047.0,
    "core.end_time": 1724033435.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1110_dataflow2_datawriter_0_20240818T231617.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:11:05 UTC       justIN version: 01.01.09