justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264408.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264408.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3520
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 20:41:18
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2024-09-26 22:18:32
From worker nodeHostnamedune001-2140382.0-lcg2420.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 20:42:05
Input fileshd-protodune:np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413.hdf5
JobscriptExit code0
Real time1h (5682s)
CPU time1h (5183s = 91%)
Outputting started2024-09-26 22:16:47
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup_hists.root
Finished2024-09-26 22:18:32
Saved logsjustin-logs:264408.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

404 summary
Retagger: tagging trace set: gauss with 49190 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49190 traces tagged "gauss"
FrameSaver: q=1.12452e+06 n=879382 tag=gauss
wclsFrameSaver: saving 69404 traces tagged "wiener"
FrameSaver: q=1.24018e+06 n=793976 tag=wiener
3787 hits in TPC 0
2113 hits in TPC 1
4284 hits in TPC 2
1910 hits in TPC 3
5284 hits in TPC 4
10183 hits in TPC 5
4336 hits in TPC 6
2748 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 732 XUs and 1104 XVs -> 134 XUVs
C:0 T:2 9800 XUs and 13497 XVs -> 306 XUVs
C:0 T:3 22 XUs and 44 XVs -> 0 XUVs
C:0 T:4 49 XUs and 91 XVs -> 2 XUVs
C:0 T:5 37515 XUs and 52568 XVs -> 3117 XUVs
C:0 T:6 9370 XUs and 6796 XVs -> 423 XUVs
C:0 T:7 147 XUs and 85 XVs -> 3 XUVs
3985 XUVs total
1124 collection wire objects
3985 potential space points
Neighbour search...
161231 tests to find 94072 neighbours
Iterating with no regularization...
Begin: 2.12729e+07
0 1.96893e+07
1 1.95468e+07
2 1.9523e+07
3 1.95162e+07
Now with regularization...
Begin: 1.82114e+07
0 1.82017e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 22:16:32 UTC  Closed output file "np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup.root"
26-Sep-2024 22:16:32 UTC  Closed input file "np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              69.4183       107.764       175.943       106.267       25.3894        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000701141   0.00376937    0.00830426    0.00384027    0.00140276       39     
produce:fembfilter:PDHDFEMBFilter                      0.779826      0.858616       1.11619      0.846835      0.0540049       39     
produce:wclsdatahd:WireCellToolkit                      37.0615       39.6175       41.6339       39.5605        1.051         39     
produce:gaushit:GausHitFinder                          0.561957      0.910059       1.27191       0.86922      0.232126        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000278896   0.000497589   0.00120288    0.000477761   0.000174637      39     
produce:reco3d:SpacePointSolver                        0.177569       2.29024       14.1289      0.941334       2.89444        39     
produce:hitpdune:DisambigFromSpacePoints               0.202398      0.763824       1.7368        0.69083      0.390814        39     
produce:pandora:StandardPandora                         6.97429       18.0288       34.3935       16.7644       7.83218        39     
produce:pandoraWriter:StandardPandora                  0.109889      0.222191      0.334713      0.227842      0.0563199       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.575892       1.95437       5.07206       1.8462       0.971689        39     
produce:pandoraShower:LArPandoraShowerCreation          0.49925       2.51752       7.57796       2.19671       1.66957        39     
produce:pandoracalo:Calorimetry                        0.378972      0.931489       2.60329       0.82386      0.460697        39     
produce:pandoracalonosce:Calorimetry                   0.317972      0.851726       2.48714      0.777747      0.440103        39     
produce:pandorapid:Chi2ParticleID                      0.0017462     0.0025996    0.00582447    0.00252596    0.000797931      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.472873       2.2707        7.66051       1.86114       1.57157        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.455089       2.20615       7.38562       1.79855       1.53192        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.124152      0.210505      0.306389      0.203343      0.053369        39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0413447     0.0711284     0.105689      0.0677347     0.0183004       39     
produce:emtrkmichelid:EmTrackMichelId                   18.1778       31.9575       46.1835       32.2448       7.91627        39     
[art]:TriggerResults:TriggerResultInserter            4.3542e-05    7.30699e-05   0.000160773   7.0532e-05    1.9935e-05       39     
end_path:out1:RootOutput                               7.524e-06    2.59934e-05   0.000327868   1.7283e-05    4.94781e-05      39     
end_path:michelremoving:michelremoving                 0.0182392     0.0927532     0.439295      0.0443296     0.108113        39     
end_path:michelremovinggnocchi:michelremoving          0.0167258     0.0857398     0.433926      0.0392541      0.10525        39     
end_path:calibanagnocchi:CalibAnaTree                  0.200657      0.669863       1.86724      0.574431      0.371843        39     
end_path:out1:RootOutput(write)                        0.548193       1.0326        1.55342       1.04732      0.276019        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4948.19 MB
  Peak resident set size usage (VmHWM): 2604.27 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup.root
\tHists: np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727384733.0,
    "core.end_time": 1727388993.0,
    "core.events": [
      2732,
      2734,
      2736,
      2738,
      2740,
      2742,
      2744,
      2746,
      2748,
      2750,
      2752,
      2754,
      2756,
      2758,
      2760,
      2762,
      2764,
      2766,
      2768,
      2770,
      2772,
      2774,
      2776,
      2778,
      2780,
      2782,
      2784,
      2786,
      2788,
      2790,
      2792,
      2794,
      2796,
      2798,
      2800,
      2802,
      2804,
      2806,
      2808
    ],
    "core.event_count": 39,
    "core.first_event_number": 2732,
    "core.last_event_number": 2808,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413_reco_stage1_reco_stage2_20240926T221632_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727384733.0,
    "core.end_time": 1727388993.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0035_dataflow0_datawriter_0_20240926T193413.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:04:30 UTC       justIN version: 01.01.09