justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77189.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77189.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3389
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 06:23:36
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce03
Last heartbeat2024-09-25 07:38:28
From worker nodeHostnamedune001-2388546.0-lcg2622.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 06:24:20
Input fileshd-protodune:np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851.hdf5
JobscriptExit code0
Real time1h (4342s)
CPU time1h (3915s = 90%)
Outputting started2024-09-25 07:36:43
Output fileshd-protodune-det-reco:np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup_hists.root
Finished2024-09-25 07:38:28
Saved logsjustin-logs:77189.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ked to 5859 ticks
wclsFrameSaver: saving 47229 traces tagged "gauss"
FrameSaver: q=1.22657e+06 n=919143 tag=gauss
wclsFrameSaver: saving 63601 traces tagged "wiener"
FrameSaver: q=1.3126e+06 n=847040 tag=wiener
2382 hits in TPC 0
3094 hits in TPC 1
5286 hits in TPC 2
3717 hits in TPC 3
1970 hits in TPC 4
4039 hits in TPC 5
7903 hits in TPC 6
5534 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3505 XUs and 2627 XVs -> 46 XUVs
C:0 T:2 13059 XUs and 21744 XVs -> 925 XUVs
C:0 T:3 42 XUs and 61 XVs -> 2 XUVs
C:0 T:4 28 XUs and 99 XVs -> 4 XUVs
C:0 T:5 4397 XUs and 8951 XVs -> 442 XUVs
C:0 T:6 59958 XUs and 44034 XVs -> 4226 XUVs
C:0 T:7 144 XUs and 127 XVs -> 2 XUVs
5647 XUVs total
2283 collection wire objects
5647 potential space points
Neighbour search...
348981 tests to find 190596 neighbours
Iterating with no regularization...
Begin: 1.68179e+07
0 1.51408e+07
1 1.50166e+07
2 1.5004e+07
Now with regularization...
Begin: 1.39708e+07
0 1.39637e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

25-Sep-2024 07:36:31 UTC  Closed output file "np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup.root"
25-Sep-2024 07:36:31 UTC  Closed input file "np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.7498       96.4505       136.819       94.142        14.4264        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000885983   0.00270164    0.00457151    0.00265433    0.000984947      30     
produce:fembfilter:PDHDFEMBFilter                      0.568413      0.777882      0.906814      0.817375      0.0927237       30     
produce:wclsdatahd:WireCellToolkit                      34.9995       41.5499       46.2885       41.8137       2.25517        30     
produce:gaushit:GausHitFinder                          0.329983      0.783005       1.20389      0.745481      0.200194        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000228234   0.000379621   0.000706501   0.000358106   9.97426e-05      30     
produce:reco3d:SpacePointSolver                        0.236183       1.34482       5.71674       1.10314       1.21116        30     
produce:hitpdune:DisambigFromSpacePoints               0.126971      0.609386       1.31536      0.522667      0.304865        30     
produce:pandora:StandardPandora                         5.45271       12.9883       28.6167       12.7276       5.11854        30     
produce:pandoraWriter:StandardPandora                  0.0658338     0.158652      0.286448      0.150141      0.0470975       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.450687       1.17339       2.47109       1.12803      0.478923        30     
produce:pandoraShower:LArPandoraShowerCreation         0.491607       1.30174       3.11908       1.17636       0.57562        30     
produce:pandoracalo:Calorimetry                        0.291562      0.646174       1.4556        0.60685      0.238527        30     
produce:pandoracalonosce:Calorimetry                   0.222378      0.570951       1.27304      0.550247      0.200049        30     
produce:pandorapid:Chi2ParticleID                      0.001247     0.00221125     0.0057357     0.0021293    0.000788915      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.426387       1.26339       3.39253       1.17491      0.599081        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.420643       1.20943       3.24756       1.14008      0.553425        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0797235     0.163098      0.285377      0.162222      0.0481822       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0306719     0.0570581      0.10041      0.0570554     0.0162842       30     
produce:emtrkmichelid:EmTrackMichelId                   20.2357       30.0432       55.9643       28.226        6.70538        30     
[art]:TriggerResults:TriggerResultInserter            2.5161e-05    4.61241e-05   0.000116332   3.8186e-05    1.90307e-05      30     
end_path:out1:RootOutput                               6.25e-06     1.38799e-05   4.1321e-05    1.30955e-05   5.81523e-06      30     
end_path:michelremoving:michelremoving                 0.0211059     0.149004      0.724038      0.120253      0.157508        30     
end_path:michelremovinggnocchi:michelremoving          0.0207752     0.139509      0.568196      0.115803      0.139124        30     
end_path:calibanagnocchi:CalibAnaTree                   0.21703      0.477009      0.878116      0.435147       0.1702         30     
end_path:out1:RootOutput(write)                        0.551435      0.898482       1.37743      0.897218      0.211993        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4963.14 MB
  Peak resident set size usage (VmHWM): 2595.33 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup.root
\tHists: np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246845.0,
    "core.end_time": 1727249792.0,
    "core.events": [
      678004,
      678012,
      678020,
      678028,
      678036,
      678044,
      678052,
      678060,
      678068,
      678076,
      678084,
      678092,
      678100,
      678108,
      678116,
      678124,
      678132,
      678140,
      678148,
      678156,
      678164,
      678172,
      678180,
      678188,
      678196,
      678204,
      678212,
      678220,
      678228,
      678236
    ],
    "core.event_count": 30,
    "core.first_event_number": 678004,
    "core.last_event_number": 678236,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851_reco_stage1_reco_stage2_20240925T073631_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246845.0,
    "core.end_time": 1727249792.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2825_dataflow4_datawriter_0_20240901T140851.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:19:10 UTC       justIN version: 01.01.09