justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244554.90@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244554.90@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2866
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 18:14:38
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-18 19:35:27
From worker nodeHostnamewn-snel-030.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 18:30:51
Input fileshd-protodune:np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840.hdf5
Outputting started2024-08-18 19:34:19
Output files
Finished2024-08-18 19:35:27
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ger: tagging trace set: gauss with 66938 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66938 traces tagged "gauss"
FrameSaver: q=1.40165e+06 n=1148617 tag=gauss
wclsFrameSaver: saving 91747 traces tagged "wiener"
FrameSaver: q=1.51361e+06 n=1021348 tag=wiener
4520 hits in TPC 0
3925 hits in TPC 1
8475 hits in TPC 2
4893 hits in TPC 3
4518 hits in TPC 4
5971 hits in TPC 5
7913 hits in TPC 6
4585 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 684 XUs and 473 XVs -> 11 XUVs
C:0 T:2 69059 XUs and 78306 XVs -> 3229 XUVs
C:0 T:3 8022 XUs and 15337 XVs -> 850 XUVs
C:0 T:4 11 XUs and 16 XVs -> 0 XUVs
C:0 T:5 33602 XUs and 34322 XVs -> 1485 XUVs
C:0 T:6 59384 XUs and 78335 XVs -> 1135 XUVs
C:0 T:7 230 XUs and 207 XVs -> 10 XUVs
6720 XUVs total
1973 collection wire objects
6720 potential space points
Neighbour search...
506760 tests to find 257318 neighbours
Iterating with no regularization...
Begin: 8.66136e+06
0 7.63734e+06
1 7.56251e+06
2 7.55246e+06
3 7.549e+06
Now with regularization...
Begin: 7.22015e+06
0 7.21818e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

18-Aug-2024 21:34:12 CEST  Closed output file "np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup.root"
18-Aug-2024 21:34:12 CEST  Closed input file "np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.5485       88.9634       138.868       87.6728       19.286         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000322044    0.0015514     0.0025677    0.00168967    0.000669191      30     
produce:fembfilter:PDHDFEMBFilter                       0.54485      0.554598      0.590095      0.551676      0.0088867       30     
produce:wclsdatahd:WireCellToolkit                      31.4337       33.6028       35.0132       33.6122      0.751447        30     
produce:gaushit:GausHitFinder                          0.345282      0.653517       0.91927      0.679583      0.142919        30     
produce:nhitsfilter:NumberOfHitsFilter                 0.0003041    0.000639042   0.00200799    0.000568531   0.000311291      30     
produce:reco3d:SpacePointSolver                        0.249052       1.03865       2.73223      0.933207      0.581492        30     
produce:hitpdune:DisambigFromSpacePoints               0.150757      0.516719       1.38591      0.514461      0.235074        30     
produce:pandora:StandardPandora                         4.6134        17.8371       44.6138       15.6789       10.1618        30     
produce:pandoraWriter:StandardPandora                  0.0787269     0.167228      0.246908      0.170062      0.0406617       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.323844       1.31319       2.55765       1.22768      0.558195        30     
produce:pandoraShower:LArPandoraShowerCreation         0.352607       1.40878       2.98044       1.32998      0.706999        30     
produce:pandoracalo:Calorimetry                        0.202645      0.617728       1.01873      0.602143      0.210876        30     
produce:pandoracalonosce:Calorimetry                   0.174352      0.570839      0.968694      0.547773      0.202225        30     
produce:pandorapid:Chi2ParticleID                     0.00107348    0.00190842    0.00364521    0.00184628    0.00043492       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.320914       1.21683       2.85062       1.15886      0.596043        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.311231       1.17798       2.72248       1.11768      0.568828        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.07905      0.132993      0.187051      0.134661      0.0285468       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.028621      0.0474116     0.0667291      0.04805     0.00958755       30     
produce:emtrkmichelid:EmTrackMichelId                   13.9177       26.5699       40.5377       27.2292       5.84363        30     
[art]:TriggerResults:TriggerResultInserter             1.602e-05    2.02332e-05   7.8267e-05    1.8139e-05    1.0853e-05       30     
end_path:out1:RootOutput                               3.948e-06    5.19287e-06   2.0408e-05     4.669e-06    2.84745e-06      30     
end_path:michelremoving:michelremoving                 0.0126247     0.0598175     0.222581      0.0264652     0.0637545       30     
end_path:michelremovinggnocchi:michelremoving          0.0121059     0.0585267     0.218523      0.0253313     0.0629926       30     
end_path:calibanagnocchi:CalibAnaTree                  0.193463      0.473943      0.857731      0.440564      0.181769        30     
end_path:out1:RootOutput(write)                        0.461402      0.816031       1.23151      0.858958      0.170743        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4966.1 MB
  Peak resident set size usage (VmHWM): 2661.46 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup.root
\tHists: np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724006952.0,
    "core.end_time": 1724009652.0,
    "core.events": [
      90213,
      90221,
      90261,
      90269,
      90277,
      90285,
      90293,
      90301,
      90309,
      90317,
      90325,
      90333,
      90341,
      90349,
      90357,
      90365,
      90373,
      90381,
      90389,
      90397,
      90405,
      90413,
      90421,
      90429,
      90437,
      90445,
      90453,
      90461,
      90469,
      90477
    ],
    "core.event_count": 30,
    "core.first_event_number": 90213,
    "core.last_event_number": 90477,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840_reco_stage1_reco_stage2_20240818T193412_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724006952.0,
    "core.end_time": 1724009652.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0376_dataflow5_datawriter_0_20240818T151840.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:49:55 UTC       justIN version: 01.01.09