justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244643.109@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244643.109@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 21:21:08
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-18 23:06:14
From worker nodeHostnamewn-sate-008.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 21:37:07
Input fileshd-protodune:np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359.hdf5
JobscriptExit code0
Real time1h (5278s)
CPU time1h (4974s = 94%)
Outputting started2024-08-18 23:05:06
Output fileshd-protodune-det-reco:np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup_hists.root
Finished2024-08-18 23:06:14
Saved logsjustin-logs:244643.109-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ticks
wclsFrameSaver: saving 74412 traces tagged "gauss"
FrameSaver: q=1.56281e+06 n=1328934 tag=gauss
wclsFrameSaver: saving 100917 traces tagged "wiener"
FrameSaver: q=1.66592e+06 n=1182809 tag=wiener
6980 hits in TPC 0
6011 hits in TPC 1
5130 hits in TPC 2
3593 hits in TPC 3
7181 hits in TPC 4
11771 hits in TPC 5
5969 hits in TPC 6
3726 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1778 XUs and 1794 XVs -> 125 XUVs
C:0 T:2 9798 XUs and 13023 XVs -> 729 XUVs
C:0 T:3 269 XUs and 437 XVs -> 10 XUVs
C:0 T:4 647 XUs and 1149 XVs -> 18 XUVs
C:0 T:5 47499 XUs and 63554 XVs -> 1597 XUVs
C:0 T:6 23373 XUs and 11314 XVs -> 405 XUVs
C:0 T:7 32 XUs and 59 XVs -> 2 XUVs
2886 XUVs total
1894 collection wire objects
2886 potential space points
Neighbour search...
35094 tests to find 19928 neighbours
Iterating with no regularization...
Begin: 7.93778e+06
0 7.56425e+06
1 7.55086e+06
2 7.55019e+06
Now with regularization...
Begin: 6.82139e+06
0 6.8211e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 01:04:57 CEST  Closed output file "np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup.root"
19-Aug-2024 01:04:57 CEST  Closed input file "np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              87.7454       134.283       235.242       132.807       31.5852        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000693051   0.00276799    0.00528457    0.00270739    0.00118853       30     
produce:fembfilter:PDHDFEMBFilter                      0.667741      0.684779      0.701956      0.684483     0.00961936       30     
produce:wclsdatahd:WireCellToolkit                      35.5712       40.9395       48.0545       38.7201       4.58064        30     
produce:gaushit:GausHitFinder                          0.541679      0.887171       1.29892       0.89225      0.175029        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000265218   0.000388673   0.00059195    0.000377208   6.72263e-05      30     
produce:reco3d:SpacePointSolver                         0.35958       1.41403       4.55462       0.99535       1.02228        30     
produce:hitpdune:DisambigFromSpacePoints               0.237152      0.670478       1.57006      0.635866      0.285738        30     
produce:pandora:StandardPandora                         6.06109       25.9264       74.786        23.0842       14.2704        30     
produce:pandoraWriter:StandardPandora                   0.11637      0.205098      0.305842      0.204765      0.0415185       30     
produce:pandoraTrack:LArPandoraTrackCreation            0.84209       2.6108        5.78727       2.50066       1.10981        30     
produce:pandoraShower:LArPandoraShowerCreation         0.863496       3.04787       8.40187       2.83204       1.66214        30     
produce:pandoracalo:Calorimetry                        0.415893       1.13951       2.75701       1.06749      0.486087        30     
produce:pandoracalonosce:Calorimetry                   0.376611       1.06539       2.72689      0.968895      0.479237        30     
produce:pandorapid:Chi2ParticleID                     0.00137563    0.00235219    0.00337061     0.002362     0.00043096       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.793413       2.47501       7.30763       2.26642       1.40734        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.755138       2.38829       7.26085       2.12088       1.40852        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.115877       0.17078      0.238663      0.162937      0.033527        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0391144     0.0606953     0.0873595     0.0591126     0.0117554       30     
produce:emtrkmichelid:EmTrackMichelId                   30.0087       48.2943       75.2985       47.5708       10.117         30     
[art]:TriggerResults:TriggerResultInserter            2.9535e-05    5.08031e-05   0.000103023   4.9748e-05    1.64383e-05      30     
end_path:out1:RootOutput                               7.614e-06    1.22487e-05   3.3824e-05    1.0259e-05    5.70336e-06      30     
end_path:michelremoving:michelremoving                  0.0294       0.0932085     0.250826      0.0534377     0.0645669       30     
end_path:michelremovinggnocchi:michelremoving          0.026725      0.0891892     0.245704      0.0497551     0.0647217       30     
end_path:calibanagnocchi:CalibAnaTree                  0.325107      0.826546       1.99573      0.777655      0.385902        30     
end_path:out1:RootOutput(write)                        0.692744       1.1027        1.58423       1.09697      0.212105        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4969.78 MB
  Peak resident set size usage (VmHWM): 2653.46 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup.root
\tHists: np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724018227.0,
    "core.end_time": 1724022298.0,
    "core.events": [
      214082,
      214090,
      214098,
      214106,
      214114,
      214122,
      214130,
      214138,
      214146,
      214154,
      214162,
      214170,
      214178,
      214186,
      214194,
      214202,
      214210,
      214218,
      214226,
      214234,
      214242,
      214250,
      214258,
      214266,
      214274,
      214282,
      214290,
      214298,
      214306,
      214314
    ],
    "core.event_count": 30,
    "core.first_event_number": 214082,
    "core.last_event_number": 214314,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359_reco_stage1_reco_stage2_20240818T230457_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724018227.0,
    "core.end_time": 1724022298.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0892_dataflow2_datawriter_0_20240818T210359.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:24:54 UTC       justIN version: 01.01.08