justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59502.75@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59502.75@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 22:21:23
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-18 23:42:41
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 22:32:13
Input fileshd-protodune:np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514.hdf5
JobscriptExit code0
Real time1h (4135s)
CPU time1h (3811s = 92%)
Outputting started2024-08-18 23:41:12
Output fileshd-protodune-det-reco:np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup_hists.root
Finished2024-08-18 23:42:25
Saved logsjustin-logs:59502.75-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

62 hits in TPC 0
2264 hits in TPC 1
2525 hits in TPC 2
2062 hits in TPC 3
2093 hits in TPC 4
4856 hits in TPC 5
3948 hits in TPC 6
2749 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 41 XUs and 32 XVs -> 0 XUVs
C:0 T:2 4255 XUs and 2551 XVs -> 77 XUVs
C:0 T:3 8 XUs and 9 XVs -> 0 XUVs
C:0 T:4 54 XUs and 102 XVs -> 10 XUVs
C:0 T:5 6093 XUs and 10339 XVs -> 574 XUVs
C:0 T:6 9587 XUs and 6337 XVs -> 225 XUVs
C:0 T:7 53 XUs and 45 XVs -> 5 XUVs
891 XUVs total
732 collection wire objects
891 potential space points
Neighbour search...
9897 tests to find 5276 neighbours
Iterating with no regularization...
Begin: 3.16823e+06
0 2.9904e+06
1 2.9833e+06
2 2.98276e+06
Now with regularization...
Begin: 2.77761e+06
0 2.77756e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 231359 TrkackID 19 startx, y, z 47.9096 181.105 453.194  wireno, peakt tpcno 340 5161.39 5 dist 0min T, max_T4966.92 5569.72
no of hits closeby  1   event 231359 TrkackID 19 startx, y, z 47.9096 181.105 453.194  wireno, peakt tpcno 340 5161.39 5 dist 0min T, max_T4966.92 5569.72
19-Aug-2024 01:41:00 CEST  Closed output file "np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup.root"
19-Aug-2024 01:41:00 CEST  Closed input file "np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.0053       97.9336       165.161       92.3132       21.2687        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000316022   0.00188522     0.0042926    0.00166195    0.00106183       30     
produce:fembfilter:PDHDFEMBFilter                      0.498225      0.572545      0.874356      0.537079      0.0897775       30     
produce:wclsdatahd:WireCellToolkit                      28.8965       34.8455       39.5353       35.9221       3.21776        30     
produce:gaushit:GausHitFinder                          0.403213      0.621193      0.996069      0.616975      0.126271        30     
produce:nhitsfilter:NumberOfHitsFilter                0.00024073    0.000371047   0.000549759   0.000348192   7.42296e-05      30     
produce:reco3d:SpacePointSolver                        0.095801       0.9713        4.0065       0.815593      0.817105        30     
produce:hitpdune:DisambigFromSpacePoints               0.146442      0.505425       1.38607      0.525844      0.232588        30     
produce:pandora:StandardPandora                         6.04905       21.6581       57.0662       17.4573       12.1756        30     
produce:pandoraWriter:StandardPandora                  0.0987499      0.15803      0.260113      0.151721      0.0329237       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.590408       1.41757       6.29534       1.12449       1.02046        30     
produce:pandoraShower:LArPandoraShowerCreation         0.636193       1.41561       4.95387       1.2335        0.81448        30     
produce:pandoracalo:Calorimetry                        0.313027       0.6689        2.46035      0.555646      0.386774        30     
produce:pandoracalonosce:Calorimetry                   0.279894      0.615682       2.33143      0.508568      0.370744        30     
produce:pandorapid:Chi2ParticleID                      0.001297     0.00184388    0.00374106    0.00166106    0.000512476      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.582542       1.27644       3.75026       1.10084       0.65395        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.569978       1.24657       3.55562       1.06046      0.642445        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0704064     0.121563      0.170814      0.121136      0.0255864       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0254749     0.0435958     0.058705      0.0443787    0.00867697       30     
produce:emtrkmichelid:EmTrackMichelId                   19.2676       29.5516       41.7429       28.7688       5.45076        30     
[art]:TriggerResults:TriggerResultInserter            1.9066e-05    2.39134e-05    7.969e-05    2.12145e-05   1.07894e-05      30     
end_path:out1:RootOutput                               4.198e-06    5.3444e-06    2.4215e-05    4.6585e-06    3.51629e-06      30     
end_path:michelremoving:michelremoving                 0.0232746     0.0642353     0.207289      0.0362022     0.0571263       30     
end_path:michelremovinggnocchi:michelremoving          0.0227994     0.0631447     0.206608      0.0349549     0.0578247       30     
end_path:calibanagnocchi:CalibAnaTree                  0.332598      0.823222       2.60019      0.688473      0.418074        30     
end_path:out1:RootOutput(write)                        0.883766       1.15918       1.42759       1.16891      0.136913        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4978.38 MB
  Peak resident set size usage (VmHWM): 2657.45 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup.root
\tHists: np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724021490.0,
    "core.end_time": 1724024460.0,
    "core.events": [
      231079,
      231087,
      231095,
      231103,
      231111,
      231119,
      231175,
      231183,
      231191,
      231199,
      231207,
      231215,
      231223,
      231231,
      231239,
      231247,
      231255,
      231263,
      231271,
      231279,
      231287,
      231295,
      231303,
      231311,
      231319,
      231327,
      231335,
      231343,
      231351,
      231359
    ],
    "core.event_count": 30,
    "core.first_event_number": 231079,
    "core.last_event_number": 231359,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514_reco_stage1_reco_stage2_20240818T234100_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724021490.0,
    "core.end_time": 1724024460.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0963_dataflow7_datawriter_0_20240818T214514.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:07:16 UTC       justIN version: 01.01.09