justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59505.54@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59505.54@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 00:05:24
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 01:08:59
From worker nodeHostnamewn-snel-007.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 00:07:08
Input fileshd-protodune:np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815.hdf5
JobscriptExit code0
Real time1h (3615s)
CPU time54m (3297s = 91%)
Outputting started2024-08-19 01:07:37
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup_hists.root
Finished2024-08-19 01:08:59
Saved logsjustin-logs:59505.54-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

rs
----view 0: 3.27229e-05 3.26633e-05 0.000377357 3.39746e-05 3.39746e-05 3.3915e-05 3.39746e-05 3.3915e-05 3.39746e-05 3.39746e-05 3.3915e-05 
----view 1: 0.000602424 0.00029844 0.000560105 0.000287414 0.000487149 0.000339448 0.000405192 0.000387728 0.000307977 0.000436604 0.000756264 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 3.26633e-05 0.000377357 3.39746e-05 3.39746e-05 3.3915e-05 3.39746e-05 3.3915e-05 3.39746e-05 3.39746e-05 3.3915e-05 3.39746e-05 
----view 1: 0.00029844 0.000560105 0.000287414 0.000487149 0.000339448 0.000405192 0.000387728 0.000307977 0.000436604 0.000756264 0.000402093 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 248159 TrkackID 6 startx, y, z 170.288 438.898 455.284  wireno, peakt tpcno 335 4257.39 5 dist 0min T, max_T2628.02 4929.41
no of hits closeby  1   event 248159 TrkackID 6 startx, y, z 170.288 438.898 455.284  wireno, peakt tpcno 335 4257.39 5 dist 0min T, max_T2628.02 4929.41
19-Aug-2024 03:07:14 CEST  Closed output file "np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup.root"
19-Aug-2024 03:07:14 CEST  Closed input file "np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              52.7334       82.6517       114.493       82.7288       15.1705        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000591719   0.00195584    0.00375543    0.00180312    0.000981465      30     
produce:fembfilter:PDHDFEMBFilter                      0.487745      0.554606       0.94399      0.498965      0.106857        30     
produce:wclsdatahd:WireCellToolkit                      27.8578       29.4169       36.4258       29.2865       1.55309        30     
produce:gaushit:GausHitFinder                          0.336503      0.598491       0.84026      0.598667      0.118699        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000219281   0.000389008   0.000819447   0.000353137   0.000129517      30     
produce:reco3d:SpacePointSolver                        0.159987      0.892412       2.32983      0.804173      0.545619        30     
produce:hitpdune:DisambigFromSpacePoints               0.164809       0.45206      0.914185      0.421022      0.167602        30     
produce:pandora:StandardPandora                         3.61111       17.3634       30.0058       16.5115       7.02107        30     
produce:pandoraWriter:StandardPandora                  0.0933311     0.148635      0.219593      0.154619      0.0343519       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.449331       1.17555       2.31785       1.11124      0.464174        30     
produce:pandoraShower:LArPandoraShowerCreation         0.515092       1.2907        3.33878       1.01898      0.733426        30     
produce:pandoracalo:Calorimetry                        0.271998      0.557404       1.1099       0.518952      0.206518        30     
produce:pandoracalonosce:Calorimetry                   0.238177      0.528607       1.02807      0.471715      0.218935        30     
produce:pandorapid:Chi2ParticleID                     0.000806172   0.00168983     0.003421     0.00157551    0.000543774      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.505887       1.16124       2.91927      0.942379      0.638192        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.485887       1.10216       2.67931      0.989533      0.573991        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0694138     0.117408      0.174392      0.116067      0.0263742       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0270197     0.0427107     0.0610193     0.0416103    0.00976435       30     
produce:emtrkmichelid:EmTrackMichelId                   15.6596       25.1367       35.7413       25.4477       5.08103        30     
[art]:TriggerResults:TriggerResultInserter            1.3145e-05    2.61945e-05   0.000100238   2.26975e-05    1.491e-05       30     
end_path:out1:RootOutput                               3.747e-06    6.19463e-06   2.9375e-05    5.4755e-06    4.37602e-06      30     
end_path:michelremoving:michelremoving                 0.0174886      0.11471      0.434843      0.0406215      0.11619        30     
end_path:michelremovinggnocchi:michelremoving          0.016692      0.112979      0.419312      0.037948      0.115105        30     
end_path:calibanagnocchi:CalibAnaTree                  0.315498       0.70513       1.39155      0.652062      0.287737        30     
end_path:out1:RootOutput(write)                        0.596397       1.04967       1.26107       1.08807      0.179125        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4955.14 MB
  Peak resident set size usage (VmHWM): 2632.4 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup.root
\tHists: np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724027110.0,
    "core.end_time": 1724029635.0,
    "core.events": [
      247927,
      247935,
      247943,
      247951,
      247959,
      247967,
      247975,
      247983,
      247991,
      247999,
      248007,
      248015,
      248023,
      248031,
      248039,
      248047,
      248055,
      248063,
      248071,
      248079,
      248087,
      248095,
      248103,
      248111,
      248119,
      248127,
      248135,
      248143,
      248151,
      248159
    ],
    "core.event_count": 30,
    "core.first_event_number": 247927,
    "core.last_event_number": 248159,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815_reco_stage1_reco_stage2_20240819T010714_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724027110.0,
    "core.end_time": 1724029635.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1033_dataflow7_datawriter_0_20240818T222815.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:07:55 UTC       justIN version: 01.01.09