justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244743.61@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244743.61@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 05:02:27
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2024-08-19 06:04:45
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 05:04:03
Input fileshd-protodune:np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702.hdf5
JobscriptExit code0
Real time59m (3547s)
CPU time53m (3202s = 90%)
Outputting started2024-08-19 06:03:12
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup_hists.root
Finished2024-08-19 06:04:30
Saved logsjustin-logs:244743.61-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86698e-05 
----view 1: 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 
----view 1: 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 0.000557065 0 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86698e-05 2.86102e-05 2.86698e-05 2.86698e-05 
----view 1: 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.25441e-05 3.24845e-05 3.24845e-05 3.25441e-05 0.000557065 0 0 
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 08:03:01 CEST  Closed output file "np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup.root"
19-Aug-2024 08:03:01 CEST  Closed input file "np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              47.0524       79.6747       116.777       80.3461       16.6594        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000348011   0.00168483    0.00370291    0.00149442    0.000836856      30     
produce:fembfilter:PDHDFEMBFilter                      0.494943       0.56795      0.894674      0.507004      0.113752        30     
produce:wclsdatahd:WireCellToolkit                      27.1941       28.385        29.9172       28.4817      0.758427        30     
produce:gaushit:GausHitFinder                          0.317143      0.581443      0.848318      0.594629      0.137181        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000178133   0.000346869   0.000668261    0.0003469    0.000101768      30     
produce:reco3d:SpacePointSolver                        0.0958857     0.768681       1.82131      0.712791      0.444838        30     
produce:hitpdune:DisambigFromSpacePoints               0.105205       0.44757      0.853579      0.459857      0.194993        30     
produce:pandora:StandardPandora                         3.71784       15.9845       41.797        15.0362       8.53703        30     
produce:pandoraWriter:StandardPandora                  0.0606797     0.140711      0.205446      0.142434      0.0363539       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.248289       1.11677       2.0331        1.09021      0.503545        30     
produce:pandoraShower:LArPandoraShowerCreation          0.27342       1.23199       2.99037       1.2139        0.60686        30     
produce:pandoracalo:Calorimetry                         0.14451      0.539462      0.915616       0.53168      0.199838        30     
produce:pandoracalonosce:Calorimetry                   0.123847      0.493109      0.856803      0.484788      0.191874        30     
produce:pandorapid:Chi2ParticleID                     0.000930562   0.00160465    0.00255218     0.0015846    0.000375839      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.23603       1.05997       2.29177       1.04793      0.477255        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.230679       1.02777       2.21445       1.01715      0.462261        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0542018     0.115987      0.168263       0.12124      0.0264534       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0188406     0.0410578     0.057279      0.0422372    0.00946876       30     
produce:emtrkmichelid:EmTrackMichelId                   12.8145       25.0297       32.7517       26.2037       5.30518        30     
[art]:TriggerResults:TriggerResultInserter            1.8255e-05    2.25466e-05   7.9699e-05    2.0118e-05    1.08283e-05      30     
end_path:out1:RootOutput                               4.077e-06    5.2642e-06     2.681e-05     4.523e-06    4.01138e-06      30     
end_path:michelremoving:michelremoving                 0.0166787     0.104893      0.491958      0.0362244     0.134363        30     
end_path:michelremovinggnocchi:michelremoving          0.0154354     0.104503      0.485532      0.0355276     0.134511        30     
end_path:calibanagnocchi:CalibAnaTree                  0.162758      0.746076       1.38318      0.746814      0.302465        30     
end_path:out1:RootOutput(write)                        0.632023       1.07538       1.42339       1.08188      0.174644        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4947.28 MB
  Peak resident set size usage (VmHWM): 2626.7 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup.root
\tHists: np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724044958.0,
    "core.end_time": 1724047382.0,
    "core.events": [
      320885,
      320893,
      320901,
      320909,
      320917,
      320925,
      320933,
      320941,
      320949,
      320957,
      320965,
      320973,
      320981,
      320989,
      320997,
      321005,
      321013,
      321021,
      321029,
      321037,
      321045,
      321053,
      321061,
      321069,
      321077,
      321085,
      321093,
      321101,
      321109,
      321125
    ],
    "core.event_count": 30,
    "core.first_event_number": 320885,
    "core.last_event_number": 321125,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702_reco_stage1_reco_stage2_20240819T060301_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724044958.0,
    "core.end_time": 1724047382.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1337_dataflow5_datawriter_0_20240819T013702.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:10:59 UTC       justIN version: 01.01.09