justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244713.40@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244713.40@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 02:25:31
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 03:30:14
From worker nodeHostnamewn-snel-007.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 02:27:27
Input fileshd-protodune:np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236.hdf5
JobscriptExit code0
Real time1h (3672s)
CPU time56m (3378s = 91%)
Outputting started2024-08-19 03:28:49
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup_hists.root
Finished2024-08-19 03:30:14
Saved logsjustin-logs:244713.40-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Vs -> 9 XUVs
C:0 T:5 2689 XUs and 2821 XVs -> 186 XUVs
C:0 T:6 42918 XUs and 99162 XVs -> 3512 XUVs
C:0 T:7 873 XUs and 1071 XVs -> 29 XUVs
5396 XUVs total
1908 collection wire objects
5396 potential space points
Neighbour search...
681090 tests to find 335094 neighbours
Iterating with no regularization...
Begin: 1.13867e+07
0 1.07274e+07
1 1.06917e+07
2 1.06887e+07
Now with regularization...
Begin: 1.03209e+07
0 1.03197e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 292320 TrkackID 19 startx, y, z 17.5926 592.219 180.237  wireno, peakt tpcno 365 2960.78 2 dist 220.874min T, max_T1319.3 2971.32
no of hits closeby  0   event 292320 TrkackID 19 startx, y, z 17.5926 592.219 180.237  wireno, peakt tpcno 365 2960.78 2 dist 220.874min T, max_T1319.3 2971.32
19-Aug-2024 05:28:29 CEST  Closed output file "np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup.root"
19-Aug-2024 05:28:29 CEST  Closed input file "np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.9977       85.5738       113.543       83.5069       14.6555        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000533701   0.00189989    0.00361761    0.00202711    0.00079253       30     
produce:fembfilter:PDHDFEMBFilter                      0.494929      0.548853      0.735725      0.502982      0.0718577       30     
produce:wclsdatahd:WireCellToolkit                      27.8177       29.5911       33.8051       29.3732       1.24945        30     
produce:gaushit:GausHitFinder                          0.405479      0.639987      0.814609      0.655641      0.116629        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000199665   0.000369157   0.000657603    0.0003733    8.72743e-05      30     
produce:reco3d:SpacePointSolver                        0.252726      0.909767       2.17915      0.807274      0.496752        30     
produce:hitpdune:DisambigFromSpacePoints               0.239215       0.49449      0.897899      0.475175      0.174133        30     
produce:pandora:StandardPandora                         8.16191       17.8634       36.3383       16.3349       7.53451        30     
produce:pandoraWriter:StandardPandora                  0.114115      0.158746      0.219314      0.159263      0.0300406       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.613305       1.33704       2.6612        1.21331      0.563589        30     
produce:pandoraShower:LArPandoraShowerCreation         0.528834       1.56634       3.11771       1.49705      0.673954        30     
produce:pandoracalo:Calorimetry                         0.33174      0.644174       1.25738      0.622524      0.228498        30     
produce:pandoracalonosce:Calorimetry                   0.289127      0.586597       1.18857      0.580298      0.207959        30     
produce:pandorapid:Chi2ParticleID                     0.00120375    0.00165368    0.00288802    0.00157519    0.000341485      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.521397       1.36958       2.98729       1.27143      0.579922        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.489962       1.35073       3.27233       1.21177      0.627197        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0712932     0.120065      0.172813      0.122008      0.0242159       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0257453     0.0436443     0.0615581     0.0437775    0.00876267       30     
produce:emtrkmichelid:EmTrackMichelId                   16.8993       26.0842       35.7521       25.1546       5.07355        30     
[art]:TriggerResults:TriggerResultInserter            1.3645e-05    2.85902e-05   7.5952e-05    2.51925e-05   1.17034e-05      30     
end_path:out1:RootOutput                               3.506e-06    5.93103e-06   2.2432e-05     5.175e-06    3.25356e-06      30     
end_path:michelremoving:michelremoving                 0.0202234     0.111061      0.557681      0.0446981     0.132748        30     
end_path:michelremovinggnocchi:michelremoving          0.0187745     0.108344      0.556917      0.0408177     0.133413        30     
end_path:calibanagnocchi:CalibAnaTree                  0.286301      0.806007       1.71846      0.790088      0.312659        30     
end_path:out1:RootOutput(write)                        0.628936       1.09634       1.35141       1.10549       0.16009        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4993.88 MB
  Peak resident set size usage (VmHWM): 2669.04 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup.root
\tHists: np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724035509.0,
    "core.end_time": 1724038110.0,
    "core.events": [
      292088,
      292096,
      292104,
      292112,
      292120,
      292128,
      292136,
      292144,
      292152,
      292160,
      292168,
      292176,
      292184,
      292192,
      292200,
      292208,
      292216,
      292224,
      292232,
      292240,
      292248,
      292256,
      292264,
      292272,
      292280,
      292288,
      292296,
      292304,
      292312,
      292320
    ],
    "core.event_count": 30,
    "core.first_event_number": 292088,
    "core.last_event_number": 292320,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236_reco_stage1_reco_stage2_20240819T032829_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724035509.0,
    "core.end_time": 1724038110.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1217_dataflow0_datawriter_0_20240819T002236.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:09:36 UTC       justIN version: 01.01.09