justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262672.73@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262672.73@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 02:34:42
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-09-26 06:35:04
From worker nodeHostnamen231.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:41:30
Input fileshd-protodune:np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209.hdf5
JobscriptExit code0
Real time1h (5999s)
CPU time1h (4047s = 67%)
Outputting started2024-09-26 05:21:35
Output fileshd-protodune-det-reco:np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup_hists.root
Finished2024-09-26 06:35:04
Saved logsjustin-logs:262672.73-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 5
6298 hits in TPC 6
4388 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3188 XUs and 3191 XVs -> 220 XUVs
C:0 T:2 29520 XUs and 27606 XVs -> 1127 XUVs
C:0 T:3 95 XUs and 108 XVs -> 4 XUVs
C:0 T:4 26 XUs and 23 XVs -> 1 XUVs
C:0 T:5 12037 XUs and 9587 XVs -> 241 XUVs
C:0 T:6 25075 XUs and 26461 XVs -> 2524 XUVs
C:0 T:7 165 XUs and 160 XVs -> 13 XUVs
4130 XUVs total
1509 collection wire objects
4130 potential space points
Neighbour search...
146012 tests to find 88458 neighbours
Iterating with no regularization...
Begin: 1.39189e+07
0 1.33435e+07
1 1.33051e+07
2 1.32992e+07
Now with regularization...
Begin: 1.24599e+07
0 1.24567e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  4   event 498022 TrkackID 12 startx, y, z 29.46 354.28 448.075  wireno, peakt tpcno 69 3275.99 5 dist 1.15902min T, max_T3186.76 3544.94
no of hits closeby  4   event 498022 TrkackID 12 startx, y, z 29.46 354.28 448.075  wireno, peakt tpcno 69 3275.99 5 dist 1.15902min T, max_T3186.76 3544.94
26-Sep-2024 06:21:19 BST  Closed output file "np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup.root"
26-Sep-2024 06:21:19 BST  Closed input file "np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.0614       99.0109       151.176       94.9346       20.1257        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000323398   0.00123993     0.0038687    0.000965086   0.00087722       30     
produce:fembfilter:PDHDFEMBFilter                      0.796301      0.895335       1.30645      0.812418      0.167264        30     
produce:wclsdatahd:WireCellToolkit                      42.5965       47.808        65.2384       45.2669       6.15261        30     
produce:gaushit:GausHitFinder                          0.548071      0.861715       1.24529      0.816538      0.200665        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000275052   0.000398259   0.000742843   0.000385149   8.95232e-05      30     
produce:reco3d:SpacePointSolver                        0.307979       1.39425       10.6612      0.847098       1.92668        30     
produce:hitpdune:DisambigFromSpacePoints               0.288564      0.714959       1.43307      0.711163      0.291224        30     
produce:pandora:StandardPandora                         6.12788       15.051        35.3502       13.012        6.86865        30     
produce:pandoraWriter:StandardPandora                   0.11282      0.178961      0.307682      0.172589      0.0436581       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.831798       1.97725       3.84985       1.91646      0.719087        30     
produce:pandoraShower:LArPandoraShowerCreation         0.906431       2.27662       4.79221       2.28148      0.960867        30     
produce:pandoracalo:Calorimetry                        0.370398      0.831981       1.50652      0.795151      0.276871        30     
produce:pandoracalonosce:Calorimetry                   0.336781      0.766719       1.40931      0.736675      0.258966        30     
produce:pandorapid:Chi2ParticleID                     0.00138738    0.00205584    0.00562738    0.00190493    0.000766864      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.655296       1.90397       4.47998       1.86133      0.815599        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.644483       1.86493       4.36612       1.8091       0.788686        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0859933     0.149364      0.279765      0.140483      0.0425712       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0346792     0.0580582     0.111803      0.0556514     0.016669        30     
produce:emtrkmichelid:EmTrackMichelId                   13.3149       20.4138       32.0702       20.031        4.12788        30     
[art]:TriggerResults:TriggerResultInserter            2.9908e-05    3.90257e-05   0.000112772   3.63285e-05   1.42357e-05      30     
end_path:out1:RootOutput                               7.332e-06     1.058e-05    4.0699e-05    9.1675e-06    5.83802e-06      30     
end_path:michelremoving:michelremoving                 0.0253843     0.0779588     0.246267      0.0463981     0.0586279       30     
end_path:michelremovinggnocchi:michelremoving          0.0234673     0.0751608     0.237854      0.043154      0.0587307       30     
end_path:calibanagnocchi:CalibAnaTree                  0.265343      0.612857       1.13973      0.578103      0.210887        30     
end_path:out1:RootOutput(write)                        0.585023      0.933607       1.52963       0.90207      0.231048        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5858.14 MB
  Peak resident set size usage (VmHWM): 2963.85 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup.root
\tHists: np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727325056.0,
    "core.end_time": 1727328079.0,
    "core.events": [
      497790,
      497798,
      497806,
      497814,
      497822,
      497830,
      497838,
      497846,
      497854,
      497862,
      497870,
      497878,
      497886,
      497894,
      497902,
      497910,
      497918,
      497926,
      497934,
      497942,
      497950,
      497958,
      497966,
      497974,
      497982,
      497990,
      497998,
      498006,
      498014,
      498022
    ],
    "core.event_count": 30,
    "core.first_event_number": 497790,
    "core.last_event_number": 498022,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209_reco_stage1_reco_stage2_20240926T052119_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727325056.0,
    "core.end_time": 1727328079.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2074_dataflow6_datawriter_0_20240908T012209.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:35 UTC       justIN version: 01.01.08