justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264561.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264561.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3520
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 02:39:23
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2024-09-27 03:53:59
From worker nodeHostnamedune001-2144434.0-lcg2714.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 02:40:56
Input fileshd-protodune:np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754.hdf5
JobscriptExit code0
Real time1h (4286s)
CPU time1h (3728s = 86%)
Outputting started2024-09-27 03:52:23
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup_hists.root
Finished2024-09-27 03:53:59
Saved logsjustin-logs:264561.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2364 XUs and 2257 XVs -> 67 XUVs
C:0 T:2 128494 XUs and 118942 XVs -> 2216 XUVs
C:0 T:3 775 XUs and 826 XVs -> 16 XUVs
C:0 T:4 98 XUs and 61 XVs -> 5 XUVs
C:0 T:5 68612 XUs and 41670 XVs -> 2278 XUVs
C:0 T:6 136640 XUs and 181625 XVs -> 5061 XUVs
C:0 T:7 161 XUs and 138 XVs -> 8 XUVs
9651 XUVs total
2085 collection wire objects
9651 potential space points
Neighbour search...
639563 tests to find 326726 neighbours
Iterating with no regularization...
Begin: 3.23389e+07
0 2.62527e+07
1 2.58522e+07
2 2.57831e+07
3 2.57583e+07
Now with regularization...
Begin: 2.50704e+07
0 2.50535e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 4991 TrkackID 15 startx, y, z 100.523 595.979 197.46  wireno, peakt tpcno 346 1548.02 2 dist 188.807min T, max_T6.20254 1571.91
no of hits closeby  0   event 4991 TrkackID 15 startx, y, z 100.523 595.979 197.46  wireno, peakt tpcno 346 1548.02 2 dist 188.807min T, max_T6.20254 1571.91
27-Sep-2024 03:52:09 UTC  Closed output file "np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup.root"
27-Sep-2024 03:52:09 UTC  Closed input file "np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              46.7307        74.75        127.359       74.477        16.6417        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000356237   0.00157837     0.006002     0.00110588    0.00136159       39     
produce:fembfilter:PDHDFEMBFilter                      0.554725      0.674053       0.73644      0.680756      0.0334178       39     
produce:wclsdatahd:WireCellToolkit                      30.4325       33.702        36.5266       33.6621       1.38975        39     
produce:gaushit:GausHitFinder                          0.391244      0.705962       1.16478      0.724489      0.195151        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000171939   0.000297831   0.000555897   0.000277428   7.15372e-05      39     
produce:reco3d:SpacePointSolver                        0.0886181      1.60866       8.34055      0.702692       2.05393        39     
produce:hitpdune:DisambigFromSpacePoints               0.145353      0.539742       1.21623      0.508176       0.27094        39     
produce:pandora:StandardPandora                         3.58778       12.2068       33.0338       10.9379       6.23604        39     
produce:pandoraWriter:StandardPandora                  0.101116      0.167336      0.253143      0.160353      0.0436651       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.404949       1.38252       3.4809        1.16322      0.680791        39     
produce:pandoraShower:LArPandoraShowerCreation         0.397474       1.63024       5.31342       1.35911       0.96588        39     
produce:pandoracalo:Calorimetry                        0.227451      0.655036       1.78318      0.616525      0.299536        39     
produce:pandoracalonosce:Calorimetry                   0.181254       0.57123       1.58913      0.519386      0.263492        39     
produce:pandorapid:Chi2ParticleID                     0.00116578    0.00197864    0.00381193    0.00188494    0.000514137      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.361605       1.31038       5.08774       1.09707      0.824813        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.359883       1.29456       5.7003        1.07895      0.887824        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0740137      0.15291      0.302037      0.146607      0.0483751       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0256044     0.0509099     0.0756845     0.0497825     0.0131051       39     
produce:emtrkmichelid:EmTrackMichelId                   8.37067       16.3695       24.8678       15.6811       4.24912        39     
[art]:TriggerResults:TriggerResultInserter            3.0255e-05    6.14338e-05   0.000118909   6.5198e-05    2.10833e-05      39     
end_path:out1:RootOutput                               4.317e-06    1.23481e-05    3.338e-05    1.1207e-05    5.39972e-06      39     
end_path:michelremoving:michelremoving                 0.0179674     0.0952617     0.344851      0.0369728     0.0935645       39     
end_path:michelremovinggnocchi:michelremoving          0.0146442     0.0913082     0.333758      0.0371539     0.091598        39     
end_path:calibanagnocchi:CalibAnaTree                  0.148745      0.465754       1.16129      0.423692      0.220092        39     
end_path:out1:RootOutput(write)                        0.420977       0.7822        1.18228      0.787606      0.213115        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6144.22 MB
  Peak resident set size usage (VmHWM): 3025.92 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup.root
\tHists: np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727406157.0,
    "core.end_time": 1727409129.0,
    "core.events": [
      4915,
      4917,
      4919,
      4921,
      4923,
      4925,
      4927,
      4929,
      4931,
      4933,
      4935,
      4937,
      4939,
      4941,
      4943,
      4945,
      4947,
      4949,
      4951,
      4953,
      4955,
      4957,
      4959,
      4961,
      4963,
      4965,
      4967,
      4969,
      4971,
      4973,
      4975,
      4977,
      4979,
      4981,
      4983,
      4985,
      4987,
      4989,
      4991
    ],
    "core.event_count": 39,
    "core.first_event_number": 4915,
    "core.last_event_number": 4991,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754_reco_stage1_reco_stage2_20240927T035209_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727406157.0,
    "core.end_time": 1727409129.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0063_dataflow1_datawriter_0_20240927T013754.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:23:01 UTC       justIN version: 01.01.08