justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79668.4@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79668.4@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3520
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 00:37:13
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2024-09-27 02:33:16
From worker nodeHostnamedune001-2143182.0-lcg2388.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 00:59:53
Input fileshd-protodune:np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657.hdf5
JobscriptExit code0
Real time1h (5501s)
CPU time1h (4943s = 89%)
Outputting started2024-09-27 02:31:35
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup_hists.root
Finished2024-09-27 02:33:16
Saved logsjustin-logs:79668.4-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

9257 XVs -> 210 XUVs
C:0 T:3 368 XUs and 739 XVs -> 15 XUVs
C:0 T:4 313 XUs and 366 XVs -> 7 XUVs
C:0 T:5 28740 XUs and 16660 XVs -> 649 XUVs
C:0 T:6 22104 XUs and 24267 XVs -> 934 XUVs
C:0 T:7 119 XUs and 154 XVs -> 5 XUVs
1898 XUVs total
1257 collection wire objects
1898 potential space points
Neighbour search...
19734 tests to find 11550 neighbours
Iterating with no regularization...
Begin: 9.23376e+06
0 8.97287e+06
1 8.96323e+06
2 8.96256e+06
Now with regularization...
Begin: 8.47656e+06
0 8.4764e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 4445 TrkackID 0 startx, y, z 189.546 600.789 373.241  wireno, peakt tpcno 395 10.6691 5 dist 0min T, max_T6 3604
no of hits closeby  5   event 4445 TrkackID 1 startx, y, z -29.7119 590.216 420.857  wireno, peakt tpcno 118 8.03266 2 dist 0min T, max_T1.49157 1674.65
no of hits closeby  0   event 4445 TrkackID 0 startx, y, z 189.546 600.789 373.241  wireno, peakt tpcno 395 10.6691 5 dist 0min T, max_T6 3604
no of hits closeby  5   event 4445 TrkackID 1 startx, y, z -29.7119 590.216 420.857  wireno, peakt tpcno 118 8.03266 2 dist 0min T, max_T1.49157 1674.65
27-Sep-2024 02:31:18 UTC  Closed output file "np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup.root"
27-Sep-2024 02:31:18 UTC  Closed input file "np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.7981       101.603       133.839       97.8192       15.9259        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000724077   0.00337506    0.00794938    0.00364739    0.00134458       39     
produce:fembfilter:PDHDFEMBFilter                      0.559186      0.764515      0.890733      0.776114      0.0588876       39     
produce:wclsdatahd:WireCellToolkit                      39.1592       42.562        48.0378       41.9655       2.15651        39     
produce:gaushit:GausHitFinder                          0.534772      0.807903       1.12245      0.811708      0.156067        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000325725   0.000454922   0.000739936   0.000422728   9.16282e-05      39     
produce:reco3d:SpacePointSolver                        0.280776       1.64858       9.1216       0.745192       1.99731        39     
produce:hitpdune:DisambigFromSpacePoints               0.242336      0.602363       1.32106      0.594578      0.232641        39     
produce:pandora:StandardPandora                         7.07764       14.238        26.7394       13.8359       5.08718        39     
produce:pandoraWriter:StandardPandora                  0.120081      0.201533      0.276195      0.198054      0.0408758       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.538124       1.68979       3.38736       1.47343      0.717797        39     
produce:pandoraShower:LArPandoraShowerCreation         0.460178       1.91403       3.89591       1.86813      0.885967        39     
produce:pandoracalo:Calorimetry                        0.288133      0.793979       1.5529       0.765959      0.274748        39     
produce:pandoracalonosce:Calorimetry                   0.244986      0.728799       1.43219      0.703291      0.257057        39     
produce:pandorapid:Chi2ParticleID                     0.00150403    0.00254956    0.00437942    0.00250326    0.000500815      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.381154       1.66619       3.19253       1.79749      0.698946        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.357816       1.65137       3.15888       1.81532      0.725719        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0740471     0.191548      0.281921      0.198887      0.0420881       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0244302     0.0649962     0.102535      0.0681313     0.0143153       39     
produce:emtrkmichelid:EmTrackMichelId                   17.5725       30.1571       42.2127       29.0301       5.80089        39     
[art]:TriggerResults:TriggerResultInserter            3.9144e-05    7.48283e-05   0.000114566    7.423e-05    1.9316e-05       39     
end_path:out1:RootOutput                               6.982e-06    1.65117e-05   4.1278e-05    1.3786e-05    8.53891e-06      39     
end_path:michelremoving:michelremoving                 0.022696      0.111171      0.391106      0.0586871     0.0924283       39     
end_path:michelremovinggnocchi:michelremoving          0.0198277     0.105573      0.383387      0.0508561     0.093519        39     
end_path:calibanagnocchi:CalibAnaTree                  0.216908      0.558333       1.03033      0.571462       0.19733        39     
end_path:out1:RootOutput(write)                        0.527254      0.949721       1.28192       1.0086       0.171824        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4936.18 MB
  Peak resident set size usage (VmHWM): 2595.92 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup.root
\tHists: np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727400235.0,
    "core.end_time": 1727404283.0,
    "core.events": [
      4369,
      4371,
      4373,
      4375,
      4377,
      4379,
      4381,
      4383,
      4385,
      4387,
      4389,
      4391,
      4393,
      4395,
      4397,
      4399,
      4401,
      4403,
      4405,
      4407,
      4409,
      4411,
      4413,
      4415,
      4417,
      4419,
      4421,
      4423,
      4425,
      4427,
      4429,
      4431,
      4433,
      4435,
      4437,
      4439,
      4441,
      4443,
      4445
    ],
    "core.event_count": 39,
    "core.first_event_number": 4369,
    "core.last_event_number": 4445,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657_reco_stage1_reco_stage2_20240927T023118_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727400235.0,
    "core.end_time": 1727404283.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0056_dataflow1_datawriter_0_20240927T000657.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:14:08 UTC       justIN version: 01.01.08