justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264225.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264225.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3461
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:22:32
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-26 18:04:16
From worker nodeHostnamewn5917301.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:23:17
Input fileshd-protodune:np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436.hdf5
JobscriptExit code0
Real time1h (5960s)
CPU time1h (5482s = 91%)
Outputting started2024-09-26 18:02:37
Output fileshd-protodune-det-reco:np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup.root
hd-protodune-det-reco:np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup_hists.root
Finished2024-09-26 18:04:16
Saved logsjustin-logs:264225.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XVs -> 844 XUVs
C:0 T:3 23 XUs and 33 XVs -> 3 XUVs
C:0 T:4 810 XUs and 1273 XVs -> 165 XUVs
C:0 T:5 13751 XUs and 11385 XVs -> 502 XUVs
C:0 T:6 6528 XUs and 9201 XVs -> 265 XUVs
C:0 T:7 277 XUs and 369 XVs -> 14 XUVs
1801 XUVs total
1020 collection wire objects
1801 potential space points
Neighbour search...
38425 tests to find 21502 neighbours
Iterating with no regularization...
Begin: 1.73488e+07
0 1.65873e+07
1 1.6522e+07
2 1.65114e+07
Now with regularization...
Begin: 1.5119e+07
0 1.51153e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  25   event 31079 TrkackID 5 startx, y, z 139.218 101.687 458.763  wireno, peakt tpcno 258 4338.49 5 dist 3.84765min T, max_T3528.42 5242.38
no of hits closeby  0   event 31079 TrkackID 17 startx, y, z 17.5159 586.631 277.01  wireno, peakt tpcno 0 2033 5 dist 0min T, max_T2033 3182.26
no of hits closeby  25   event 31079 TrkackID 5 startx, y, z 139.218 101.687 458.763  wireno, peakt tpcno 258 4338.49 5 dist 3.84765min T, max_T3528.42 5242.38
no of hits closeby  0   event 31079 TrkackID 17 startx, y, z 17.5159 586.631 277.01  wireno, peakt tpcno 0 2033 5 dist 0min T, max_T2033 3182.26
26-Sep-2024 19:02:24 BST  Closed output file "np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup.root"
26-Sep-2024 19:02:24 BST  Closed input file "np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              84.098        121.409       171.551       121.675       20.4093        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000618758    0.0028032    0.00481196    0.00285673    0.00124098       35     
produce:fembfilter:PDHDFEMBFilter                      0.770805       1.02053       1.18546       1.04059      0.0845104       35     
produce:wclsdatahd:WireCellToolkit                      42.2081       49.8869       55.7776       50.2113       3.56898        35     
produce:gaushit:GausHitFinder                          0.537632      0.987486       1.52806       1.03221      0.253858        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000346274   0.000456555   0.00063605    0.000468845   6.97593e-05      35     
produce:reco3d:SpacePointSolver                         0.28608      0.866957       1.92118      0.898923      0.393024        35     
produce:hitpdune:DisambigFromSpacePoints               0.262478      0.716549       1.63378      0.671429      0.298727        35     
produce:pandora:StandardPandora                         8.18478       18.8741       51.1768       17.104        8.26967        35     
produce:pandoraWriter:StandardPandora                   0.12817      0.236592      0.351397       0.24273      0.0555547       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.809065       1.8334        3.43197       1.66962      0.614284        35     
produce:pandoraShower:LArPandoraShowerCreation         0.571005       2.06653       5.15047       1.97998       0.92061        35     
produce:pandoracalo:Calorimetry                        0.385591      0.955672       1.71672      0.876598      0.322709        35     
produce:pandoracalonosce:Calorimetry                   0.347844      0.872867       1.4675       0.828624      0.291342        35     
produce:pandorapid:Chi2ParticleID                     0.00164672    0.00284776    0.00481352     0.0027055    0.000674427      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.482492       1.91194       4.44613       1.84047      0.817404        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.466852       1.78447       4.16064       1.77477      0.778086        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.097203      0.207198      0.295784      0.221249      0.0579132       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0330416     0.070157      0.0967736     0.0741817     0.0170367       35     
produce:emtrkmichelid:EmTrackMichelId                   20.5432       36.7546       49.8926       37.939         7.087         35     
[art]:TriggerResults:TriggerResultInserter            1.6832e-05    3.66509e-05   9.1052e-05    3.5908e-05    1.22556e-05      35     
end_path:out1:RootOutput                               4.077e-06    7.24703e-06   3.6178e-05     5.681e-06    6.01493e-06      35     
end_path:michelremoving:michelremoving                 0.0314477     0.152434      0.472943       0.16406      0.112761        35     
end_path:michelremovinggnocchi:michelremoving          0.0315022     0.150593      0.469216      0.160458      0.112147        35     
end_path:calibanagnocchi:CalibAnaTree                  0.260552      0.730847       1.3824       0.704323      0.238899        35     
end_path:out1:RootOutput(write)                        0.619226       1.16318       1.61204       1.18132      0.222797        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5007.2 MB
  Peak resident set size usage (VmHWM): 2674.11 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup.root
\tHists: np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369434.0,
    "core.end_time": 1727373745.0,
    "core.events": [
      30943,
      30947,
      30951,
      30955,
      30959,
      30963,
      30967,
      30971,
      30975,
      30979,
      30983,
      30987,
      30991,
      30995,
      30999,
      31003,
      31007,
      31011,
      31015,
      31019,
      31023,
      31027,
      31031,
      31035,
      31039,
      31043,
      31047,
      31051,
      31055,
      31059,
      31063,
      31067,
      31071,
      31075,
      31079
    ],
    "core.event_count": 35,
    "core.first_event_number": 30943,
    "core.last_event_number": 31079,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27298
    ],
    "core.runs_subruns": [
      2729800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436_reco_stage1_reco_stage2_20240926T180224_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369434.0,
    "core.end_time": 1727373745.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27298
    ],
    "core.runs_subruns": [
      2729800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027298_0221_dataflow3_datawriter_0_20240619T150436.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:20:11 UTC       justIN version: 01.01.09