justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 76829.91@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID76829.91@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3392
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 21:49:17
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2024-09-25 06:26:49
From worker nodeHostnamewn-200-13-21-06-a.cr.cnaf.infn.it
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 01:19:40
Input fileshd-protodune:np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002.hdf5
JobscriptExit code0
Real time5h (18128s)
CPU time4h (17415s = 96%)
Outputting started2024-09-25 06:21:49
Output fileshd-protodune-det-reco:np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup.root
hd-protodune-det-reco:np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup_hists.root
Finished2024-09-25 06:26:49
Saved logsjustin-logs:76829.91-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66899 traces, 66899 summary
Retagger: tagging trace set: gauss with 52238 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52238 traces tagged "gauss"
FrameSaver: q=1.13947e+06 n=996187 tag=gauss
wclsFrameSaver: saving 66899 traces tagged "wiener"
FrameSaver: q=1.22945e+06 n=906655 tag=wiener
4467 hits in TPC 0
3512 hits in TPC 1
6664 hits in TPC 2
5165 hits in TPC 3
2495 hits in TPC 4
4357 hits in TPC 5
5262 hits in TPC 6
3728 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 15010 XUs and 19618 XVs -> 3805 XUVs
C:0 T:2 32901 XUs and 26561 XVs -> 814 XUVs
C:0 T:3 123 XUs and 186 XVs -> 4 XUVs
C:0 T:4 30 XUs and 29 XVs -> 0 XUVs
C:0 T:5 11289 XUs and 5933 XVs -> 214 XUVs
C:0 T:6 10635 XUs and 13619 XVs -> 526 XUVs
C:0 T:7 25 XUs and 23 XVs -> 0 XUVs
5363 XUVs total
1227 collection wire objects
5363 potential space points
Neighbour search...
566061 tests to find 308078 neighbours
Iterating with no regularization...
Begin: 8.57243e+06
0 8.23737e+06
1 8.22169e+06
2 8.22094e+06
Now with regularization...
Begin: 7.78837e+06
0 7.78785e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

25-Sep-2024 08:21:20 CEST  Closed output file "np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup.root"
25-Sep-2024 08:21:20 CEST  Closed input file "np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              325.914       472.543       999.959       453.369       125.886        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00139073    0.00728962     0.0187272    0.00700007    0.00372603       30     
produce:fembfilter:PDHDFEMBFilter                       2.16046       2.96546       5.57736       2.98888      0.698412        30     
produce:wclsdatahd:WireCellToolkit                      196.835       214.613       234.064       213.639        7.223         30     
produce:gaushit:GausHitFinder                           1.41412       3.1579        4.93765       3.12527      0.778933        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000644778   0.00102729    0.00139143    0.00101593    0.000191892      30     
produce:reco3d:SpacePointSolver                        0.709021       4.19194       37.5871       2.51043       6.74296        30     
produce:hitpdune:DisambigFromSpacePoints               0.661481       3.29762       11.4679       2.71161       2.6306         30     
produce:pandora:StandardPandora                         20.3728       75.0252       538.765       52.3623       90.4531        30     
produce:pandoraWriter:StandardPandora                  0.315395      0.568349       1.02439      0.563659      0.167614        30     
produce:pandoraTrack:LArPandoraTrackCreation            3.10589       7.27463       16.4035       6.5453        3.28957        30     
produce:pandoraShower:LArPandoraShowerCreation          2.96297       9.25729       21.0592        9.028        4.37238        30     
produce:pandoracalo:Calorimetry                         1.37626       3.48405       7.3035        3.2103        1.42139        30     
produce:pandoracalonosce:Calorimetry                    1.34819       3.20162       7.28521       3.01698       1.3665         30     
produce:pandorapid:Chi2ParticleID                     0.00431393    0.00774754     0.0116233    0.00766824    0.00179206       30     
produce:pandoraShowercalo:ShowerCalorimetry             2.46895       8.10351       21.7243       8.23816       4.04815        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        2.3937        7.89697       21.1685       7.70995       4.02218        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.269895      0.585294      0.927134      0.566983      0.157283        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0863754     0.220908      0.334337      0.213895      0.0647618       30     
produce:emtrkmichelid:EmTrackMichelId                   74.7096       121.477       182.15        121.685       25.6217        30     
[art]:TriggerResults:TriggerResultInserter            8.3158e-05    0.000131155   0.000282336   0.000129021   3.22028e-05      30     
end_path:out1:RootOutput                              2.7043e-05    3.64054e-05   8.5356e-05    3.56475e-05   1.01773e-05      30     
end_path:michelremoving:michelremoving                 0.0994139     0.439032       2.11604      0.182318      0.470039        30     
end_path:michelremovinggnocchi:michelremoving          0.085397      0.420706       2.09879      0.172692      0.461825        30     
end_path:calibanagnocchi:CalibAnaTree                   1.13457       2.73013       7.20441       2.57038       1.29708        30     
end_path:out1:RootOutput(write)                         1.4812        3.25492       6.28442       3.10747      0.958348        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4921.04 MB
  Peak resident set size usage (VmHWM): 2334.96 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup.root
\tHists: np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727230942.0,
    "core.end_time": 1727245282.0,
    "core.events": [
      3841,
      3849,
      3857,
      3865,
      3873,
      3881,
      3889,
      3897,
      3905,
      3913,
      3921,
      3929,
      3937,
      3945,
      3953,
      3961,
      3969,
      3977,
      3985,
      3993,
      4001,
      4009,
      4017,
      4025,
      4033,
      4041,
      4049,
      4057,
      4065,
      4073
    ],
    "core.event_count": 30,
    "core.first_event_number": 3841,
    "core.last_event_number": 4073,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29037
    ],
    "core.runs_subruns": [
      2903700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002_reco_stage1_reco_stage2_20240925T062120_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727230942.0,
    "core.end_time": 1727245282.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29037
    ],
    "core.runs_subruns": [
      2903700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029037_0016_dataflow1_datawriter_0_20240902T114002.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:46:35 UTC       justIN version: 01.01.09