justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269318.37@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269318.37@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3573
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 17:08:48
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-04 23:48:56
From worker nodeHostnamedunegli-4177378-0-fnpc22015.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 20:20:54
Input fileshd-protodune:np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641.hdf5
JobscriptExit code0
Real time3h (12409s)
CPU time2h (10544s = 84%)
Outputting started2024-10-04 23:47:45
Output fileshd-protodune-det-reco:np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup.root
hd-protodune-det-reco:np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup_hists.root
Finished2024-10-04 23:48:56
Saved logsjustin-logs:269318.37-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

1 event: 312 at 04-Oct-2024 23:46:03 UTC
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 133691 traces, 133691 summary
Retagger: tagging trace set: gauss with 168510 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 168510 traces tagged "gauss"
FrameSaver: q=8.63872e+08 n=16986506 tag=gauss
wclsFrameSaver: saving 133691 traces tagged "wiener"
FrameSaver: q=8.90171e+08 n=17390605 tag=wiener
63831 hits in TPC 0
04-Oct-2024 23:47:37 UTC  Closed output file "np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup.root"
04-Oct-2024 23:47:37 UTC  Closed input file "np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0033811      76.1847       200.861       87.6137       64.1984        122    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000172847   0.00208055    0.00631963    0.00174668    0.00168922       122    
produce:fembfilter:PDHDFEMBFilter                     6.4943e-05     0.293858      0.944484      0.210497      0.314464        122    
produce:wclsdatahd:WireCellToolkit                      25.9375       87.8204       152.162       99.1625       44.368         77     
produce:gaushit:GausHitFinder                          0.369326       9.68815       16.7617       14.1357       6.90338        77     
produce:nhitsfilter:NumberOfHitsFilter                0.000245163   0.00323884     0.0112472    0.00318631    0.00271269       77     
produce:reco3d:SpacePointSolver                         0.13449       2.43602        12.17        0.71496       3.30131        28     
produce:hitpdune:DisambigFromSpacePoints                0.24929      0.737535       2.26468      0.579724      0.533401        28     
produce:pandora:StandardPandora                         5.05142       17.1788       58.1219       12.6727       12.7131        28     
produce:pandoraWriter:StandardPandora                  0.0990104     0.186394      0.392378      0.172429      0.0709174       28     
produce:pandoraTrack:LArPandoraTrackCreation           0.562123       1.80801       5.81216       1.2505        1.33072        28     
produce:pandoraShower:LArPandoraShowerCreation         0.522836       2.0451        9.00747       1.30062       1.86538        28     
produce:pandoracalo:Calorimetry                        0.287625      0.776084       2.54578      0.592404      0.509275        28     
produce:pandoracalonosce:Calorimetry                   0.256171      0.714364       2.44129      0.528718      0.496446        28     
produce:pandorapid:Chi2ParticleID                     0.00109874    0.00238921    0.00602087    0.00224134    0.000906573      28     
produce:pandoraShowercalo:ShowerCalorimetry            0.464977       1.6862        7.42871       1.16039       1.51621        28     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.44212       1.57281       6.67595       1.11537       1.37176        28     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0683296     0.134552      0.283722      0.125859      0.046682        28     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.022064      0.0462141     0.0977172     0.042624      0.0166094       28     
produce:emtrkmichelid:EmTrackMichelId                   15.0586       25.8303       50.6673       23.6825       8.08425        28     
[art]:TriggerResults:TriggerResultInserter            1.3366e-05    7.36753e-05   0.000157127   7.2522e-05    3.54534e-05      122    
end_path:out1:RootOutput                               1.813e-06    1.6713e-05    6.0024e-05    1.36205e-05   1.11731e-05      122    
end_path:michelremoving:michelremoving                 7.103e-06     0.0157725     0.383078     6.5038e-05     0.0477004       122    
end_path:michelremovinggnocchi:michelremoving          4.047e-06     0.0151101     0.379845      3.978e-05     0.0469958       122    
end_path:calibanagnocchi:CalibAnaTree                  3.987e-06     0.141331       1.81547     3.67395e-05     0.3392         122    
end_path:out1:RootOutput(write)                       0.000346445     1.41649       3.96196      0.738735       1.41969        122    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5696.15 MB
  Peak resident set size usage (VmHWM): 3367.28 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup.root
\tHists: np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728076315.0,
    "core.end_time": 1728085658.0,
    "core.events": [
      191,
      192,
      193,
      194,
      195,
      196,
      197,
      198,
      199,
      200,
      201,
      202,
      203,
      204,
      205,
      206,
      207,
      208,
      209,
      210,
      211,
      212,
      213,
      214,
      215,
      216,
      217,
      218,
      219,
      220,
      221,
      222,
      223,
      224,
      225,
      226,
      227,
      228,
      229,
      230,
      231,
      232,
      233,
      234,
      235,
      236,
      237,
      238,
      239,
      240,
      241,
      242,
      243,
      244,
      245,
      246,
      247,
      248,
      249,
      250,
      251,
      252,
      253,
      254,
      255,
      256,
      257,
      258,
      259,
      260,
      261,
      262,
      263,
      264,
      265,
      266,
      267,
      268,
      269,
      270,
      271,
      272,
      273,
      274,
      275,
      276,
      277,
      278,
      279,
      280,
      281,
      282,
      283,
      284,
      285,
      286,
      287,
      288,
      289,
      290,
      291,
      292,
      293,
      294,
      295,
      296,
      297,
      298,
      299,
      300,
      301,
      302,
      303,
      304,
      305,
      306,
      307,
      308,
      309,
      310,
      311,
      312
    ],
    "core.event_count": 122,
    "core.first_event_number": 191,
    "core.last_event_number": 312,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27553
    ],
    "core.runs_subruns": [
      2755300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641_reco_stage1_reco_stage2_20241004T234737_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728076315.0,
    "core.end_time": 1728085658.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27553
    ],
    "core.runs_subruns": [
      2755300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027553_0002_dataflow0_datawriter_0_20240629T132641.hdf5"
    }
  ]
}
justIN time: 2024-11-24 13:32:34 UTC       justIN version: 01.01.09