justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269271.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269271.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3571
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:39:58
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-10-04 21:48:45
From worker nodeHostnamedunegli-35534-0-cmswn4053.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 16:55:17
Input fileshd-protodune:np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156.hdf5
JobscriptExit code0
Real time4h (17555s)
CPU time2h (8234s = 46%)
Outputting started2024-10-04 21:47:53
Output fileshd-protodune-det-reco:np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup.root
hd-protodune-det-reco:np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup_hists.root
Finished2024-10-04 21:48:45
Saved logsjustin-logs:269271.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

FrameSaver: q=8.58598e+08 n=16961541 tag=gauss
wclsFrameSaver: saving 137038 traces tagged "wiener"
FrameSaver: q=8.85578e+08 n=17371755 tag=wiener
65953 hits in TPC 0
04-Oct-2024 21:47:48 UTC  Closed output file "np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup.root"
04-Oct-2024 21:47:48 UTC  Closed input file "np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00436977      44.6674       228.245      0.592277       56.8876        164    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                8.1995e-05     0.0011212     0.0121035    0.000352008   0.00154413       164    
produce:fembfilter:PDHDFEMBFilter                     2.2934e-05     0.162771      0.677503      0.0540187     0.214531        164    
[art]:TriggerResults:TriggerResultInserter             8.346e-06    3.66933e-05   0.000136038   3.7697e-05    2.05187e-05      164    
end_path:out1:RootOutput                               1.142e-06    7.17805e-06   2.3445e-05     5.551e-06    5.05213e-06      164    
end_path:michelremoving:michelremoving                 5.069e-06    0.00178323     0.0572532    2.10345e-05   0.00551692       164    
end_path:michelremovinggnocchi:michelremoving          3.016e-06    0.00154298     0.0486344    5.9815e-06     0.0047305       164    
end_path:calibanagnocchi:CalibAnaTree                  2.524e-06     0.0102778     0.121608     6.2015e-06     0.0254003       164    
end_path:out1:RootOutput(write)                       0.000137401     0.59221       2.26274     0.000640659    0.882771        164    
produce:wclsdatahd:WireCellToolkit                      21.1314       53.3097       89.2686       67.6852       26.0365        70     
produce:gaushit:GausHitFinder                          0.228356       6.25648       11.1347       9.85841       4.83946        70     
produce:nhitsfilter:NumberOfHitsFilter                0.000169591   0.00159955    0.00324116    0.00218342    0.00111323       70     
produce:reco3d:SpacePointSolver                        0.0307604     0.225795      0.886861      0.184859      0.214575        28     
produce:hitpdune:DisambigFromSpacePoints               0.0453765     0.160938       0.37329      0.143544      0.0805637       28     
produce:pandora:StandardPandora                         30.2724       75.0715       154.607       67.1016       37.6901        28     
produce:pandoraWriter:StandardPandora                  0.102468      0.191699      0.291598      0.191457      0.0504458       28     
produce:pandoraTrack:LArPandoraTrackCreation           0.0621107     0.160651      0.346602       0.14464      0.0721303       28     
produce:pandoraShower:LArPandoraShowerCreation         0.0223824     0.156267      0.367476      0.118083      0.0920304       28     
produce:pandoracalo:Calorimetry                        0.0326112     0.0957301     0.244802      0.0881565     0.0472624       28     
produce:pandoracalonosce:Calorimetry                   0.0279133     0.0853387      0.23194      0.0793111     0.0453455       28     
produce:pandorapid:Chi2ParticleID                     0.000407362   0.000717559   0.00246905    0.000684797   0.000369352      28     
produce:pandoraShowercalo:ShowerCalorimetry            0.0131004     0.136235      0.314155      0.102598      0.0886647       28     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.0122983     0.129944      0.297995      0.0952563     0.0854776       28     
produce:pandoraGnocchiCalo:GnocchiCalorimetry         0.00807131     0.0240988     0.0431555     0.0221894    0.00807737       28     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry    0.00291889     0.0084815     0.0146531    0.00757908    0.00284553       28     
produce:emtrkmichelid:EmTrackMichelId                   19.3237       31.3446       48.8173       30.4874       7.94859        28     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5692.96 MB
  Peak resident set size usage (VmHWM): 3331.28 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup.root
\tHists: np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728071115.0,
    "core.end_time": 1728078468.0,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20,
      21,
      22,
      23,
      24,
      25,
      26,
      27,
      28,
      29,
      30,
      31,
      32,
      33,
      34,
      35,
      36,
      37,
      38,
      39,
      40,
      41,
      42,
      43,
      44,
      45,
      46,
      47,
      48,
      49,
      50,
      51,
      52,
      53,
      54,
      55,
      56,
      57,
      58,
      59,
      60,
      61,
      62,
      63,
      64,
      65,
      66,
      67,
      68,
      69,
      70,
      71,
      72,
      73,
      74,
      75,
      76,
      77,
      78,
      79,
      80,
      81,
      82,
      83,
      84,
      85,
      86,
      87,
      88,
      89,
      90,
      91,
      92,
      93,
      94,
      95,
      96,
      97,
      98,
      99,
      100,
      101,
      102,
      103,
      104,
      105,
      106,
      107,
      108,
      109,
      110,
      111,
      112,
      113,
      114,
      115,
      116,
      117,
      118,
      119,
      120,
      121,
      122,
      123,
      124,
      125,
      126,
      127,
      128,
      129,
      130,
      131,
      132,
      133,
      134,
      135,
      136,
      137,
      138,
      139,
      140,
      141,
      142,
      143,
      144,
      145,
      146,
      147,
      148,
      149,
      150,
      151,
      152,
      153,
      154,
      155,
      156,
      157,
      158,
      159,
      160,
      161,
      162,
      163,
      164
    ],
    "core.event_count": 164,
    "core.first_event_number": 1,
    "core.last_event_number": 164,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156_reco_stage1_reco_stage2_20241004T214748_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728071115.0,
    "core.end_time": 1728078468.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0000_dataflow0_datawriter_0_20240628T101156.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:36:40 UTC       justIN version: 01.01.09