justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269271.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269271.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3571
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:39:58
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-10-04 19:42:48
From worker nodeHostnamedunegli-35534-0-cmswn4053.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 16:55:15
Input fileshd-protodune:np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734.hdf5
JobscriptExit code0
Real time2h (10016s)
CPU time17m (1035s = 10%)
Outputting started2024-10-04 19:42:12
Output fileshd-protodune-det-reco:np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup.root
hd-protodune-det-reco:np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup_hists.root
Finished2024-10-04 19:42:48
Saved logsjustin-logs:269271.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ecord. run: 27541 subRun: 1 event: 266 at 04-Oct-2024 19:42:06 UTC
Begin processing the 145th record. run: 27541 subRun: 1 event: 267 at 04-Oct-2024 19:42:06 UTC
Begin processing the 146th record. run: 27541 subRun: 1 event: 268 at 04-Oct-2024 19:42:06 UTC
04-Oct-2024 19:42:07 UTC  Closed output file "np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup.root"
04-Oct-2024 19:42:07 UTC  Closed input file "np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.000660853     4.49897       32.6875      0.155443       6.53381        146    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                7.4511e-05    0.000376386   0.00555003    0.00019277    0.000532915      146    
produce:fembfilter:PDHDFEMBFilter                     2.3474e-05     0.149756      0.786538      0.0279697     0.224723        146    
[art]:TriggerResults:TriggerResultInserter             7.855e-06    2.36006e-05   0.000119426   1.70475e-05   1.59109e-05      146    
end_path:out1:RootOutput                               9.82e-07     3.58155e-06   1.8165e-05     3.522e-06    2.31975e-06      146    
end_path:michelremoving:michelremoving                 4.399e-06    0.00032242    0.00829849    1.5419e-05    0.000888071      146    
end_path:michelremovinggnocchi:michelremoving          2.344e-06    0.000216257   0.00724226     4.459e-06    0.000676698      146    
end_path:calibanagnocchi:CalibAnaTree                  2.705e-06    0.00146067     0.0594991     4.033e-06    0.00526682       146    
end_path:out1:RootOutput(write)                       0.000138342    0.0621091     0.469873     0.000498099    0.138011        146    
produce:wclsdatahd:WireCellToolkit                      4.82341       6.84306       10.6873       5.04124       2.36847        49     
produce:gaushit:GausHitFinder                         0.00516669     0.537712       1.45363       0.06504      0.615032        49     
produce:nhitsfilter:NumberOfHitsFilter                4.3683e-05    0.000423781   0.00155506    0.000112583   0.000445783      49     
produce:reco3d:SpacePointSolver                       0.000799635   0.00599397     0.0858505    0.00323475     0.0148577       30     
produce:hitpdune:DisambigFromSpacePoints              0.000442158    0.010009      0.192073     0.00372183     0.0338295       30     
produce:pandora:StandardPandora                        0.0516236       2.654        10.2435       1.95253        2.103         30     
produce:pandoraWriter:StandardPandora                 0.00275624     0.0284406     0.0666639     0.0267233     0.0125379       30     
produce:pandoraTrack:LArPandoraTrackCreation          0.000136449   0.00626598     0.160755     0.000206948    0.0287258       30     
produce:pandoraShower:LArPandoraShowerCreation        8.0613e-05     0.0014171     0.0264809    0.000100105    0.0049835       30     
produce:pandoracalo:Calorimetry                       9.9759e-05    0.00366048     0.0968442    0.000138352    0.0173198       30     
produce:pandoracalonosce:Calorimetry                  4.9223e-05    0.00319285     0.0899617     6.083e-05     0.0161185       30     
produce:pandorapid:Chi2ParticleID                      3.688e-05    0.000134598   0.00105169    4.81965e-05   0.000223686      30     
produce:pandoraShowercalo:ShowerCalorimetry           5.5496e-05    0.00118363     0.0228369    6.36355e-05   0.00429834       30     
produce:pandoraShowercalonosce:ShowerCalorimetry      3.8002e-05    0.00103108     0.0207164    4.3257e-05    0.00392512       30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry         6.5344e-05    0.00043085    0.00589794    7.98515e-05   0.00107842       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry    4.9113e-05    0.000254675    0.0045079    5.7113e-05    0.000802751      30     
produce:emtrkmichelid:EmTrackMichelId                   0.79619       6.01886       15.1143       5.9059        2.48145        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4421.31 MB
  Peak resident set size usage (VmHWM): 2042.29 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup.root
\tHists: np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728070246.0,
    "core.end_time": 1728070927.0,
    "core.events": [
      123,
      124,
      125,
      126,
      127,
      128,
      129,
      130,
      131,
      132,
      133,
      134,
      135,
      136,
      137,
      138,
      139,
      140,
      141,
      142,
      143,
      144,
      145,
      146,
      147,
      148,
      149,
      150,
      151,
      152,
      153,
      154,
      155,
      156,
      157,
      158,
      159,
      160,
      161,
      162,
      163,
      164,
      165,
      166,
      167,
      168,
      169,
      170,
      171,
      172,
      173,
      174,
      175,
      176,
      177,
      178,
      179,
      180,
      181,
      182,
      183,
      184,
      185,
      186,
      187,
      188,
      189,
      190,
      191,
      192,
      193,
      194,
      195,
      196,
      197,
      198,
      199,
      200,
      201,
      202,
      203,
      204,
      205,
      206,
      207,
      208,
      209,
      210,
      211,
      212,
      213,
      214,
      215,
      216,
      217,
      218,
      219,
      220,
      221,
      222,
      223,
      224,
      225,
      226,
      227,
      228,
      229,
      230,
      231,
      232,
      233,
      234,
      235,
      236,
      237,
      238,
      239,
      240,
      241,
      242,
      243,
      244,
      245,
      246,
      247,
      248,
      249,
      250,
      251,
      252,
      253,
      254,
      255,
      256,
      257,
      258,
      259,
      260,
      261,
      262,
      263,
      264,
      265,
      266,
      267,
      268
    ],
    "core.event_count": 146,
    "core.first_event_number": 123,
    "core.last_event_number": 268,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27541
    ],
    "core.runs_subruns": [
      2754100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734_reco_stage1_reco_stage2_20241004T194207_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728070246.0,
    "core.end_time": 1728070927.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27541
    ],
    "core.runs_subruns": [
      2754100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027541_0001_dataflow0_datawriter_0_20240628T092734.hdf5"
    }
  ]
}
justIN time: 2024-11-24 13:07:42 UTC       justIN version: 01.01.09