justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269271.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269271.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3571
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:39:58
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-10-04 21:14:20
From worker nodeHostnamedunegli-35534-0-cmswn4053.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 16:55:18
Input fileshd-protodune:np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643.hdf5
JobscriptExit code0
Real time4h (15498s)
CPU time2h (7279s = 46%)
Outputting started2024-10-04 21:13:37
Output fileshd-protodune-det-reco:np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup.root
hd-protodune-det-reco:np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup_hists.root
Finished2024-10-04 21:14:20
Saved logsjustin-logs:269271.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: gauss with 171549 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 171549 traces tagged "gauss"
FrameSaver: q=8.29076e+08 n=17824364 tag=gauss
wclsFrameSaver: saving 135588 traces tagged "wiener"
FrameSaver: q=8.58722e+08 n=18365765 tag=wiener
61162 hits in TPC 0
04-Oct-2024 21:13:32 UTC  Closed output file "np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup.root"
04-Oct-2024 21:13:32 UTC  Closed input file "np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00188792      45.6384       323.852      0.595724       60.5593        142    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                7.7497e-05    0.000807537   0.00811757    0.000345725   0.00112738       142    
produce:fembfilter:PDHDFEMBFilter                     2.3855e-05     0.183467      0.707362      0.0480621     0.230973        142    
produce:wclsdatahd:WireCellToolkit                      21.1852       47.9044       84.6569       24.4047       27.1928        61     
produce:gaushit:GausHitFinder                          0.170743       4.9821        10.4227      0.465904       4.91796        61     
produce:nhitsfilter:NumberOfHitsFilter                0.000121971   0.00126347    0.00297582    0.000349242   0.00110317       61     
produce:reco3d:SpacePointSolver                        0.0231457     0.153397      0.611454      0.108419      0.145442        32     
produce:hitpdune:DisambigFromSpacePoints               0.0320273     0.143121      0.435126       0.11602      0.0881131       32     
produce:pandora:StandardPandora                         20.7068       66.9716       247.419       53.3041       52.3718        32     
produce:pandoraWriter:StandardPandora                  0.100553      0.182127      0.348832      0.161839      0.0628576       32     
produce:pandoraTrack:LArPandoraTrackCreation           0.0167545     0.172072      0.328846      0.175917      0.0789028       32     
produce:pandoraShower:LArPandoraShowerCreation        0.00569687     0.152519      0.435871      0.150122      0.0873997       32     
produce:pandoracalo:Calorimetry                       0.00812905     0.0944464     0.179248      0.0906998     0.0433185       32     
produce:pandoracalonosce:Calorimetry                  0.00591051     0.0845247     0.162741      0.0808512     0.0402268       32     
produce:pandorapid:Chi2ParticleID                     0.000249212   0.000647672   0.00137711    0.000663868   0.000220385      32     
produce:pandoraShowercalo:ShowerCalorimetry           0.00311507     0.134969      0.369717      0.127105      0.0807992       32     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.002827      0.129504      0.356728      0.121553      0.0784475       32     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0040847     0.0224286     0.0391343     0.0233328    0.00821453       32     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry    0.00160513    0.00828648     0.0156877    0.00823735    0.00320392       32     
produce:emtrkmichelid:EmTrackMichelId                   20.0647       30.0265       50.7211       28.0825       7.77777        32     
[art]:TriggerResults:TriggerResultInserter             8.095e-06    3.08029e-05    7.396e-05    3.18105e-05   1.68032e-05      142    
end_path:out1:RootOutput                               1.213e-06    6.37923e-06   2.2894e-05    4.3035e-06    4.8501e-06       142    
end_path:michelremoving:michelremoving                 5.14e-06     0.00185339     0.0121703    1.96375e-05    0.0035772       142    
end_path:michelremovinggnocchi:michelremoving          2.965e-06    0.00174168     0.0114804     6.707e-06    0.00339397       142    
end_path:calibanagnocchi:CalibAnaTree                  2.885e-06     0.0144195     0.127582      5.14e-06      0.0299612       142    
end_path:out1:RootOutput(write)                       0.000141057    0.494212       2.30671     0.000662666    0.805383        142    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5703.33 MB
  Peak resident set size usage (VmHWM): 3337.72 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup.root
\tHists: np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728069907.0,
    "core.end_time": 1728076412.0,
    "core.events": [
      165,
      166,
      167,
      168,
      169,
      170,
      171,
      172,
      173,
      174,
      175,
      176,
      177,
      178,
      179,
      180,
      181,
      182,
      183,
      184,
      185,
      186,
      187,
      188,
      189,
      190,
      191,
      192,
      193,
      194,
      195,
      196,
      197,
      198,
      199,
      200,
      201,
      202,
      203,
      204,
      205,
      206,
      207,
      208,
      209,
      210,
      211,
      212,
      213,
      214,
      215,
      216,
      217,
      218,
      219,
      220,
      221,
      222,
      223,
      224,
      225,
      226,
      227,
      228,
      229,
      230,
      231,
      232,
      233,
      234,
      235,
      236,
      237,
      238,
      239,
      240,
      241,
      242,
      243,
      244,
      245,
      246,
      247,
      248,
      249,
      250,
      251,
      252,
      253,
      254,
      255,
      256,
      257,
      258,
      259,
      260,
      261,
      262,
      263,
      264,
      265,
      266,
      267,
      268,
      269,
      270,
      271,
      272,
      273,
      274,
      275,
      276,
      277,
      278,
      279,
      280,
      281,
      282,
      283,
      284,
      285,
      286,
      287,
      288,
      289,
      290,
      291,
      292,
      293,
      294,
      295,
      296,
      297,
      298,
      299,
      300,
      301,
      302,
      303,
      304,
      305,
      306
    ],
    "core.event_count": 142,
    "core.first_event_number": 165,
    "core.last_event_number": 306,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643_reco_stage1_reco_stage2_20241004T211332_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728069907.0,
    "core.end_time": 1728076412.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0001_dataflow0_datawriter_0_20240628T101643.hdf5"
    }
  ]
}
justIN time: 2024-11-24 13:00:41 UTC       justIN version: 01.01.09