justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269271.61@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269271.61@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3571
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:39:58
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-10-04 19:57:07
From worker nodeHostnamedunegli-35534-0-cmswn4053.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 16:55:21
Input fileshd-protodune:np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159.hdf5
JobscriptExit code0
Real time3h (10854s)
CPU time2h (9016s = 83%)
Outputting started2024-10-04 19:56:16
Output fileshd-protodune-det-reco:np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup.root
hd-protodune-det-reco:np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup_hists.root
Finished2024-10-04 19:57:07
Saved logsjustin-logs:269271.61-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ticks=5859 keeping as is
Retagger: tagging trace set: wiener with 131060 traces, 131060 summary
Retagger: tagging trace set: gauss with 164431 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 164431 traces tagged "gauss"
FrameSaver: q=8.602e+08 n=16538254 tag=gauss
wclsFrameSaver: saving 131060 traces tagged "wiener"
FrameSaver: q=8.84629e+08 n=16923488 tag=wiener
65853 hits in TPC 0
04-Oct-2024 19:56:10 UTC  Closed output file "np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup.root"
04-Oct-2024 19:56:10 UTC  Closed input file "np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00547449      62.5128       514.111       78.141        79.0379        131    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                8.2165e-05    0.00132528     0.0156349    0.000435956   0.00208328       131    
produce:fembfilter:PDHDFEMBFilter                     2.3855e-05     0.206241      0.717921      0.160818      0.237158        131    
[art]:TriggerResults:TriggerResultInserter             8.516e-06    3.46407e-05   9.1213e-05     3.679e-05    1.72349e-05      131    
end_path:out1:RootOutput                               1.193e-06    7.92702e-06   2.9346e-05     8.155e-06    5.51823e-06      131    
end_path:michelremoving:michelremoving                 5.139e-06     0.0025425     0.0234137    2.2904e-05    0.00525844       131    
end_path:michelremovinggnocchi:michelremoving          3.246e-06    0.00235563     0.0210214     6.923e-06    0.00485306       131    
end_path:calibanagnocchi:CalibAnaTree                  3.026e-06     0.0224206     0.273645      7.193e-06     0.0502748       131    
end_path:out1:RootOutput(write)                       0.000143492    0.695676       2.21306      0.262918      0.891071        131    
produce:wclsdatahd:WireCellToolkit                      21.8135       53.7884       89.1681       70.1777       27.3896        68     
produce:gaushit:GausHitFinder                          0.248057       5.87526       11.0428       9.32978       4.84311        68     
produce:nhitsfilter:NumberOfHitsFilter                0.000192655   0.00143052    0.00313088    0.00197104    0.00104125       68     
produce:reco3d:SpacePointSolver                        0.0537754     0.287211      0.819769      0.201161      0.217093        28     
produce:hitpdune:DisambigFromSpacePoints               0.0819626     0.276968      0.740888      0.204985      0.177246        28     
produce:pandora:StandardPandora                         32.5711       102.57        412.819       79.173        79.3059        28     
produce:pandoraWriter:StandardPandora                  0.132452      0.227524      0.410059      0.207315      0.0658466       28     
produce:pandoraTrack:LArPandoraTrackCreation           0.0983368     0.282814      0.716495      0.241512      0.147266        28     
produce:pandoraShower:LArPandoraShowerCreation         0.0546622     0.294238      0.787596      0.216102      0.201607        28     
produce:pandoracalo:Calorimetry                        0.0555848     0.232655       1.11404       0.14624      0.234273        28     
produce:pandoracalonosce:Calorimetry                   0.047611      0.215732       1.08212      0.126889      0.229531        28     
produce:pandorapid:Chi2ParticleID                     0.000399818   0.000806942   0.00156118    0.00076503    0.000226604      28     
produce:pandoraShowercalo:ShowerCalorimetry            0.0540686     0.267744      0.914263      0.186019      0.221128        28     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.046227      0.255929       0.84289      0.182119      0.210396        28     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0164673     0.0323482     0.0544261     0.0271482     0.0118161       28     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry    0.00580583     0.0122544     0.0227245     0.011328     0.00447833       28     
produce:emtrkmichelid:EmTrackMichelId                   24.4837       37.8476       72.2936       35.2268       10.9341        28     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5762.06 MB
  Peak resident set size usage (VmHWM): 3386.82 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup.root
\tHists: np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728063557.0,
    "core.end_time": 1728071771.0,
    "core.events": [
      307,
      308,
      309,
      310,
      311,
      312,
      313,
      314,
      315,
      316,
      317,
      318,
      319,
      320,
      321,
      322,
      323,
      324,
      325,
      326,
      327,
      328,
      329,
      330,
      331,
      332,
      333,
      334,
      335,
      336,
      337,
      338,
      339,
      340,
      341,
      342,
      343,
      344,
      345,
      346,
      347,
      348,
      349,
      350,
      351,
      352,
      353,
      354,
      355,
      356,
      357,
      358,
      359,
      360,
      361,
      362,
      363,
      364,
      365,
      366,
      367,
      368,
      369,
      370,
      371,
      372,
      373,
      374,
      375,
      376,
      377,
      378,
      379,
      380,
      381,
      382,
      383,
      384,
      385,
      386,
      387,
      388,
      389,
      390,
      391,
      392,
      393,
      394,
      395,
      396,
      397,
      398,
      399,
      400,
      401,
      402,
      403,
      404,
      405,
      406,
      407,
      408,
      409,
      410,
      411,
      412,
      413,
      414,
      415,
      416,
      417,
      418,
      419,
      420,
      421,
      422,
      423,
      424,
      425,
      426,
      427,
      428,
      429,
      430,
      431,
      432,
      433,
      434,
      435,
      436,
      437
    ],
    "core.event_count": 131,
    "core.first_event_number": 307,
    "core.last_event_number": 437,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159_reco_stage1_reco_stage2_20241004T195610_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728063557.0,
    "core.end_time": 1728071771.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27542
    ],
    "core.runs_subruns": [
      2754200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027542_0002_dataflow0_datawriter_0_20240628T102159.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:37:54 UTC       justIN version: 01.01.09