justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269318.21@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269318.21@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3573
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 17:08:48
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2024-10-04 23:49:26
From worker nodeHostnameiut2-c352.iu.edu
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 20:20:53
Input fileshd-protodune:np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531.hdf5
JobscriptExit code0
Real time3h (12450s)
CPU time2h (10276s = 82%)
Outputting started2024-10-04 23:48:24
Output fileshd-protodune-det-reco:np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup.root
hd-protodune-det-reco:np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup_hists.root
Finished2024-10-04 23:49:26
Saved logsjustin-logs:269318.21-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

t-2024 19:46:14 EDT
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 135086 traces, 135086 summary
Retagger: tagging trace set: gauss with 170819 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 170819 traces tagged "gauss"
FrameSaver: q=8.69559e+08 n=17166283 tag=gauss
wclsFrameSaver: saving 135086 traces tagged "wiener"
FrameSaver: q=8.9629e+08 n=17587560 tag=wiener
64580 hits in TPC 0
04-Oct-2024 19:48:17 EDT  Closed output file "np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup.root"
04-Oct-2024 19:48:17 EDT  Closed input file "np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00441918      72.1874       173.119       84.0174       63.108         124    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000157416   0.00223514    0.00818226    0.00202881    0.00197551       124    
produce:fembfilter:PDHDFEMBFilter                     5.5995e-05     0.254966      0.833803      0.163451      0.277713        124    
produce:wclsdatahd:WireCellToolkit                      27.9196       85.3143       152.134       102.951       41.8283        74     
produce:gaushit:GausHitFinder                          0.381836       9.98012       18.8651       13.689        7.51173        74     
produce:nhitsfilter:NumberOfHitsFilter                0.000268856   0.00225487    0.00439358    0.00313286    0.00146054       74     
produce:reco3d:SpacePointSolver                        0.175842       2.26332       9.33207      0.716033       3.04653        28     
produce:hitpdune:DisambigFromSpacePoints               0.193847       0.72469       1.60296      0.583924      0.395287        28     
produce:pandora:StandardPandora                         5.69056       17.5455       44.8853       16.1862       9.62632        28     
produce:pandoraWriter:StandardPandora                  0.0954443      0.19995      0.342557      0.199285      0.0690294       28     
produce:pandoraTrack:LArPandoraTrackCreation           0.709499       1.62831       3.07437       1.60978      0.732394        28     
produce:pandoraShower:LArPandoraShowerCreation         0.636683       1.88158       5.13757       1.51349       1.17251        28     
produce:pandoracalo:Calorimetry                        0.365269      0.741896       1.39848       0.66714      0.297393        28     
produce:pandoracalonosce:Calorimetry                   0.308718      0.687286       1.28333      0.626365      0.284983        28     
produce:pandorapid:Chi2ParticleID                     0.00128707     0.0023458    0.00661584    0.00214302    0.00104433       28     
produce:pandoraShowercalo:ShowerCalorimetry            0.593256       1.58771       4.16431       1.40112      0.880007        28     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.557262       1.55016       3.83972       1.33314      0.834891        28     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0805544     0.162184      0.267364      0.158172      0.052834        28     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0243428     0.0530786     0.0868014     0.0524581     0.0161627       28     
produce:emtrkmichelid:EmTrackMichelId                   19.6283       30.0916       42.3058       28.721        6.57925        28     
[art]:TriggerResults:TriggerResultInserter            1.2152e-05    5.78653e-05   0.000109225   5.8029e-05    2.79767e-05      124    
end_path:out1:RootOutput                               1.653e-06    1.45108e-05   6.3249e-05    1.19725e-05   1.06482e-05      124    
end_path:michelremoving:michelremoving                 5.981e-06     0.0148915      0.27419     5.56895e-05    0.0406653       124    
end_path:michelremovinggnocchi:michelremoving          3.807e-06     0.0141048     0.264533     3.49455e-05    0.0394898       124    
end_path:calibanagnocchi:CalibAnaTree                  3.927e-06     0.129422       1.1354      3.4765e-05     0.265032        124    
end_path:out1:RootOutput(write)                       0.000310824     1.46144       4.08631      0.889663       1.54836        124    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5746.91 MB
  Peak resident set size usage (VmHWM): 3388.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup.root
\tHists: np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728076703.0,
    "core.end_time": 1728085698.0,
    "core.events": [
      442,
      443,
      444,
      445,
      446,
      447,
      448,
      449,
      450,
      451,
      452,
      453,
      454,
      455,
      456,
      457,
      458,
      459,
      460,
      461,
      462,
      463,
      464,
      465,
      466,
      467,
      468,
      469,
      470,
      471,
      472,
      473,
      474,
      475,
      476,
      477,
      478,
      479,
      480,
      481,
      482,
      483,
      484,
      485,
      486,
      487,
      488,
      489,
      490,
      491,
      492,
      493,
      494,
      495,
      496,
      497,
      498,
      499,
      500,
      501,
      502,
      503,
      504,
      505,
      506,
      507,
      508,
      509,
      510,
      511,
      512,
      513,
      514,
      515,
      516,
      517,
      518,
      519,
      520,
      521,
      522,
      523,
      524,
      525,
      526,
      527,
      528,
      529,
      530,
      531,
      532,
      533,
      534,
      535,
      536,
      537,
      538,
      539,
      540,
      541,
      542,
      543,
      544,
      545,
      546,
      547,
      548,
      549,
      550,
      551,
      552,
      553,
      554,
      555,
      556,
      557,
      558,
      559,
      560,
      561,
      562,
      563,
      564,
      565
    ],
    "core.event_count": 124,
    "core.first_event_number": 442,
    "core.last_event_number": 565,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27553
    ],
    "core.runs_subruns": [
      2755300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531_reco_stage1_reco_stage2_20241004T234817_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728076703.0,
    "core.end_time": 1728085698.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27553
    ],
    "core.runs_subruns": [
      2755300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027553_0004_dataflow0_datawriter_0_20240629T133531.hdf5"
    }
  ]
}
justIN time: 2024-11-24 13:32:34 UTC       justIN version: 01.01.09