justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80354.3@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80354.3@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:45:22
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 19:35:45
From worker nodeHostnamemh-7763-1.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:46:31
Input fileshd-protodune:np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435.hdf5
JobscriptExit code0
Real time1h (6430s)
CPU time1h (3840s = 59%)
Outputting started2024-09-27 19:33:43
Output fileshd-protodune-det-reco:np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup.root
hd-protodune-det-reco:np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup_hists.root
Finished2024-09-27 19:35:45
Saved logsjustin-logs:80354.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Retagger: tagging trace set: gauss with 41769 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41769 traces tagged "gauss"
FrameSaver: q=1.53681e+06 n=727632 tag=gauss
wclsFrameSaver: saving 55635 traces tagged "wiener"
FrameSaver: q=1.67298e+06 n=662281 tag=wiener
3095 hits in TPC 0
3435 hits in TPC 1
4534 hits in TPC 2
3079 hits in TPC 3
3033 hits in TPC 4
4036 hits in TPC 5
5171 hits in TPC 6
3762 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4 XUs and 3 XVs -> 0 XUVs
C:0 T:1 9806 XUs and 3389 XVs -> 79 XUVs
C:0 T:2 12432 XUs and 14795 XVs -> 1126 XUVs
C:0 T:3 38 XUs and 48 XVs -> 4 XUVs
C:0 T:4 534 XUs and 128 XVs -> 6 XUVs
C:0 T:5 59996 XUs and 12402 XVs -> 713 XUVs
C:0 T:6 14941 XUs and 11532 XVs -> 725 XUVs
C:0 T:7 49 XUs and 28 XVs -> 0 XUVs
2653 XUVs total
1223 collection wire objects
2653 potential space points
Neighbour search...
54829 tests to find 30956 neighbours
Iterating with no regularization...
Begin: 3.70854e+07
0 3.40948e+07
1 3.39389e+07
2 3.39133e+07
Now with regularization...
Begin: 3.23734e+07
0 3.23656e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:33:35 PDT  Closed output file "np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup.root"
27-Sep-2024 12:33:35 PDT  Closed input file "np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              53.9254       92.1511       143.523       86.6901       24.2191        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000445597   0.00187278     0.0041494    0.00143102    0.00107852       35     
produce:fembfilter:PDHDFEMBFilter                       0.48746      0.519576      0.574598      0.520066      0.0161674       35     
produce:wclsdatahd:WireCellToolkit                      25.3437       27.5472       31.3072       27.3686       1.30522        35     
produce:gaushit:GausHitFinder                          0.388215      0.630875       1.03468       0.62452      0.150222        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000215778   0.000317283   0.000442976   0.000321797   5.62443e-05      35     
produce:reco3d:SpacePointSolver                        0.234079       1.06338       3.1324       0.988506      0.647789        35     
produce:hitpdune:DisambigFromSpacePoints               0.235588      0.613669       1.26578      0.551306      0.278599        35     
produce:pandora:StandardPandora                         5.30161       25.3846       63.5464       22.8967       14.6713        35     
produce:pandoraWriter:StandardPandora                  0.0798072      0.14078      0.229699      0.142915      0.0345429       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.468019       1.87101       7.10717       1.62878       1.18379        35     
produce:pandoraShower:LArPandoraShowerCreation          0.75909       1.86695       6.74767       1.55575       1.1297         35     
produce:pandoracalo:Calorimetry                        0.291812      0.912219       2.62855      0.827724      0.467952        35     
produce:pandoracalonosce:Calorimetry                   0.265309      0.855107       2.13748      0.774943      0.416308        35     
produce:pandorapid:Chi2ParticleID                     0.000995903   0.00191827    0.00294013    0.00189406    0.000424255      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.594225       1.72681       5.32695       1.47266      0.984263        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.556332       1.6493        4.95106       1.43461      0.943835        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.058078      0.100006      0.147915      0.0965577     0.0216917       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0217653     0.0343937     0.0510384     0.0334668     0.0069191       35     
produce:emtrkmichelid:EmTrackMichelId                   15.889        25.621        37.4187       25.7686       5.21246        35     
[art]:TriggerResults:TriggerResultInserter             1.514e-05    2.68113e-05   6.5849e-05     2.303e-05    1.12018e-05      35     
end_path:out1:RootOutput                               7.51e-06     9.74914e-06    2.056e-05     9.56e-06     2.34036e-06      35     
end_path:michelremoving:michelremoving                 0.015235      0.0507621     0.225389      0.0235163     0.0529958       35     
end_path:michelremovinggnocchi:michelremoving          0.0134098      0.04766      0.219383      0.0207808     0.0531737       35     
end_path:calibanagnocchi:CalibAnaTree                  0.187056      0.670115       1.73415      0.617785      0.322714        35     
end_path:out1:RootOutput(write)                        0.445037      0.706473       1.06062      0.731742      0.150813        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5055.08 MB
  Peak resident set size usage (VmHWM): 2690.32 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup.root
\tHists: np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462362.0,
    "core.end_time": 1727465616.0,
    "core.events": [
      18086,
      18090,
      18094,
      18098,
      18102,
      18106,
      18110,
      18114,
      18118,
      18122,
      18126,
      18130,
      18134,
      18138,
      18142,
      18146,
      18150,
      18154,
      18158,
      18162,
      18166,
      18170,
      18174,
      18178,
      18182,
      18186,
      18190,
      18194,
      18198,
      18202,
      18206,
      18210,
      18214,
      18218,
      18222
    ],
    "core.event_count": 35,
    "core.first_event_number": 18086,
    "core.last_event_number": 18222,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27333
    ],
    "core.runs_subruns": [
      2733300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435_reco_stage1_reco_stage2_20240927T193335_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462362.0,
    "core.end_time": 1727465616.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27333
    ],
    "core.runs_subruns": [
      2733300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027333_0129_dataflow2_datawriter_0_20240621T023435.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:12:01 UTC       justIN version: 01.01.09