justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79994.7@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79994.7@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3513
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:48:28
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 17:02:40
From worker nodeHostnamemh-7763-5.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 13:55:41
Input fileshd-protodune:np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048.hdf5
Outputting started2024-09-27 16:36:40
Output files
Finished2024-09-27 17:02:40
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

tagging trace set: wiener with 73024 traces, 73024 summary
Retagger: tagging trace set: gauss with 55189 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55189 traces tagged "gauss"
FrameSaver: q=1.99476e+06 n=1021328 tag=gauss
wclsFrameSaver: saving 73024 traces tagged "wiener"
FrameSaver: q=2.17596e+06 n=940582 tag=wiener
6219 hits in TPC 0
4325 hits in TPC 1
4643 hits in TPC 2
2041 hits in TPC 3
4845 hits in TPC 4
10505 hits in TPC 5
6439 hits in TPC 6
4520 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 10075 XUs and 10233 XVs -> 708 XUVs
C:0 T:2 8282 XUs and 17051 XVs -> 396 XUVs
C:0 T:3 580 XUs and 692 XVs -> 37 XUVs
C:0 T:4 438 XUs and 491 XVs -> 25 XUVs
C:0 T:5 59393 XUs and 45675 XVs -> 1320 XUVs
C:0 T:6 18076 XUs and 18978 XVs -> 1286 XUVs
C:0 T:7 329 XUs and 318 XVs -> 42 XUVs
3814 XUVs total
1804 collection wire objects
3814 potential space points
Neighbour search...
77398 tests to find 48690 neighbours
Iterating with no regularization...
Begin: 2.95721e+07
0 2.7227e+07
1 2.70255e+07
2 2.70066e+07
Now with regularization...
Begin: 2.52676e+07
0 2.52602e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 09:36:32 PDT  Closed output file "np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup.root"
27-Sep-2024 09:36:32 PDT  Closed input file "np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              58.0185       75.4319       103.222        72.08        11.7294        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000450788   0.00166818    0.00372199    0.00175928    0.000797926      35     
produce:fembfilter:PDHDFEMBFilter                      0.507816       0.5434       0.587056      0.536441      0.0198343       35     
produce:wclsdatahd:WireCellToolkit                      26.3656       28.0001        29.42        28.1077      0.833512        35     
produce:gaushit:GausHitFinder                          0.410591      0.596006      0.940788      0.595707      0.107609        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000200009   0.000282993   0.000459078   0.000277139   5.2267e-05       35     
produce:reco3d:SpacePointSolver                        0.220469      0.883167       2.50786       0.55688      0.715532        35     
produce:hitpdune:DisambigFromSpacePoints               0.223054      0.458124      0.905363       0.41438      0.175718        35     
produce:pandora:StandardPandora                         7.49374       13.9155       27.9191       11.9741       5.65677        35     
produce:pandoraWriter:StandardPandora                  0.0895373     0.123378      0.171588      0.120519      0.0229127       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.615571       1.15102       2.04271       1.07874      0.332271        35     
produce:pandoraShower:LArPandoraShowerCreation         0.693863       1.29847       2.59249       1.22866      0.451903        35     
produce:pandoracalo:Calorimetry                        0.357026      0.607035       1.17388      0.561478      0.174875        35     
produce:pandoracalonosce:Calorimetry                   0.328331      0.561832       1.08653      0.516004      0.164562        35     
produce:pandorapid:Chi2ParticleID                     0.00124302    0.00161573    0.00335645     0.0015008    0.000411955      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.671962       1.26795       2.71298       1.1722       0.502607        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.651601       1.21388       2.55235       1.1022       0.476737        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0654774     0.0989109     0.193755      0.0955285     0.024144        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0232964     0.0340368     0.0620669     0.0328266    0.00816897       35     
produce:emtrkmichelid:EmTrackMichelId                   16.7327       23.3551       32.1933       22.7149       3.53396        35     
[art]:TriggerResults:TriggerResultInserter             1.725e-05    2.71591e-05    7.398e-05     2.504e-05    1.01433e-05      35     
end_path:out1:RootOutput                               3.97e-06     9.5814e-06     2.633e-05     8.97e-06     3.55774e-06      35     
end_path:michelremoving:michelremoving                 0.0159712     0.0544978     0.198729      0.0234166     0.0574985       35     
end_path:michelremovinggnocchi:michelremoving          0.0147608     0.051047      0.195165      0.0205804     0.0557696       35     
end_path:calibanagnocchi:CalibAnaTree                  0.289525      0.454362      0.879937      0.422956      0.134757        35     
end_path:out1:RootOutput(write)                        0.468925      0.652648      0.929373      0.632416      0.117509        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5033.94 MB
  Peak resident set size usage (VmHWM): 2668.68 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup.root
\tHists: np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727452319.0,
    "core.end_time": 1727454993.0,
    "core.events": [
      2808,
      2812,
      2816,
      2820,
      2824,
      2828,
      2832,
      2836,
      2840,
      2844,
      2848,
      2852,
      2856,
      2860,
      2864,
      2868,
      2872,
      2876,
      2880,
      2884,
      2888,
      2892,
      2896,
      2900,
      2904,
      2908,
      2912,
      2916,
      2920,
      2924,
      2928,
      2932,
      2936,
      2940,
      2944
    ],
    "core.event_count": 35,
    "core.first_event_number": 2808,
    "core.last_event_number": 2944,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27365
    ],
    "core.runs_subruns": [
      2736500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048_reco_stage1_reco_stage2_20240927T163632_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727452319.0,
    "core.end_time": 1727454993.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27365
    ],
    "core.runs_subruns": [
      2736500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027365_0020_dataflow0_datawriter_0_20240622T023048.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:37:06 UTC       justIN version: 01.01.08