justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276383.57@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID276383.57@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3705
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 11:32:12
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-17 13:41:09
From worker nodeHostnamespool0127.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 11:35:05
Input fileshd-protodune:np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303.hdf5
Outputting started2024-10-17 13:22:21
Output files
Finished2024-10-17 14:25:27
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

is
Retagger: tagging trace set: wiener with 51373 traces, 51373 summary
Retagger: tagging trace set: gauss with 40966 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40966 traces tagged "gauss"
FrameSaver: q=1.60367e+06 n=816137 tag=gauss
wclsFrameSaver: saving 51373 traces tagged "wiener"
FrameSaver: q=1.70515e+06 n=755789 tag=wiener
2070 hits in TPC 0
2971 hits in TPC 1
3385 hits in TPC 2
1922 hits in TPC 3
5137 hits in TPC 4
7084 hits in TPC 5
5536 hits in TPC 6
3047 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1181 XUs and 1357 XVs -> 288 XUVs
C:0 T:2 3145 XUs and 3320 XVs -> 227 XUVs
C:0 T:3 60 XUs and 107 XVs -> 1 XUVs
C:0 T:4 163 XUs and 134 XVs -> 4 XUVs
C:0 T:5 24777 XUs and 18623 XVs -> 822 XUVs
C:0 T:6 9342 XUs and 10521 XVs -> 638 XUVs
C:0 T:7 145 XUs and 98 XVs -> 12 XUVs
1992 XUVs total
1225 collection wire objects
1992 potential space points
Neighbour search...
35904 tests to find 19336 neighbours
Iterating with no regularization...
Begin: 2.71928e+07
0 2.6523e+07
1 2.64934e+07
2 2.64908e+07
Now with regularization...
Begin: 2.45237e+07
0 2.45218e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

17-Oct-2024 13:22:09 UTC  Closed output file "np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup.root"
17-Oct-2024 13:22:09 UTC  Closed input file "np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.3383       114.408       172.145       107.458       20.1265        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000440394   0.00207992     0.0065189    0.00182263     0.0013732       35     
produce:fembfilter:PDHDFEMBFilter                      0.791195      0.855614        1.109       0.816135      0.0858056       35     
produce:wclsdatahd:WireCellToolkit                      55.189        59.1872       63.5205       59.3064       2.00949        35     
produce:gaushit:GausHitFinder                          0.581215      0.966277       1.9317       0.916009      0.275947        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000342257   0.000515218   0.00115887    0.000483228   0.000158232      35     
produce:reco3d:SpacePointSolver                        0.225037       1.21475        3.44        0.831719      0.839239        35     
produce:hitpdune:DisambigFromSpacePoints                0.27913      0.694288       1.57303      0.667492      0.264745        35     
produce:pandora:StandardPandora                         8.07198       18.8397       64.2578       15.1931       11.2552        35     
produce:pandoraWriter:StandardPandora                  0.124565      0.207121      0.366292      0.199429      0.0580061       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.26433       2.84754       5.09721       2.62382       1.05473        35     
produce:pandoraShower:LArPandoraShowerCreation         0.729167       3.0203        7.09435       2.56872       1.49287        35     
produce:pandoracalo:Calorimetry                        0.526018       1.15707       2.03898       1.07081      0.382866        35     
produce:pandoracalonosce:Calorimetry                   0.488499       1.07381       2.12677       1.07002      0.377271        35     
produce:pandorapid:Chi2ParticleID                     0.00150066    0.00229713    0.00421522    0.00212693    0.000585859      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.588888       2.58741       6.45532       2.34942       1.19681        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.580716       2.5915        5.67896       2.46837       1.18402        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0752683     0.149748      0.282134      0.133623      0.0531895       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0322951     0.057908      0.107814      0.0499054     0.0208343       35     
produce:emtrkmichelid:EmTrackMichelId                   10.0036       16.7137       24.501        16.4591       3.76903        35     
[art]:TriggerResults:TriggerResultInserter            2.7237e-05    5.09761e-05    9.968e-05    4.8029e-05    1.3525e-05       35     
end_path:out1:RootOutput                               7.111e-06    1.38583e-05   4.1419e-05    1.1596e-05    6.65318e-06      35     
end_path:michelremoving:michelremoving                  0.02558      0.104044      0.306974      0.0718053     0.073655        35     
end_path:michelremovinggnocchi:michelremoving          0.0232561      0.10326      0.322019      0.0605097     0.079849        35     
end_path:calibanagnocchi:CalibAnaTree                  0.395238      0.860386       2.01572      0.837466      0.295062        35     
end_path:out1:RootOutput(write)                        0.578975      0.920254       1.60625      0.861094       0.2687         35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6110.76 MB
  Peak resident set size usage (VmHWM): 2491.23 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup.root
\tHists: np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729167280.0,
    "core.end_time": 1729171330.0,
    "core.events": [
      4904,
      4908,
      4912,
      4916,
      4920,
      4924,
      4928,
      4932,
      4936,
      4940,
      4944,
      4948,
      4952,
      4956,
      4960,
      4964,
      4968,
      4972,
      4976,
      4980,
      4984,
      4988,
      4992,
      4996,
      5000,
      5004,
      5008,
      5012,
      5016,
      5020,
      5024,
      5028,
      5032,
      5036,
      5040
    ],
    "core.event_count": 35,
    "core.first_event_number": 4904,
    "core.last_event_number": 5040,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27406
    ],
    "core.runs_subruns": [
      2740600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303_reco_stage1_reco_stage2_20241017T132209_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729167280.0,
    "core.end_time": 1729171330.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27406
    ],
    "core.runs_subruns": [
      2740600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027406_0035_dataflow0_datawriter_0_20240624T135303.hdf5"
    }
  ]
}
justIN time: 2024-11-24 10:02:52 UTC       justIN version: 01.01.09