justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 83089.44@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID83089.44@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3698
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 08:29:21
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-10-17 16:03:26
From worker nodeHostnamesdsc-21.t2.ucsd.edu
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 13:58:30
Input fileshd-protodune:np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919.hdf5
JobscriptExit code0
Real time2h (7399s)
CPU time1h (4788s = 64%)
Outputting started2024-10-17 16:01:50
Output fileshd-protodune-det-reco:np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup.root
hd-protodune-det-reco:np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup_hists.root
Finished2024-10-17 16:03:26
Saved logsjustin-logs:83089.44-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er: tagging trace set: gauss with 57826 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 57826 traces tagged "gauss"
FrameSaver: q=2.47489e+06 n=1110231 tag=gauss
wclsFrameSaver: saving 75263 traces tagged "wiener"
FrameSaver: q=2.63284e+06 n=1011417 tag=wiener
2845 hits in TPC 0
3468 hits in TPC 1
7425 hits in TPC 2
4497 hits in TPC 3
5345 hits in TPC 4
7977 hits in TPC 5
8477 hits in TPC 6
4343 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 42 XUs and 12 XVs -> 0 XUVs
C:0 T:1 1290 XUs and 876 XVs -> 17 XUVs
C:0 T:2 25013 XUs and 24410 XVs -> 953 XUVs
C:0 T:3 526 XUs and 429 XVs -> 10 XUVs
C:0 T:4 74 XUs and 79 XVs -> 0 XUVs
C:0 T:5 58878 XUs and 29876 XVs -> 1053 XUVs
C:0 T:6 28673 XUs and 32591 XVs -> 1015 XUVs
C:0 T:7 216 XUs and 219 XVs -> 2 XUVs
3050 XUVs total
1610 collection wire objects
3050 potential space points
Neighbour search...
80374 tests to find 37818 neighbours
Iterating with no regularization...
Begin: 7.30013e+07
0 6.45101e+07
1 6.42958e+07
2 6.42749e+07
Now with regularization...
Begin: 6.19546e+07
0 6.1946e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

17-Oct-2024 09:01:41 PDT  Closed output file "np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup.root"
17-Oct-2024 09:01:41 PDT  Closed input file "np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              82.3291       107.755       132.378       105.213       13.9288        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000373837   0.00202059    0.00511554    0.00214832    0.000963266      35     
produce:fembfilter:PDHDFEMBFilter                       0.71822      0.775642      0.991975      0.765816      0.042279        35     
produce:wclsdatahd:WireCellToolkit                      45.5795       48.6643       55.4385       47.7714       2.59314        35     
produce:gaushit:GausHitFinder                          0.537195      0.867666       1.23573      0.862052      0.182943        35     
produce:nhitsfilter:NumberOfHitsFilter                 0.0001966    0.000342954   0.000526058   0.000331326   9.49282e-05      35     
produce:reco3d:SpacePointSolver                        0.284449       0.76327       1.6585       0.655864       0.38266        35     
produce:hitpdune:DisambigFromSpacePoints               0.309823      0.687782       1.23833      0.645819      0.267968        35     
produce:pandora:StandardPandora                         8.15636       18.4295       31.0718       18.0253       6.13707        35     
produce:pandoraWriter:StandardPandora                  0.0926603     0.156751      0.205939      0.158316      0.0300781       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.610005       1.46463       2.22573       1.4292       0.403187        35     
produce:pandoraShower:LArPandoraShowerCreation         0.655497       1.73283       2.87401       1.70028      0.627572        35     
produce:pandoracalo:Calorimetry                        0.339241      0.708646       1.10031      0.668328      0.182167        35     
produce:pandoracalonosce:Calorimetry                   0.306028      0.656738       1.00636      0.624182       0.17221        35     
produce:pandorapid:Chi2ParticleID                      0.0013227    0.00198602    0.00347477    0.00197529    0.000384988      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.597023       1.55747       2.76909       1.56202      0.564044        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.586216       1.5101        2.67022       1.53794       0.54868        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0811086     0.128348      0.179482      0.128499      0.0281561       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0284871     0.0478159     0.0673616     0.048126      0.0103077       35     
produce:emtrkmichelid:EmTrackMichelId                   18.1982       27.9776       37.3668       27.7279       5.38003        35     
[art]:TriggerResults:TriggerResultInserter            1.9305e-05    2.66027e-05   8.4467e-05    2.3137e-05    1.14191e-05      35     
end_path:out1:RootOutput                               3.962e-06    8.5954e-06    4.2881e-05     5.144e-06    8.1767e-06       35     
end_path:michelremoving:michelremoving                 0.0201643     0.0707794     0.243876      0.0352703     0.0605278       35     
end_path:michelremovinggnocchi:michelremoving          0.0184063     0.0668129     0.239666      0.0324049     0.0601628       35     
end_path:calibanagnocchi:CalibAnaTree                  0.232773      0.574071       1.01655      0.551397      0.182703        35     
end_path:out1:RootOutput(write)                         0.55272      0.830061       1.11435      0.820532      0.162568        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4975.65 MB
  Peak resident set size usage (VmHWM): 2607.14 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup.root
\tHists: np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729177082.0,
    "core.end_time": 1729180902.0,
    "core.events": [
      31784,
      31788,
      31792,
      31796,
      31800,
      31804,
      31808,
      31812,
      31816,
      31820,
      31824,
      31828,
      31832,
      31836,
      31840,
      31844,
      31848,
      31852,
      31856,
      31860,
      31864,
      31868,
      31872,
      31876,
      31880,
      31884,
      31888,
      31892,
      31896,
      31900,
      31904,
      31908,
      31912,
      31916,
      31920
    ],
    "core.event_count": 35,
    "core.first_event_number": 31784,
    "core.last_event_number": 31920,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919_reco_stage1_reco_stage2_20241017T160141_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729177082.0,
    "core.end_time": 1729180902.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0227_dataflow0_datawriter_0_20240625T155919.hdf5"
    }
  ]
}
justIN time: 2024-11-24 03:58:57 UTC       justIN version: 01.01.09