justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264724.111@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264724.111@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:14:59
SiteUS_Wisconsin
EntryHCCHTPC_US_Wisconsin_osg01_rhel7
Last heartbeat2024-09-27 14:20:12
From worker nodeHostnameherringa2001
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit82800 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 08:36:21
Input fileshd-protodune:np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436.hdf5
JobscriptExit code0
Real time5h (20399s)
CPU time1h (5705s = 27%)
Outputting started2024-09-27 14:16:21
Output fileshd-protodune-det-reco:np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup.root
hd-protodune-det-reco:np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup_hists.root
Finished2024-09-27 14:20:12
Saved logsjustin-logs:264724.111-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er saving cooked to 5859 ticks
wclsFrameSaver: saving 64050 traces tagged "gauss"
FrameSaver: q=2.52204e+06 n=1203285 tag=gauss
wclsFrameSaver: saving 82956 traces tagged "wiener"
FrameSaver: q=2.72146e+06 n=1098176 tag=wiener
3487 hits in TPC 0
2667 hits in TPC 1
10450 hits in TPC 2
5564 hits in TPC 3
5909 hits in TPC 4
9429 hits in TPC 5
7079 hits in TPC 6
4936 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4065 XUs and 5236 XVs -> 81 XUVs
C:0 T:2 61416 XUs and 42778 XVs -> 2115 XUVs
C:0 T:3 8152 XUs and 8685 XVs -> 1250 XUVs
C:0 T:4 354 XUs and 400 XVs -> 25 XUVs
C:0 T:5 44511 XUs and 40177 XVs -> 1392 XUVs
C:0 T:6 26319 XUs and 19574 XVs -> 1361 XUVs
C:0 T:7 699 XUs and 628 XVs -> 22 XUVs
6246 XUVs total
2577 collection wire objects
6246 potential space points
Neighbour search...
281246 tests to find 131678 neighbours
Iterating with no regularization...
Begin: 5.09883e+07
0 4.31671e+07
1 4.19996e+07
2 4.18984e+07
3 4.18692e+07
Now with regularization...
Begin: 3.90791e+07
0 3.90611e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 09:15:47 CDT  Closed output file "np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup.root"
27-Sep-2024 09:15:47 CDT  Closed input file "np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              91.1744       134.435       204.277       126.651       30.589         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000975423   0.00331698    0.00576533    0.00341933    0.00145188       35     
produce:fembfilter:PDHDFEMBFilter                       0.65819      0.945595       1.01821      0.981078      0.0742185       35     
produce:wclsdatahd:WireCellToolkit                      44.7362       48.4575       53.4521       48.3337       1.79785        35     
produce:gaushit:GausHitFinder                          0.603145       1.11453       1.99578       1.06958      0.299008        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000321775   0.000511879   0.00103146    0.000491714   0.000134311      35     
produce:reco3d:SpacePointSolver                        0.422276       1.40304       4.67622      0.989098       1.03958        35     
produce:hitpdune:DisambigFromSpacePoints               0.361772       1.0644        2.36149      0.900518      0.501857        35     
produce:pandora:StandardPandora                         8.11605       24.9382       74.3595       20.2879       13.5327        35     
produce:pandoraWriter:StandardPandora                  0.129975      0.226925      0.348835      0.214759      0.0573053       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.815642       2.2366        4.56193       2.19654       1.00221        35     
produce:pandoraShower:LArPandoraShowerCreation         0.756547       2.82435       5.90858       2.4964        1.60279        35     
produce:pandoracalo:Calorimetry                        0.533278       1.17337       2.60782       1.11587      0.493294        35     
produce:pandoracalonosce:Calorimetry                   0.478926       1.06123       2.44226      0.979294      0.459693        35     
produce:pandorapid:Chi2ParticleID                     0.00194217    0.00299991     0.0043223    0.00294767    0.000614344      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.718001       2.58233       6.24325       2.32324       1.42203        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.683184       2.42385       5.81936       2.1772        1.31824        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.119121      0.211408      0.308324      0.207848      0.0505331       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.039617      0.0706702     0.103492      0.071516      0.016918        35     
produce:emtrkmichelid:EmTrackMichelId                   25.2243       41.4593       60.803        39.6519       9.23895        35     
[art]:TriggerResults:TriggerResultInserter            2.4466e-05    5.81895e-05   0.000127549    5.879e-05    2.11329e-05      35     
end_path:out1:RootOutput                               1.054e-05    1.72929e-05   4.3733e-05     1.61e-05     5.78488e-06      35     
end_path:michelremoving:michelremoving                 0.0242059     0.104909      0.368132      0.0412402     0.0990142       35     
end_path:michelremovinggnocchi:michelremoving          0.0222034      0.10184      0.359353      0.0382031     0.0985213       35     
end_path:calibanagnocchi:CalibAnaTree                  0.307328       0.76258       1.78804      0.694037      0.321426        35     
end_path:out1:RootOutput(write)                        0.693987       1.09292       1.62752       1.05151      0.252335        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4983.6 MB
  Peak resident set size usage (VmHWM): 2639.67 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup.root
\tHists: np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727441676.0,
    "core.end_time": 1727446548.0,
    "core.events": [
      13302,
      13306,
      13310,
      13314,
      13318,
      13322,
      13326,
      13330,
      13334,
      13338,
      13342,
      13346,
      13350,
      13354,
      13358,
      13362,
      13366,
      13370,
      13374,
      13378,
      13382,
      13386,
      13390,
      13394,
      13398,
      13402,
      13406,
      13410,
      13414,
      13418,
      13422,
      13426,
      13430,
      13434,
      13438
    ],
    "core.event_count": 35,
    "core.first_event_number": 13302,
    "core.last_event_number": 13438,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436_reco_stage1_reco_stage2_20240927T141547_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727441676.0,
    "core.end_time": 1727446548.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0095_dataflow2_datawriter_0_20240624T001436.hdf5"
    }
  ]
}
justIN time: 2024-11-17 04:02:19 UTC       justIN version: 01.01.09