justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79815.131@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79815.131@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3512
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 04:09:38
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2024-09-27 17:37:16
From worker nodeHostnameiut2-c213.iu.edu
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 08:08:40
Input fileshd-protodune:np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655.hdf5
JobscriptExit code0
Real time9h (33126s)
CPU time2h (7818s = 23%)
Outputting started2024-09-27 17:20:47
Output fileshd-protodune-det-reco:np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup.root
hd-protodune-det-reco:np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup_hists.root
Finished2024-09-27 17:37:16
Saved logsjustin-logs:79815.131-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63118 traces tagged "gauss"
FrameSaver: q=2.25887e+06 n=1117091 tag=gauss
wclsFrameSaver: saving 85026 traces tagged "wiener"
FrameSaver: q=2.44409e+06 n=999783 tag=wiener
4460 hits in TPC 0
4908 hits in TPC 1
8831 hits in TPC 2
5030 hits in TPC 3
5055 hits in TPC 4
8159 hits in TPC 5
7571 hits in TPC 6
3000 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7764 XUs and 7354 XVs -> 286 XUVs
C:0 T:2 38831 XUs and 47539 XVs -> 2998 XUVs
C:0 T:3 677 XUs and 725 XVs -> 31 XUVs
C:0 T:4 73 XUs and 61 XVs -> 0 XUVs
C:0 T:5 29902 XUs and 25749 XVs -> 631 XUVs
C:0 T:6 37130 XUs and 36015 XVs -> 655 XUVs
C:0 T:7 1084 XUs and 1137 XVs -> 62 XUVs
4663 XUVs total
1903 collection wire objects
4663 potential space points
Neighbour search...
177631 tests to find 101984 neighbours
Iterating with no regularization...
Begin: 2.40329e+07
0 2.20781e+07
1 2.19224e+07
2 2.19021e+07
Now with regularization...
Begin: 2.02369e+07
0 2.0231e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:20:32 EDT  Closed output file "np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup.root"
27-Sep-2024 13:20:32 EDT  Closed input file "np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              127.737       179.917       267.958       175.744       30.6761        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00076327    0.00263334    0.00507908     0.002324     0.00145985       35     
produce:fembfilter:PDHDFEMBFilter                      0.771948       1.10939       1.24231       1.15822      0.104878        35     
produce:wclsdatahd:WireCellToolkit                      56.9293       66.9952       75.9195       67.2301       4.29419        35     
produce:gaushit:GausHitFinder                          0.811655       1.50842       2.18643       1.50671       0.33748        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000377429   0.00111962     0.0195287    0.000576551   0.00315935       35     
produce:reco3d:SpacePointSolver                        0.370882       1.47497       3.8191        1.27735       0.77896        35     
produce:hitpdune:DisambigFromSpacePoints               0.405029       1.3608        2.87492       1.31412      0.607971        35     
produce:pandora:StandardPandora                         13.6396       32.9265       65.4464       29.4032       11.8258        35     
produce:pandoraWriter:StandardPandora                  0.170844      0.284752      0.407012      0.286109      0.0587737       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.69924       3.98727       8.16879       4.0471        1.32962        35     
produce:pandoraShower:LArPandoraShowerCreation          1.31221       5.04661       13.0466       4.57103       2.37921        35     
produce:pandoracalo:Calorimetry                        0.756657       1.75265       3.71118       1.71728      0.578618        35     
produce:pandoracalonosce:Calorimetry                    0.70213       1.65187       3.57612       1.63832      0.569456        35     
produce:pandorapid:Chi2ParticleID                     0.00216461    0.00367771    0.00679019    0.00364427    0.00103099       35     
produce:pandoraShowercalo:ShowerCalorimetry             1.05321       4.01313       11.3969       3.49974       2.01496        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.980907       3.92913       10.9177       3.40426       1.86296        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.133816      0.250094      0.398366      0.253182      0.0665647       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0487065     0.0919776     0.147069      0.0911165     0.0257312       35     
produce:emtrkmichelid:EmTrackMichelId                   32.2133       50.0942       70.8817       49.436        8.75217        35     
[art]:TriggerResults:TriggerResultInserter            4.8847e-05    7.74789e-05   0.000166422    7.604e-05    1.92795e-05      35     
end_path:out1:RootOutput                              1.0205e-05    1.70696e-05   4.3791e-05    1.4338e-05    7.17791e-06      35     
end_path:michelremoving:michelremoving                 0.0346113     0.179258      0.729726      0.0779221     0.182034        35     
end_path:michelremovinggnocchi:michelremoving          0.0328234     0.174274      0.677524      0.0722268     0.182979        35     
end_path:calibanagnocchi:CalibAnaTree                  0.478776       1.43031       3.0856        1.3931       0.501375        35     
end_path:out1:RootOutput(write)                        0.919713        1.482        2.24669       1.49366      0.280282        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4997.7 MB
  Peak resident set size usage (VmHWM): 2667.19 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup.root
\tHists: np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451246.0,
    "core.end_time": 1727457634.0,
    "core.events": [
      18925,
      18929,
      18933,
      18937,
      18941,
      18945,
      18949,
      18953,
      18957,
      18961,
      18965,
      18969,
      18973,
      18977,
      18981,
      18985,
      18989,
      18993,
      18997,
      19001,
      19005,
      19009,
      19013,
      19017,
      19021,
      19025,
      19029,
      19033,
      19037,
      19041,
      19045,
      19049,
      19053,
      19057,
      19061
    ],
    "core.event_count": 35,
    "core.first_event_number": 18925,
    "core.last_event_number": 19061,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27338
    ],
    "core.runs_subruns": [
      2733800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655_reco_stage1_reco_stage2_20240927T172032_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451246.0,
    "core.end_time": 1727457634.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27338
    ],
    "core.runs_subruns": [
      2733800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027338_0135_dataflow1_datawriter_0_20240621T115655.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:46:44 UTC       justIN version: 01.01.09