justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77929.16@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77929.16@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 03:15:29
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2024-09-26 07:20:12
From worker nodeHostnameccwcondor0598
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 05:31:20
Input fileshd-protodune:np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545.hdf5
JobscriptExit code0
Real time1h (4260s)
CPU time1h (4079s = 95%)
Outputting started2024-09-26 06:42:20
Output fileshd-protodune-det-reco:np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup_hists.root
Finished2024-09-26 07:20:12
Saved logsjustin-logs:77929.16-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

race set: gauss with 33364 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 33364 traces tagged "gauss"
FrameSaver: q=736599 n=643660 tag=gauss
wclsFrameSaver: saving 44585 traces tagged "wiener"
FrameSaver: q=804620 n=588774 tag=wiener
1866 hits in TPC 0
1634 hits in TPC 1
4935 hits in TPC 2
4033 hits in TPC 3
2281 hits in TPC 4
4528 hits in TPC 5
4053 hits in TPC 6
2066 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 220 XUs and 186 XVs -> 0 XUVs
C:0 T:2 27883 XUs and 55372 XVs -> 6623 XUVs
C:0 T:3 754 XUs and 1031 XVs -> 73 XUVs
C:0 T:4 97 XUs and 62 XVs -> 3 XUVs
C:0 T:5 10941 XUs and 9864 XVs -> 318 XUVs
C:0 T:6 6990 XUs and 19151 XVs -> 1027 XUVs
C:0 T:7 141 XUs and 208 XVs -> 4 XUVs
8048 XUVs total
1480 collection wire objects
8048 potential space points
Neighbour search...
1348610 tests to find 556634 neighbours
Iterating with no regularization...
Begin: 5.3181e+06
0 4.46329e+06
1 4.39354e+06
2 4.38361e+06
3 4.38035e+06
Now with regularization...
Begin: 4.0677e+06
0 4.06521e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 08:42:10 CEST  Closed output file "np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup.root"
26-Sep-2024 08:42:10 CEST  Closed input file "np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              70.1192       108.028       195.694       98.9299       26.3213        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000779571    0.0036159    0.00551518    0.00369002    0.00121325       30     
produce:fembfilter:PDHDFEMBFilter                       0.50809      0.710062      0.842212      0.737019      0.0877235       30     
produce:wclsdatahd:WireCellToolkit                      32.7526       41.7908       45.2673       42.7833       3.2641         30     
produce:gaushit:GausHitFinder                          0.422018      0.770426       1.43927      0.735316      0.204503        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000234239   0.000369563   0.000637845   0.000345087   8.87774e-05      30     
produce:reco3d:SpacePointSolver                        0.275357       1.30041       3.73534      0.937899      0.921256        30     
produce:hitpdune:DisambigFromSpacePoints               0.216976      0.660204       2.17017       0.56057      0.402943        30     
produce:pandora:StandardPandora                         6.25577       14.722        38.3394       11.7854       7.29764        30     
produce:pandoraWriter:StandardPandora                  0.111798      0.181211      0.315936      0.168172      0.0535866       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.879704       2.14211       5.89902       1.90578       1.10099        30     
produce:pandoraShower:LArPandoraShowerCreation         0.776275       2.80066       9.64152       2.38828       1.77311        30     
produce:pandoracalo:Calorimetry                        0.496726       1.05272       3.31909      0.922332      0.559103        30     
produce:pandoracalonosce:Calorimetry                    0.41538       1.04294       4.55623      0.938772      0.757762        30     
produce:pandorapid:Chi2ParticleID                     0.00124148    0.00239627    0.00595602    0.00232783    0.000901119      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.770442       2.60558       11.2643       2.34104       1.9698         30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.651376       2.33291       8.7298        1.96071       1.6819         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0681757     0.167654      0.284727      0.163259      0.0475235       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0234842     0.0580542     0.0973066     0.0554037     0.0160838       30     
produce:emtrkmichelid:EmTrackMichelId                    18.97        33.6406       57.9936       31.3551       9.23273        30     
[art]:TriggerResults:TriggerResultInserter            3.2782e-05    7.30086e-05   0.000167464   7.06625e-05   2.38909e-05      30     
end_path:out1:RootOutput                               9.629e-06     2.051e-05     5.887e-05    1.83995e-05   9.07086e-06      30     
end_path:michelremoving:michelremoving                 0.0249503     0.113493      0.380836      0.0735029     0.096295        30     
end_path:michelremovinggnocchi:michelremoving          0.0237726     0.102404      0.373135      0.0592877     0.0844942       30     
end_path:calibanagnocchi:CalibAnaTree                  0.259814      0.742613       2.40257      0.614173      0.452378        30     
end_path:out1:RootOutput(write)                         0.48021      0.845569       1.46012      0.822057      0.222025        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4961.14 MB
  Peak resident set size usage (VmHWM): 2382.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup.root
\tHists: np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727329637.0,
    "core.end_time": 1727332931.0,
    "core.events": [
      743069,
      743077,
      743085,
      743093,
      743101,
      743109,
      743117,
      743125,
      743133,
      743141,
      743149,
      743157,
      743165,
      743173,
      743181,
      743189,
      743197,
      743205,
      743213,
      743221,
      743229,
      743237,
      743245,
      743253,
      743261,
      743269,
      743277,
      743285,
      743293,
      743301
    ],
    "core.event_count": 30,
    "core.first_event_number": 743069,
    "core.last_event_number": 743301,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545_reco_stage1_reco_stage2_20240926T064210_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727329637.0,
    "core.end_time": 1727332931.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3096_dataflow5_datawriter_0_20240908T200545.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:18:10 UTC       justIN version: 01.01.08