justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79372.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79372.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:22:08
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-09-26 17:34:09
From worker nodeHostnamedune001-2654845.0-lcg2599.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:24:01
Input fileshd-protodune:np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758.hdf5
JobscriptExit code0
Real time1h (4107s)
CPU time1h (3678s = 89%)
Outputting started2024-09-26 17:32:28
Output fileshd-protodune-det-reco:np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup.root
hd-protodune-det-reco:np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup_hists.root
Finished2024-09-26 17:34:09
Saved logsjustin-logs:79372.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-> 149 XUVs
C:0 T:7 64 XUs and 103 XVs -> 3 XUVs
6286 XUVs total
1249 collection wire objects
6286 potential space points
Neighbour search...
659102 tests to find 344906 neighbours
Iterating with no regularization...
Begin: 2.07319e+07
0 1.54905e+07
1 1.46227e+07
2 1.45412e+07
3 1.45174e+07
4 1.45073e+07
Now with regularization...
Begin: 1.37681e+07
0 1.37572e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.030304 0.0301056 0.0439987 0.0297089 0.06147 0.109833 0.0498734 0.0217819 0.0149689 0.00436497 0.00140858 
----view 1: 0.000486374 0.000449657 0.000449657 0.000449896 0.000449657 0.000449657 0.000449896 0.000449657 0.000449657 0.000449896 0.000449657 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  5   event 2873 TrkackID 3 startx, y, z 115.572 597.235 378.475  wireno, peakt tpcno 137 2883.94 5 dist 3.85893min T, max_T1427.41 2928.59
no of hits closeby  5   event 2873 TrkackID 3 startx, y, z 115.572 597.235 378.475  wireno, peakt tpcno 137 2883.94 5 dist 3.85893min T, max_T1427.41 2928.59
26-Sep-2024 17:32:12 UTC  Closed output file "np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup.root"
26-Sep-2024 17:32:12 UTC  Closed input file "np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.4534       88.1932       147.423       81.3541       18.8269        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000543826   0.00217204    0.00379833    0.00221178    0.000941252      30     
produce:fembfilter:PDHDFEMBFilter                      0.524817      0.743176      0.853573      0.790183      0.113131        30     
produce:wclsdatahd:WireCellToolkit                      33.9678       38.6711       42.1416        39.19        2.25318        30     
produce:gaushit:GausHitFinder                          0.405701      0.734289       1.26071      0.701352      0.204789        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000227526   0.000358962   0.000825374   0.00033181    0.000117098      30     
produce:reco3d:SpacePointSolver                        0.182937      0.611426       3.81348      0.432412      0.659959        30     
produce:hitpdune:DisambigFromSpacePoints               0.215727      0.569323       2.17656      0.439109      0.387467        30     
produce:pandora:StandardPandora                         5.5408        12.6555       48.255        10.023        8.90418        30     
produce:pandoraWriter:StandardPandora                  0.078173      0.141488      0.258757      0.133129      0.0497942       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.410106       1.03788       2.45594      0.971622      0.526043        30     
produce:pandoraShower:LArPandoraShowerCreation          0.42736       1.14131       2.33636      0.950931      0.516112        30     
produce:pandoracalo:Calorimetry                        0.269195      0.568879       1.13535      0.535966      0.223544        30     
produce:pandoracalonosce:Calorimetry                   0.227005       0.51277       1.04514      0.486527      0.211347        30     
produce:pandorapid:Chi2ParticleID                      0.0011396    0.00213958    0.00420306     0.0021348    0.000685999      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.404975       1.0652        2.08039      0.886557       0.50611        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.392454       1.03157       2.00065      0.883943      0.487735        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0681532     0.145628      0.226335      0.142219      0.0436243       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0231029     0.0488247     0.0766417     0.045921      0.0142919       30     
produce:emtrkmichelid:EmTrackMichelId                   18.9593       26.9418       41.4111       25.1485       6.17789        30     
[art]:TriggerResults:TriggerResultInserter            2.1761e-05    3.34871e-05   8.8063e-05    3.2226e-05    1.15379e-05      30     
end_path:out1:RootOutput                               4.04e-06     1.12454e-05   3.4791e-05    1.0785e-05    5.14808e-06      30     
end_path:michelremoving:michelremoving                 0.0138544     0.119924      0.570263      0.0318089     0.133592        30     
end_path:michelremovinggnocchi:michelremoving          0.0119448     0.120128      0.681968      0.0273253      0.14727        30     
end_path:calibanagnocchi:CalibAnaTree                   0.2002       0.428153      0.858092      0.365217      0.175099        30     
end_path:out1:RootOutput(write)                         0.46332       0.7995        1.28267      0.744017      0.198123        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4927.16 MB
  Peak resident set size usage (VmHWM): 2269.66 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup.root
\tHists: np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369236.0,
    "core.end_time": 1727371932.0,
    "core.events": [
      2641,
      2649,
      2657,
      2665,
      2673,
      2681,
      2689,
      2697,
      2705,
      2713,
      2721,
      2729,
      2737,
      2745,
      2753,
      2761,
      2769,
      2777,
      2785,
      2793,
      2801,
      2809,
      2817,
      2825,
      2833,
      2841,
      2849,
      2857,
      2865,
      2873
    ],
    "core.event_count": 30,
    "core.first_event_number": 2641,
    "core.last_event_number": 2873,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29094
    ],
    "core.runs_subruns": [
      2909400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758_reco_stage1_reco_stage2_20240926T173212_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369236.0,
    "core.end_time": 1727371932.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29094
    ],
    "core.runs_subruns": [
      2909400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029094_0011_dataflow1_datawriter_0_20240906T083758.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:58:36 UTC       justIN version: 01.01.09