justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59074.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59074.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2865
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-17 21:24:32
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-17 22:29:16
From worker nodeHostnamewn-snel-023.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-17 21:25:17
Input fileshd-protodune:np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931.hdf5
Outputting started2024-08-17 22:28:03
Output files
Finished2024-08-17 22:29:16
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

meSaver: saving 78736 traces tagged "gauss"
FrameSaver: q=1.74982e+06 n=1473843 tag=gauss
wclsFrameSaver: saving 103274 traces tagged "wiener"
FrameSaver: q=1.95982e+06 n=1351452 tag=wiener
14107 hits in TPC 0
8602 hits in TPC 1
7609 hits in TPC 2
5960 hits in TPC 3
5535 hits in TPC 4
7452 hits in TPC 5
5492 hits in TPC 6
4397 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 31058 XUs and 18262 XVs -> 2792 XUVs
C:0 T:2 50700 XUs and 44555 XVs -> 1414 XUVs
C:0 T:3 3491 XUs and 2719 XVs -> 123 XUVs
C:0 T:4 36 XUs and 39 XVs -> 0 XUVs
C:0 T:5 60932 XUs and 81314 XVs -> 5962 XUVs
C:0 T:6 39503 XUs and 43179 XVs -> 1957 XUVs
C:0 T:7 327 XUs and 331 XVs -> 13 XUVs
12261 XUVs total
2395 collection wire objects
12261 potential space points
Neighbour search...
1245051 tests to find 557924 neighbours
Iterating with no regularization...
Begin: 3.01346e+07
0 2.81322e+07
1 2.79429e+07
2 2.79277e+07
Now with regularization...
Begin: 2.73887e+07
0 2.7383e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

18-Aug-2024 00:27:56 CEST  Closed output file "np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup.root"
18-Aug-2024 00:27:56 CEST  Closed input file "np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              59.7613       88.0042       177.574       85.1956       24.202         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000380592   0.00185275    0.00441979     0.001774     0.000861496      30     
produce:fembfilter:PDHDFEMBFilter                      0.525379      0.535864      0.571349      0.534639     0.00862541       30     
produce:wclsdatahd:WireCellToolkit                      30.0471       31.3835       32.8544       31.2716      0.757721        30     
produce:gaushit:GausHitFinder                          0.481799      0.629245      0.898166      0.606228      0.102076        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000268412   0.000400343   0.000618548   0.000396182   7.80987e-05      30     
produce:reco3d:SpacePointSolver                        0.435135       1.77444       24.205       0.955605       4.19352        30     
produce:hitpdune:DisambigFromSpacePoints               0.223746      0.495763       1.00098      0.492192       0.17074        30     
produce:pandora:StandardPandora                         6.49375       19.5294       73.0842       15.6877       15.0514        30     
produce:pandoraWriter:StandardPandora                  0.106044      0.164411      0.249972       0.16018      0.0318759       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.478979       1.43704        3.354        1.34378      0.626426        30     
produce:pandoraShower:LArPandoraShowerCreation         0.557005       1.44696       3.26989       1.26133      0.631034        30     
produce:pandoracalo:Calorimetry                        0.295587      0.658508        1.51        0.610225      0.252798        30     
produce:pandoracalonosce:Calorimetry                   0.272836      0.624658       1.55644      0.587787      0.265308        30     
produce:pandorapid:Chi2ParticleID                     0.00118152    0.00187801    0.00321289    0.00181371    0.000404969      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.533425       1.26707       2.85414       1.07644      0.569989        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.518787       1.22316       2.69698       1.05368      0.546469        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0851022     0.124843      0.167049      0.122964      0.0248205       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0304889     0.0451554     0.0616639     0.0432136    0.00853133       30     
produce:emtrkmichelid:EmTrackMichelId                   16.7616       25.1833       35.8676       25.1271       4.14699        30     
[art]:TriggerResults:TriggerResultInserter            1.4858e-05    2.22423e-05   6.6464e-05    1.91805e-05   9.4936e-06       30     
end_path:out1:RootOutput                               3.316e-06    4.42017e-06   1.7874e-05     3.877e-06    2.53397e-06      30     
end_path:michelremoving:michelremoving                 0.0161107     0.0436196      0.26058      0.0231071     0.056148        30     
end_path:michelremovinggnocchi:michelremoving          0.015599      0.0417106     0.251979      0.021191      0.0551591       30     
end_path:calibanagnocchi:CalibAnaTree                   0.19327      0.472765       1.05761      0.410023      0.203711        30     
end_path:out1:RootOutput(write)                        0.526548      0.778347       1.09073      0.773798      0.134233        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4928.06 MB
  Peak resident set size usage (VmHWM): 2610.91 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup.root
\tHists: np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723931003.0,
    "core.end_time": 1723933676.0,
    "core.events": [
      108217,
      108225,
      108257,
      108265,
      108273,
      108281,
      108289,
      108297,
      108305,
      108313,
      108321,
      108329,
      108337,
      108345,
      108353,
      108361,
      108369,
      108377,
      108385,
      108393,
      108401,
      108409,
      108417,
      108425,
      108433,
      108441,
      108449,
      108457,
      108473,
      108481
    ],
    "core.event_count": 30,
    "core.first_event_number": 108217,
    "core.last_event_number": 108481,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28758
    ],
    "core.runs_subruns": [
      2875800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931_reco_stage1_reco_stage2_20240817T222756_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723931003.0,
    "core.end_time": 1723933676.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28758
    ],
    "core.runs_subruns": [
      2875800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028758_0451_dataflow1_datawriter_0_20240817T181931.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:21:47 UTC       justIN version: 01.01.09