justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 58793.33@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID58793.33@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2863
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-17 07:17:11
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug
Last heartbeat2024-08-17 08:22:08
From worker nodeHostnamewn-lot-028.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-17 07:19:37
Input fileshd-protodune:np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254.hdf5
Outputting started2024-08-17 08:21:07
Output files
Finished2024-08-17 08:22:08
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

th 49829 traces, 49829 summary
Retagger: tagging trace set: gauss with 36635 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 36635 traces tagged "gauss"
FrameSaver: q=769471 n=683755 tag=gauss
wclsFrameSaver: saving 49829 traces tagged "wiener"
FrameSaver: q=824595 n=619256 tag=wiener
3809 hits in TPC 0
3331 hits in TPC 1
2404 hits in TPC 2
1386 hits in TPC 3
2639 hits in TPC 4
5181 hits in TPC 5
4862 hits in TPC 6
3447 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 327 XUs and 699 XVs -> 7 XUVs
C:0 T:2 4588 XUs and 2922 XVs -> 324 XUVs
C:0 T:3 114 XUs and 88 XVs -> 4 XUVs
C:0 T:4 263 XUs and 390 XVs -> 18 XUVs
C:0 T:5 11203 XUs and 18290 XVs -> 396 XUVs
C:0 T:6 15672 XUs and 14436 XVs -> 393 XUVs
C:0 T:7 167 XUs and 245 XVs -> 25 XUVs
1167 XUVs total
668 collection wire objects
1167 potential space points
Neighbour search...
24393 tests to find 15128 neighbours
Iterating with no regularization...
Begin: 5.04572e+06
0 4.7179e+06
1 4.69424e+06
2 4.69197e+06
Now with regularization...
Begin: 4.42731e+06
0 4.42652e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

17-Aug-2024 10:21:00 CEST  Closed output file "np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup.root"
17-Aug-2024 10:21:00 CEST  Closed input file "np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              61.2351       85.9144       139.399       82.9369       17.3059        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000398906   0.00176039    0.00246445    0.00183616    0.000627968      30     
produce:fembfilter:PDHDFEMBFilter                      0.580301      0.599268      0.721308      0.590885      0.026016        30     
produce:wclsdatahd:WireCellToolkit                      32.3062       33.7433       35.3449       33.5917       0.7495         30     
produce:gaushit:GausHitFinder                          0.443649      0.652973       1.0427       0.646226      0.138878        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000269665   0.00039681    0.000613708   0.00037924    0.000105439      30     
produce:reco3d:SpacePointSolver                        0.191065       1.17111       4.11667      0.831968      0.943083        30     
produce:hitpdune:DisambigFromSpacePoints               0.194989      0.512096       1.32141       0.44766      0.258081        30     
produce:pandora:StandardPandora                         5.93011       15.5319       42.1467       13.9789       8.84767        30     
produce:pandoraWriter:StandardPandora                  0.107571      0.158903      0.248609      0.155321      0.0328104       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.618712       1.34737       2.96174       1.28789      0.585651        30     
produce:pandoraShower:LArPandoraShowerCreation          0.59413       1.38493       3.65509       1.22646      0.648914        30     
produce:pandoracalo:Calorimetry                        0.330303      0.652505       1.34876      0.609112      0.239378        30     
produce:pandoracalonosce:Calorimetry                    0.2956       0.603326       1.26526      0.555108      0.234156        30     
produce:pandorapid:Chi2ParticleID                     0.00125223    0.00192243    0.00439391    0.00181674    0.000627155      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.548996       1.24379       3.38728       1.11931      0.593564        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.534417       1.21101       3.41282       1.07981      0.591861        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0912475     0.138234      0.200238      0.128519      0.0297365       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0334684     0.0484473     0.0695868     0.0460854    0.00954735       30     
produce:emtrkmichelid:EmTrackMichelId                   17.466        25.3209       38.069        24.7746       4.81106        30     
[art]:TriggerResults:TriggerResultInserter            1.4097e-05    1.98548e-05   7.0001e-05    1.74825e-05   9.58457e-06      30     
end_path:out1:RootOutput                               3.847e-06    5.0875e-06    1.9376e-05     4.393e-06    2.79465e-06      30     
end_path:michelremoving:michelremoving                 0.0159368     0.0760742     0.258011      0.0299196     0.0700572       30     
end_path:michelremovinggnocchi:michelremoving          0.0156245     0.075373      0.255431      0.0268387     0.0703307       30     
end_path:calibanagnocchi:CalibAnaTree                  0.220245      0.490074       1.07577      0.447448      0.196392        30     
end_path:out1:RootOutput(write)                         0.56423       0.82607       1.2798       0.789291      0.164769        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4933.43 MB
  Peak resident set size usage (VmHWM): 2618.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup.root
\tHists: np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723880248.0,
    "core.end_time": 1723882860.0,
    "core.events": [
      89282,
      89290,
      89298,
      89306,
      89314,
      89322,
      89330,
      89338,
      89346,
      89354,
      89362,
      89370,
      89378,
      89386,
      89394,
      89402,
      89410,
      89418,
      89426,
      89434,
      89442,
      89450,
      89458,
      89466,
      89474,
      89482,
      89490,
      89498,
      89514,
      89522
    ],
    "core.event_count": 30,
    "core.first_event_number": 89282,
    "core.last_event_number": 89522,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28751
    ],
    "core.runs_subruns": [
      2875100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254_reco_stage1_reco_stage2_20240817T082100_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723880248.0,
    "core.end_time": 1723882860.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28751
    ],
    "core.runs_subruns": [
      2875100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028751_0372_dataflow2_datawriter_0_20240817T063254.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:24:35 UTC       justIN version: 01.01.09