justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244851.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244851.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 09:10:30
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-19 10:13:50
From worker nodeHostnamewn-snel-025.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 09:11:53
Input fileshd-protodune:np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713.hdf5
JobscriptExit code0
Real time1h (3641s)
CPU time55m (3333s = 91%)
Outputting started2024-08-19 10:12:40
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup_hists.root
Finished2024-08-19 10:13:50
Saved logsjustin-logs:244851.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

gger: tagging trace set: wiener with 63251 traces, 63251 summary
Retagger: tagging trace set: gauss with 47296 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47296 traces tagged "gauss"
FrameSaver: q=1.09125e+06 n=867348 tag=gauss
wclsFrameSaver: saving 63251 traces tagged "wiener"
FrameSaver: q=1.17274e+06 n=794230 tag=wiener
2260 hits in TPC 0
2721 hits in TPC 1
6488 hits in TPC 2
4046 hits in TPC 3
4588 hits in TPC 4
6411 hits in TPC 5
3942 hits in TPC 6
2156 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 193 XUs and 73 XVs -> 0 XUVs
C:0 T:2 24710 XUs and 22636 XVs -> 1205 XUVs
C:0 T:3 446 XUs and 485 XVs -> 7 XUVs
C:0 T:4 34 XUs and 35 XVs -> 0 XUVs
C:0 T:5 38060 XUs and 26173 XVs -> 1165 XUVs
C:0 T:6 6690 XUs and 15207 XVs -> 259 XUVs
C:0 T:7 334 XUs and 741 XVs -> 23 XUVs
2659 XUVs total
1157 collection wire objects
2659 potential space points
Neighbour search...
118453 tests to find 75072 neighbours
Iterating with no regularization...
Begin: 8.91255e+06
0 8.37601e+06
1 8.35154e+06
2 8.34828e+06
Now with regularization...
Begin: 7.91727e+06
0 7.91613e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 12:12:27 CEST  Closed output file "np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup.root"
19-Aug-2024 12:12:27 CEST  Closed input file "np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              41.6325       84.1134       125.743       81.883        18.6582        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000391755   0.00162179    0.00244492    0.00179116    0.000568214      30     
produce:fembfilter:PDHDFEMBFilter                      0.531291      0.547796      0.584184       0.54246      0.0135304       30     
produce:wclsdatahd:WireCellToolkit                      31.135        32.8792       36.7913       32.5569       1.1878         30     
produce:gaushit:GausHitFinder                          0.307301      0.697971       3.00653      0.617749      0.449093        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000257945   0.00057887    0.00306513    0.00048734    0.000485546      30     
produce:reco3d:SpacePointSolver                        0.142704       1.13584       4.13586      0.791069      0.896118        29     
produce:hitpdune:DisambigFromSpacePoints               0.103289      0.488859      0.970882      0.427582      0.219913        29     
produce:pandora:StandardPandora                         4.77272       16.2144       40.9103       14.748        8.26705        29     
produce:pandoraWriter:StandardPandora                  0.0688012     0.159881      0.242066      0.158717      0.040069        29     
produce:pandoraTrack:LArPandoraTrackCreation           0.301213       1.27374       2.53845       1.19962      0.569557        29     
produce:pandoraShower:LArPandoraShowerCreation         0.271102       1.37257       3.81419       1.24289      0.810812        29     
produce:pandoracalo:Calorimetry                        0.183331       0.63315       1.31068      0.616257      0.261806        29     
produce:pandoracalonosce:Calorimetry                   0.155436      0.563784       1.10055      0.558473       0.23123        29     
produce:pandorapid:Chi2ParticleID                     0.00108629     0.0018849    0.00367708    0.00187574    0.000470172      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.226438       1.22641       3.32005       1.11226      0.729003        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.217124       1.19527       3.13997       1.07213      0.731255        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0678883     0.121977       0.18946      0.122655      0.0280929       29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0236043     0.0446307     0.0682813     0.0455428     0.0104614       29     
produce:emtrkmichelid:EmTrackMichelId                   12.7525       25.7033       36.1751       25.7523       5.33507        29     
[art]:TriggerResults:TriggerResultInserter            1.4888e-05    2.03825e-05   7.0793e-05    1.74925e-05   1.06112e-05      30     
end_path:out1:RootOutput                               3.637e-06    4.8424e-06    1.9206e-05     4.208e-06    2.85953e-06      30     
end_path:michelremoving:michelremoving                2.0328e-05     0.0809811     0.295364      0.0294414     0.0808309       30     
end_path:michelremovinggnocchi:michelremoving          4.909e-06     0.0796946      0.29347      0.0259512     0.0827286       30     
end_path:calibanagnocchi:CalibAnaTree                  4.078e-06     0.450135      0.967492      0.435509      0.212878        30     
end_path:out1:RootOutput(write)                        0.388436      0.786912       1.21213      0.781134      0.183001        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4999.34 MB
  Peak resident set size usage (VmHWM): 2678.67 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup.root
\tHists: np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724059790.0,
    "core.end_time": 1724062347.0,
    "core.events": [
      344155,
      344163,
      344179,
      344187,
      344195,
      344203,
      344211,
      344219,
      344227,
      344235,
      344243,
      344251,
      344259,
      344267,
      344275,
      344283,
      344291,
      344299,
      344307,
      344315,
      344323,
      344331,
      344339,
      344347,
      344355,
      344363,
      344379,
      344387,
      344395,
      344403
    ],
    "core.event_count": 30,
    "core.first_event_number": 344155,
    "core.last_event_number": 344403,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713_reco_stage1_reco_stage2_20240819T101227_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724059790.0,
    "core.end_time": 1724062347.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1434_dataflow3_datawriter_0_20240819T023713.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:27:59 UTC       justIN version: 01.01.08