justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59578.15@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59578.15@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 06:55:18
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 08:25:19
From worker nodeHostnamewn-pep-006.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:08:36
Input fileshd-protodune:np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409.hdf5
JobscriptExit code0
Real time1h (4525s)
CPU time1h (4211s = 93%)
Outputting started2024-08-19 08:24:02
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup_hists.root
Finished2024-08-19 08:25:19
Saved logsjustin-logs:59578.15-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3 hits in TPC 2
4393 hits in TPC 3
4964 hits in TPC 4
6201 hits in TPC 5
6361 hits in TPC 6
3252 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 8166 XUs and 5370 XVs -> 477 XUVs
C:0 T:2 38952 XUs and 40335 XVs -> 1347 XUVs
C:0 T:3 77 XUs and 63 XVs -> 1 XUVs
C:0 T:4 722 XUs and 858 XVs -> 11 XUVs
C:0 T:5 35677 XUs and 30009 XVs -> 743 XUVs
C:0 T:6 24395 XUs and 52823 XVs -> 1999 XUVs
C:0 T:7 205 XUs and 582 XVs -> 21 XUVs
4599 XUVs total
1932 collection wire objects
4599 potential space points
Neighbour search...
180605 tests to find 105724 neighbours
Iterating with no regularization...
Begin: 1.16612e+07
0 1.02883e+07
1 1.02062e+07
2 1.01965e+07
Now with regularization...
Begin: 9.70108e+06
0 9.69833e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 354955 TrkackID 2 startx, y, z 36.0453 516.284 452.542  wireno, peakt tpcno 275 2317.62 6 dist 439.326min T, max_T595.538 2345.19
no of hits closeby  1   event 354955 TrkackID 2 startx, y, z 36.0453 516.284 452.542  wireno, peakt tpcno 275 2317.62 6 dist 439.326min T, max_T595.538 2345.19
19-Aug-2024 10:23:53 CEST  Closed output file "np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup.root"
19-Aug-2024 10:23:53 CEST  Closed input file "np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              79.7212       107.86        141.927       106.554       15.882         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000409111   0.00173751    0.00350576    0.00161305    0.000918283      30     
produce:fembfilter:PDHDFEMBFilter                      0.650021      0.679692      0.751126      0.676541      0.0188339       30     
produce:wclsdatahd:WireCellToolkit                      43.5001       45.5778       46.8963       45.7362      0.800873        30     
produce:gaushit:GausHitFinder                          0.598779      0.855604       1.13474      0.860273      0.126906        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000422852   0.000587252   0.000760509   0.000571631   8.21133e-05      30     
produce:reco3d:SpacePointSolver                        0.226492       1.00137       3.5536       0.770225      0.676223        30     
produce:hitpdune:DisambigFromSpacePoints               0.329939      0.686771       1.29737      0.661383      0.212432        30     
produce:pandora:StandardPandora                         8.59811       23.0938       58.186        22.7669       9.65724        30     
produce:pandoraWriter:StandardPandora                  0.118036      0.176298       0.2468       0.176794      0.0324624       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.846275       1.9041        4.05735       1.8138       0.658538        30     
produce:pandoraShower:LArPandoraShowerCreation          1.05466       1.90243       4.58758       1.63425      0.837524        30     
produce:pandoracalo:Calorimetry                         0.46685       0.87119       1.84244      0.820942      0.276286        30     
produce:pandoracalonosce:Calorimetry                   0.410256      0.803846       1.65226      0.761749      0.254492        30     
produce:pandorapid:Chi2ParticleID                     0.00145883    0.00201151    0.00350176    0.00193184    0.000409275      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.889557       1.63443       4.28906       1.41638      0.722593        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.856153       1.58029       4.12748       1.37454      0.698701        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0959318     0.133577      0.204621      0.130869      0.0233223       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0364562     0.0509598     0.0776516     0.0485886    0.00933701       30     
produce:emtrkmichelid:EmTrackMichelId                   18.1516       25.0662       34.4591       24.8336       4.32854        30     
[art]:TriggerResults:TriggerResultInserter            3.1724e-05    4.24602e-05   9.0113e-05    4.0904e-05    1.1005e-05       30     
end_path:out1:RootOutput                               8.204e-06    1.11949e-05   2.6058e-05    1.03955e-05   3.33867e-06      30     
end_path:michelremoving:michelremoving                 0.0282584     0.0859412     0.186206      0.0462253     0.0549756       30     
end_path:michelremovinggnocchi:michelremoving          0.0239195     0.0809146     0.179418      0.0405534     0.0555367       30     
end_path:calibanagnocchi:CalibAnaTree                  0.402764      0.666141       1.33786       0.65722      0.184699        30     
end_path:out1:RootOutput(write)                        0.613714      0.874285       1.24292      0.849774       0.14127        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4957.54 MB
  Peak resident set size usage (VmHWM): 2637.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup.root
\tHists: np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052561.0,
    "core.end_time": 1724055833.0,
    "core.events": [
      354723,
      354731,
      354739,
      354747,
      354755,
      354763,
      354771,
      354779,
      354787,
      354795,
      354803,
      354811,
      354819,
      354827,
      354835,
      354843,
      354851,
      354859,
      354867,
      354875,
      354883,
      354891,
      354899,
      354907,
      354915,
      354923,
      354931,
      354939,
      354947,
      354955
    ],
    "core.event_count": 30,
    "core.first_event_number": 354723,
    "core.last_event_number": 354955,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409_reco_stage1_reco_stage2_20240819T082353_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052561.0,
    "core.end_time": 1724055833.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1478_dataflow3_datawriter_0_20240819T030409.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:22:34 UTC       justIN version: 01.01.08