justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59676.4@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59676.4@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 09:33:25
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-19 10:35:47
From worker nodeHostnamewn-lot-028.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 09:33:48
Input fileshd-protodune:np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232.hdf5
JobscriptExit code0
Real time1h (3658s)
CPU time56m (3360s = 91%)
Outputting started2024-08-19 10:34:47
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup_hists.root
Finished2024-08-19 10:35:47
Saved logsjustin-logs:59676.4-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: tagging trace set: gauss with 54167 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54167 traces tagged "gauss"
FrameSaver: q=1.25539e+06 n=1024729 tag=gauss
wclsFrameSaver: saving 70151 traces tagged "wiener"
FrameSaver: q=1.34488e+06 n=936710 tag=wiener
3773 hits in TPC 0
2537 hits in TPC 1
7105 hits in TPC 2
4198 hits in TPC 3
4570 hits in TPC 4
9362 hits in TPC 5
2581 hits in TPC 6
2306 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1605 XUs and 881 XVs -> 80 XUVs
C:0 T:2 21375 XUs and 20617 XVs -> 753 XUVs
C:0 T:3 5 XUs and 27 XVs -> 1 XUVs
C:0 T:4 430 XUs and 686 XVs -> 41 XUVs
C:0 T:5 25051 XUs and 35947 XVs -> 1717 XUVs
C:0 T:6 5377 XUs and 5964 XVs -> 209 XUVs
C:0 T:7 13 XUs and 23 XVs -> 0 XUVs
2801 XUVs total
1443 collection wire objects
2801 potential space points
Neighbour search...
52729 tests to find 32660 neighbours
Iterating with no regularization...
Begin: 1.26443e+07
0 1.20978e+07
1 1.20522e+07
2 1.2046e+07
Now with regularization...
Begin: 1.12993e+07
0 1.12977e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 12:34:40 CEST  Closed output file "np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup.root"
19-Aug-2024 12:34:40 CEST  Closed input file "np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.5454       85.2704       135.657       85.9513       18.2366        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000441335   0.00163813    0.00338087    0.00154809    0.000796551      30     
produce:fembfilter:PDHDFEMBFilter                      0.571632      0.583475       0.61547      0.581694      0.0104406       30     
produce:wclsdatahd:WireCellToolkit                      30.9586       32.5938       34.5741       32.6221      0.837325        30     
produce:gaushit:GausHitFinder                          0.330574      0.662353       1.0502       0.637355      0.165005        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000193532   0.000345608   0.000520674   0.000343873   8.36408e-05      30     
produce:reco3d:SpacePointSolver                        0.214082      0.798756       2.00226      0.618173      0.487506        30     
produce:hitpdune:DisambigFromSpacePoints               0.121253      0.475983       1.15561       0.50814      0.214581        30     
produce:pandora:StandardPandora                         5.77507       16.7942       38.5015       14.1492       8.76992        30     
produce:pandoraWriter:StandardPandora                  0.0873022      0.15768      0.259703      0.160065      0.0381901       30     
produce:pandoraTrack:LArPandoraTrackCreation            0.30564       1.30026       3.28227       1.18213      0.619367        30     
produce:pandoraShower:LArPandoraShowerCreation         0.260134       1.39475       4.04816       1.22386      0.770235        30     
produce:pandoracalo:Calorimetry                        0.169958      0.626036       1.46403      0.617153      0.264741        30     
produce:pandoracalonosce:Calorimetry                   0.149951      0.573873       1.35537      0.577125      0.248788        30     
produce:pandorapid:Chi2ParticleID                     0.000929909   0.00177784     0.0031568    0.00180733    0.000452744      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.22781       1.24379       3.46446       1.05749      0.652528        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.222123       1.20937       3.3794        1.01889      0.633284        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0599547      0.13233      0.205485       0.12528      0.0344086       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0217881     0.0476856     0.0746609     0.0467717     0.0116508       30     
produce:emtrkmichelid:EmTrackMichelId                   15.1158       25.1646       39.3896       25.7982       5.55492        30     
[art]:TriggerResults:TriggerResultInserter            1.4868e-05    1.92723e-05   6.0513e-05    1.74575e-05   8.06916e-06      30     
end_path:out1:RootOutput                               3.566e-06    4.52443e-06   1.8585e-05     4.093e-06    2.63144e-06      30     
end_path:michelremoving:michelremoving                 0.0109691     0.0550281     0.225627      0.0264027     0.0589889       30     
end_path:michelremovinggnocchi:michelremoving          0.0103999     0.0537377     0.224836      0.0252627     0.0589499       30     
end_path:calibanagnocchi:CalibAnaTree                   0.10951      0.466106       1.23961      0.475376      0.214608        30     
end_path:out1:RootOutput(write)                        0.398121      0.813496       1.2908       0.811858      0.188662        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4950.48 MB
  Peak resident set size usage (VmHWM): 2632 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup.root
\tHists: np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724061088.0,
    "core.end_time": 1724063680.0,
    "core.events": [
      389041,
      389049,
      389057,
      389065,
      389073,
      389081,
      389089,
      389097,
      389105,
      389113,
      389121,
      389129,
      389137,
      389145,
      389153,
      389161,
      389169,
      389177,
      389185,
      389193,
      389201,
      389209,
      389217,
      389225,
      389233,
      389241,
      389249,
      389257,
      389265,
      389273
    ],
    "core.event_count": 30,
    "core.first_event_number": 389041,
    "core.last_event_number": 389273,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232_reco_stage1_reco_stage2_20240819T103440_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724061088.0,
    "core.end_time": 1724063680.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1621_dataflow1_datawriter_0_20240819T044232.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:26:04 UTC       justIN version: 01.01.08