justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59583.122@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59583.122@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 07:10:14
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 08:25:41
From worker nodeHostnamewn-lot-020.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:18:39
Input fileshd-protodune:np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332.hdf5
JobscriptExit code0
Real time1h (3950s)
CPU time1h (3661s = 92%)
Outputting started2024-08-19 08:24:29
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup_hists.root
Finished2024-08-19 08:25:41
Saved logsjustin-logs:59583.122-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

to 5859 ticks
wclsFrameSaver: saving 50084 traces tagged "gauss"
FrameSaver: q=1.1311e+06 n=1008782 tag=gauss
wclsFrameSaver: saving 63049 traces tagged "wiener"
FrameSaver: q=1.20933e+06 n=929532 tag=wiener
6323 hits in TPC 0
5137 hits in TPC 1
2397 hits in TPC 2
2044 hits in TPC 3
4310 hits in TPC 4
6412 hits in TPC 5
6649 hits in TPC 6
3805 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 6475 XUs and 3065 XVs -> 473 XUVs
C:0 T:2 2780 XUs and 4305 XVs -> 199 XUVs
C:0 T:3 99 XUs and 133 XVs -> 5 XUVs
C:0 T:4 478 XUs and 279 XVs -> 11 XUVs
C:0 T:5 30866 XUs and 14711 XVs -> 552 XUVs
C:0 T:6 15895 XUs and 23157 XVs -> 526 XUVs
C:0 T:7 264 XUs and 405 XVs -> 7 XUVs
1773 XUVs total
1022 collection wire objects
1773 potential space points
Neighbour search...
26005 tests to find 12918 neighbours
Iterating with no regularization...
Begin: 1.46489e+07
0 1.41211e+07
1 1.41016e+07
2 1.41008e+07
Now with regularization...
Begin: 1.3653e+07
0 1.36528e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 10:24:20 CEST  Closed output file "np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup.root"
19-Aug-2024 10:24:20 CEST  Closed input file "np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.8534       93.7766       147.155       90.7758       19.4108        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000452839   0.00226479    0.00437581    0.00252472    0.00111053       30     
produce:fembfilter:PDHDFEMBFilter                      0.489608      0.579727      0.838662      0.556778      0.071219        30     
produce:wclsdatahd:WireCellToolkit                      26.4231       36.3298       39.6049       37.9785       3.81317        30     
produce:gaushit:GausHitFinder                          0.382818      0.635887      0.991431      0.628692      0.147518        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000254867   0.000347963   0.000498915   0.00033913    6.74181e-05      30     
produce:reco3d:SpacePointSolver                        0.237791       1.08968       2.68493      0.916772      0.708618        30     
produce:hitpdune:DisambigFromSpacePoints               0.155337      0.464224       1.12923       0.44273       0.19852        30     
produce:pandora:StandardPandora                         4.85774       18.009        43.2794       17.4347       9.42395        30     
produce:pandoraWriter:StandardPandora                  0.0960982     0.154534      0.236073      0.147279      0.0339147       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.539392       1.26518       2.94252       1.1943       0.556183        30     
produce:pandoraShower:LArPandoraShowerCreation         0.356688       1.37471       3.15766       1.20681      0.703026        30     
produce:pandoracalo:Calorimetry                         0.24133      0.588729       1.23679      0.560592      0.220014        30     
produce:pandoracalonosce:Calorimetry                   0.207584      0.537553       1.10449      0.523552      0.202097        30     
produce:pandorapid:Chi2ParticleID                     0.00107138    0.00164264    0.00264325    0.00159143    0.000339033      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.269022       1.20046       2.79869       1.05074      0.610437        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.25857       1.15802       2.70687       1.00466      0.583273        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0577747     0.123984      0.166564      0.125444      0.0259483       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0219711     0.0436983     0.0578306     0.043337     0.00892355       30     
produce:emtrkmichelid:EmTrackMichelId                   16.7434       27.9745       42.863        26.734        5.95191        30     
[art]:TriggerResults:TriggerResultInserter            1.9907e-05    2.77125e-05   7.2526e-05    2.44855e-05   1.01451e-05      30     
end_path:out1:RootOutput                               3.868e-06    5.21603e-06   2.0839e-05     4.704e-06    2.93233e-06      30     
end_path:michelremoving:michelremoving                 0.0232794      0.14797      0.478515       0.04509      0.141513        30     
end_path:michelremovinggnocchi:michelremoving          0.0231123     0.146748      0.483169      0.0449856     0.141547        30     
end_path:calibanagnocchi:CalibAnaTree                  0.299054      0.716061       1.42802      0.657957      0.293481        30     
end_path:out1:RootOutput(write)                        0.757738       1.09144       1.36516       1.09196      0.153595        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4969.35 MB
  Peak resident set size usage (VmHWM): 2647.8 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup.root
\tHists: np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724053009.0,
    "core.end_time": 1724055861.0,
    "core.events": [
      362138,
      362146,
      362178,
      362186,
      362194,
      362202,
      362210,
      362218,
      362226,
      362234,
      362242,
      362250,
      362258,
      362266,
      362274,
      362282,
      362290,
      362298,
      362306,
      362314,
      362322,
      362330,
      362338,
      362354,
      362362,
      362370,
      362378,
      362386,
      362394,
      362402
    ],
    "core.event_count": 30,
    "core.first_event_number": 362138,
    "core.last_event_number": 362402,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332_reco_stage1_reco_stage2_20240819T082420_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724053009.0,
    "core.end_time": 1724055861.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1509_dataflow2_datawriter_0_20240819T032332.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:09:09 UTC       justIN version: 01.01.09