justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263797.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263797.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3386
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 13:39:49
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2024-09-27 11:05:00
From worker nodeHostnamemilan14.farm.particle.cz
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 13:40:56
Input fileshd-protodune:np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021.hdf5
JobscriptExit code0
Real time21h (76973s)
CPU time20h (75484s = 98%)
Outputting started2024-09-27 11:03:50
Output fileshd-protodune-det-reco:np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup_hists.root
Finished2024-09-27 11:05:00
Saved logsjustin-logs:263797.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

tag=gauss
wclsFrameSaver: saving 77519 traces tagged "wiener"
FrameSaver: q=1.34895e+06 n=975765 tag=wiener
5281 hits in TPC 0
4690 hits in TPC 1
7464 hits in TPC 2
4327 hits in TPC 3
3361 hits in TPC 4
6094 hits in TPC 5
5144 hits in TPC 6
3857 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1220 XUs and 1442 XVs -> 113 XUVs
C:0 T:2 22313 XUs and 47624 XVs -> 2140 XUVs
C:0 T:3 89 XUs and 110 XVs -> 3 XUVs
C:0 T:4 119 XUs and 198 XVs -> 11 XUVs
C:0 T:5 28351 XUs and 25768 XVs -> 703 XUVs
C:0 T:6 13563 XUs and 11040 XVs -> 229 XUVs
C:0 T:7 212 XUs and 298 XVs -> 13 XUVs
3212 XUVs total
1398 collection wire objects
3212 potential space points
Neighbour search...
136060 tests to find 70534 neighbours
Iterating with no regularization...
Begin: 7.02868e+06
0 6.34076e+06
1 6.28328e+06
2 6.27433e+06
3 6.27057e+06
Now with regularization...
Begin: 5.92835e+06
0 5.92612e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:03:41 CEST  Closed output file "np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup.root"
27-Sep-2024 13:03:41 CEST  Closed input file "np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.8871       2526.75        73480        80.343        13175.7        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000346781   0.00110291    0.00255953    0.000916677   0.000537582      30     
produce:fembfilter:PDHDFEMBFilter                      0.432277      0.628409      0.702916       0.64956      0.0742231       30     
produce:wclsdatahd:WireCellToolkit                      25.2216       33.6092       36.3834       34.9103       3.0366         30     
produce:gaushit:GausHitFinder                           0.33815      0.648057      0.951598      0.712467      0.184603        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000170221   0.000291682   0.000547972   0.000273901   9.13808e-05      30     
produce:reco3d:SpacePointSolver                        0.146638      0.886258       3.38133       0.67978      0.731566        30     
produce:hitpdune:DisambigFromSpacePoints               0.164238      0.555727       1.37346      0.515131      0.323971        30     
produce:pandora:StandardPandora                         4.00444       2457.38       73402.8       11.0566       13174.2        30     
produce:pandoraWriter:StandardPandora                  0.0678505     0.140751      0.261417      0.139723      0.0440588       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.299735      0.861208       1.62714      0.795924      0.331951        30     
produce:pandoraShower:LArPandoraShowerCreation          0.17364       1.08497       2.57886       1.06796      0.507085        30     
produce:pandoracalo:Calorimetry                        0.158352      0.489054      0.869561      0.470873      0.176441        30     
produce:pandoracalonosce:Calorimetry                   0.139945      0.440532      0.803679      0.412949      0.162002        30     
produce:pandorapid:Chi2ParticleID                     0.000918162    0.0016831    0.00371171    0.00163188    0.000608671      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.147882      0.980743       2.55714      0.980663      0.486595        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.140951       0.9563        2.47455      0.954139      0.470552        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0562199     0.128464      0.205505      0.132106      0.0402122       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0203285     0.0418209     0.0651548     0.0437045      0.01283        30     
produce:emtrkmichelid:EmTrackMichelId                   14.6143       26.4818       39.0479       26.0727       6.59585        30     
[art]:TriggerResults:TriggerResultInserter             1.273e-05    2.40544e-05    7.622e-05    2.1715e-05    1.08359e-05      30     
end_path:out1:RootOutput                                3.6e-06     2.1718e-05    0.00033593     9.56e-06     5.85333e-05      30     
end_path:michelremoving:michelremoving                 0.0127377     0.0811993     0.422274      0.0304492     0.0934661       30     
end_path:michelremovinggnocchi:michelremoving          0.011425      0.0776561     0.410097      0.0250106     0.0927943       30     
end_path:calibanagnocchi:CalibAnaTree                  0.123115      0.390956      0.783557       0.37124      0.149936        30     
end_path:out1:RootOutput(write)                        0.425894       0.8255        1.23873      0.846722      0.214477        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4941.45 MB
  Peak resident set size usage (VmHWM): 2597.69 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup.root
\tHists: np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727359181.0,
    "core.end_time": 1727435021.0,
    "core.events": [
      416404,
      416412,
      416420,
      416428,
      416436,
      416444,
      416452,
      416460,
      416468,
      416476,
      416484,
      416492,
      416500,
      416508,
      416516,
      416524,
      416532,
      416540,
      416548,
      416556,
      416564,
      416572,
      416580,
      416588,
      416596,
      416604,
      416612,
      416620,
      416628,
      416636
    ],
    "core.event_count": 30,
    "core.first_event_number": 416404,
    "core.last_event_number": 416636,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021_reco_stage1_reco_stage2_20240927T110341_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727359181.0,
    "core.end_time": 1727435021.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_1735_dataflow4_datawriter_0_20240831T145021.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:37:07 UTC       justIN version: 01.01.09