justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276383.128@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID276383.128@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3705
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 11:32:12
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-17 13:26:10
From worker nodeHostnamespool0869.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 11:36:02
Input fileshd-protodune:np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031.hdf5
Outputting started2024-10-17 13:17:29
Output files
Finished2024-10-17 14:25:27
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 5
13943 hits in TPC 6
8193 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 44478 XUs and 25589 XVs -> 3495 XUVs
C:0 T:2 118166 XUs and 145339 XVs -> 10246 XUVs
C:0 T:3 1428 XUs and 1356 XVs -> 87 XUVs
C:0 T:4 70 XUs and 94 XVs -> 5 XUVs
C:0 T:5 9416 XUs and 10062 XVs -> 353 XUVs
C:0 T:6 96619 XUs and 197570 XVs -> 11606 XUVs
C:0 T:7 2012 XUs and 3060 XVs -> 192 XUVs
25984 XUVs total
4691 collection wire objects
25984 potential space points
Neighbour search...
4008502 tests to find 1359900 neighbours
Iterating with no regularization...
Begin: 2.62859e+08
0 1.56485e+08
1 1.42153e+08
2 1.41087e+08
3 1.40766e+08
4 1.40632e+08
Now with regularization...
Begin: 1.33955e+08
0 1.33818e+08
1 1.33758e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 34718 TrkackID 24 startx, y, z 61.5489 101.662 446.385  wireno, peakt tpcno 322 490.585 5 dist 0min T, max_T5 773.122
no of hits closeby  1   event 34718 TrkackID 24 startx, y, z 61.5489 101.662 446.385  wireno, peakt tpcno 322 490.585 5 dist 0min T, max_T5 773.122
17-Oct-2024 13:17:19 UTC  Closed output file "np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup.root"
17-Oct-2024 13:17:19 UTC  Closed input file "np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              74.4899       126.697       283.52        120.988       35.9513        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0004556    0.00190936    0.00561054    0.00162915     0.0013341       35     
produce:fembfilter:PDHDFEMBFilter                      0.784867      0.815972       0.99868      0.805326      0.038849        35     
produce:wclsdatahd:WireCellToolkit                      50.116        54.7837       57.7849       54.6902       1.45568        35     
produce:gaushit:GausHitFinder                          0.480502      0.993587       1.82309       1.00784      0.250004        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000304281   0.000521125   0.00108227    0.000482694   0.000152002      35     
produce:reco3d:SpacePointSolver                        0.285488       1.63364       8.61332       1.1752        1.45468        35     
produce:hitpdune:DisambigFromSpacePoints                0.24545      0.873563       3.13903      0.772522       0.49862        35     
produce:pandora:StandardPandora                         6.7622        33.661        141.647       30.0072       23.9771        35     
produce:pandoraWriter:StandardPandora                  0.106336      0.204431      0.333989      0.203767      0.0480739       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.696992       3.16903       8.3656        3.01386       1.42427        35     
produce:pandoraShower:LArPandoraShowerCreation         0.593723       3.10679       8.14228       2.95082       1.53931        35     
produce:pandoracalo:Calorimetry                        0.324285       1.35414       3.4829        1.28864      0.579865        35     
produce:pandoracalonosce:Calorimetry                   0.297185       1.27074       3.34299       1.21086      0.556781        35     
produce:pandorapid:Chi2ParticleID                     0.00137001    0.00231242    0.00372214    0.00229459    0.00050093       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.460186       2.85243       8.1731        2.74998       1.49609        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.445302       2.78275       8.03087       2.60972       1.46273        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0587577     0.136851      0.208507      0.139433      0.0326291       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0223592      0.0541       0.119725      0.0528439     0.0162868       35     
produce:emtrkmichelid:EmTrackMichelId                   9.55391       16.6794       25.5656       16.9662       3.55392        35     
[art]:TriggerResults:TriggerResultInserter            2.8837e-05    4.20043e-05   7.6875e-05    3.9512e-05    1.08037e-05      35     
end_path:out1:RootOutput                               8.21e-06     1.16748e-05   2.7814e-05    1.1101e-05    3.39961e-06      35     
end_path:michelremoving:michelremoving                 0.024511      0.0747722     0.270891      0.0471199     0.0635008       35     
end_path:michelremovinggnocchi:michelremoving          0.0220633     0.0714488     0.278675      0.0434721     0.0644143       35     
end_path:calibanagnocchi:CalibAnaTree                  0.283599      0.984117       2.62866      0.971071      0.418177        35     
end_path:out1:RootOutput(write)                        0.471458      0.949342       1.57722       0.96124      0.233296        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5854.31 MB
  Peak resident set size usage (VmHWM): 2557.46 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup.root
\tHists: np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729166567.0,
    "core.end_time": 1729171040.0,
    "core.events": [
      34582,
      34586,
      34590,
      34594,
      34598,
      34602,
      34606,
      34610,
      34614,
      34618,
      34622,
      34626,
      34630,
      34634,
      34638,
      34642,
      34646,
      34650,
      34654,
      34658,
      34662,
      34666,
      34670,
      34674,
      34678,
      34682,
      34686,
      34690,
      34694,
      34698,
      34702,
      34706,
      34710,
      34714,
      34718
    ],
    "core.event_count": 35,
    "core.first_event_number": 34582,
    "core.last_event_number": 34718,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031_reco_stage1_reco_stage2_20241017T131719_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729166567.0,
    "core.end_time": 1729171040.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0247_dataflow2_datawriter_0_20240624T122031.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:52:33 UTC       justIN version: 01.01.09