justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263058.97@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263058.97@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:54:16
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2024-09-26 09:46:42
From worker nodeHostnameb9p11p2705.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:56:28
Input fileshd-protodune:np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023.hdf5
Outputting started2024-09-26 08:50:06
Output files
Finished2024-09-26 09:46:42
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

put nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66379 traces, 66379 summary
Retagger: tagging trace set: gauss with 49964 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49964 traces tagged "gauss"
FrameSaver: q=1.09797e+06 n=946728 tag=gauss
wclsFrameSaver: saving 66379 traces tagged "wiener"
FrameSaver: q=1.16992e+06 n=855520 tag=wiener
3800 hits in TPC 0
2962 hits in TPC 1
8378 hits in TPC 2
5876 hits in TPC 3
2650 hits in TPC 4
3124 hits in TPC 5
4910 hits in TPC 6
2871 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 971 XUs and 1159 XVs -> 93 XUVs
C:0 T:2 54249 XUs and 26922 XVs -> 766 XUVs
C:0 T:3 484 XUs and 420 XVs -> 13 XUVs
C:0 T:4 329 XUs and 288 XVs -> 14 XUVs
C:0 T:5 4922 XUs and 3902 XVs -> 93 XUVs
C:0 T:6 14459 XUs and 20014 XVs -> 895 XUVs
C:0 T:7 131 XUs and 215 XVs -> 4 XUVs
1878 XUVs total
918 collection wire objects
1878 potential space points
Neighbour search...
55516 tests to find 34596 neighbours
Iterating with no regularization...
Begin: 6.14192e+06
0 5.9009e+06
1 5.88589e+06
2 5.88498e+06
Now with regularization...
Begin: 5.6452e+06
0 5.64494e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 10:49:54 CEST  Closed output file "np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup.root"
26-Sep-2024 10:49:54 CEST  Closed input file "np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.9213       79.9415       110.225       77.2511       13.275         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000377332   0.00188166    0.00355005    0.00199742    0.000904684      30     
produce:fembfilter:PDHDFEMBFilter                      0.473061      0.590392      0.774334      0.541879      0.0935471       30     
produce:wclsdatahd:WireCellToolkit                      32.2135       35.3447       39.4278       35.4612       2.30101        30     
produce:gaushit:GausHitFinder                           0.34264      0.542287      0.932224      0.526779      0.126461        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000198581   0.000270373   0.000420222   0.000257211   5.76465e-05      30     
produce:reco3d:SpacePointSolver                        0.156366      0.673552       1.74025      0.537239      0.422495        30     
produce:hitpdune:DisambigFromSpacePoints               0.130847      0.379992       0.99292      0.323996      0.192738        30     
produce:pandora:StandardPandora                         4.28036       9.23579       18.8755       8.57763       3.93121        30     
produce:pandoraWriter:StandardPandora                  0.0713293     0.115277      0.220249      0.104432      0.0399671       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.370741      0.846842       1.56489      0.724737      0.336496        30     
produce:pandoraShower:LArPandoraShowerCreation         0.427068      0.965736       1.95046      0.882821       0.37368        30     
produce:pandoracalo:Calorimetry                        0.195344      0.484378      0.999362      0.430508      0.190116        30     
produce:pandoracalonosce:Calorimetry                   0.175904      0.449464      0.904144      0.410833      0.172366        30     
produce:pandorapid:Chi2ParticleID                     0.000933506   0.00147012    0.00252322     0.0013889    0.000400543      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.352319      0.964129       2.05304      0.853252      0.435075        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.392482      0.934224       2.16405      0.797953      0.397988        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0603519     0.104271      0.182042      0.0972025     0.0320611       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0217023     0.0335024     0.0634897     0.0298003     0.0104214       30     
produce:emtrkmichelid:EmTrackMichelId                   17.1173       26.9893       43.6154       25.7547       6.7481         30     
[art]:TriggerResults:TriggerResultInserter             1.513e-05    2.96375e-05   7.4611e-05     2.527e-05    1.27319e-05      30     
end_path:out1:RootOutput                               6.89e-06     1.02364e-05    3.948e-05    8.3705e-06    6.10024e-06      30     
end_path:michelremoving:michelremoving                 0.0159465     0.0613338     0.286001      0.0302005     0.0622688       30     
end_path:michelremovinggnocchi:michelremoving          0.0138049     0.0586397     0.279994      0.0262223     0.0625536       30     
end_path:calibanagnocchi:CalibAnaTree                  0.155203      0.381492      0.714667       0.32052      0.133789        30     
end_path:out1:RootOutput(write)                        0.391982      0.678882       1.23529      0.643773      0.196838        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4978.16 MB
  Peak resident set size usage (VmHWM): 2592.42 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup.root
\tHists: np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338162.0,
    "core.end_time": 1727340595.0,
    "core.events": [
      92882,
      92890,
      92898,
      92906,
      92914,
      92922,
      92930,
      92938,
      92946,
      92954,
      92962,
      92970,
      92978,
      92986,
      92994,
      93002,
      93010,
      93018,
      93026,
      93034,
      93042,
      93050,
      93058,
      93066,
      93074,
      93082,
      93090,
      93098,
      93106,
      93114
    ],
    "core.event_count": 30,
    "core.first_event_number": 92882,
    "core.last_event_number": 93114,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29092
    ],
    "core.runs_subruns": [
      2909200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023_reco_stage1_reco_stage2_20240926T084954_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338162.0,
    "core.end_time": 1727340595.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29092
    ],
    "core.runs_subruns": [
      2909200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029092_0387_dataflow2_datawriter_0_20240905T233023.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:07:18 UTC       justIN version: 01.01.09