justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273525.159@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273525.159@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3671
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-11 11:06:31
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2024-10-11 13:58:59
From worker nodeHostnameccwcondor0574
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-11 11:47:39
Input fileshd-protodune:np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315.hdf5
Outputting started2024-10-11 13:55:26
Output files
Finished2024-10-11 13:58:59
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ith 57261 traces, 57261 summary
Retagger: tagging trace set: gauss with 44658 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 44658 traces tagged "gauss"
FrameSaver: q=1.73832e+06 n=835975 tag=gauss
wclsFrameSaver: saving 57261 traces tagged "wiener"
FrameSaver: q=1.92001e+06 n=763513 tag=wiener
5249 hits in TPC 0
4577 hits in TPC 1
5546 hits in TPC 2
3499 hits in TPC 3
2595 hits in TPC 4
4420 hits in TPC 5
5626 hits in TPC 6
5727 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 37271 XUs and 17467 XVs -> 2956 XUVs
C:0 T:2 14165 XUs and 16460 XVs -> 1029 XUVs
C:0 T:3 84 XUs and 67 XVs -> 4 XUVs
C:0 T:4 119 XUs and 81 XVs -> 4 XUVs
C:0 T:5 8535 XUs and 5921 XVs -> 86 XUVs
C:0 T:6 19047 XUs and 17881 XVs -> 507 XUVs
C:0 T:7 2879 XUs and 4095 XVs -> 384 XUVs
4970 XUVs total
1398 collection wire objects
4970 potential space points
Neighbour search...
302752 tests to find 108060 neighbours
Iterating with no regularization...
Begin: 8.90236e+07
0 8.24916e+07
1 8.11572e+07
2 8.11421e+07
Now with regularization...
Begin: 7.9253e+07
0 7.92455e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

11-Oct-2024 15:54:45 CEST  Closed output file "np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup.root"
11-Oct-2024 15:54:45 CEST  Closed input file "np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              40.9991       137.518       234.179       128.073       36.7773        32     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000985859   0.00362871    0.00645262    0.00390276    0.00146903       32     
produce:fembfilter:PDHDFEMBFilter                      0.578596      0.778503       1.01658      0.801106      0.0907126       32     
produce:wclsdatahd:WireCellToolkit                      38.6459       43.3958       49.5363       43.8626       2.31067        32     
produce:gaushit:GausHitFinder                          0.601825      0.963141       1.52544      0.897162      0.245604        32     
produce:nhitsfilter:NumberOfHitsFilter                0.000281598   0.000432184   0.000723076   0.000421716   9.01879e-05      32     
produce:reco3d:SpacePointSolver                        0.481287       2.07186       6.16922       1.66046        1.399         31     
produce:hitpdune:DisambigFromSpacePoints                0.34821      0.944452       2.46034      0.854363      0.451725        31     
produce:pandora:StandardPandora                         9.60473       30.8822       83.4857       24.5743       17.7347        31     
produce:pandoraWriter:StandardPandora                  0.130489      0.211078      0.323014      0.218433      0.0483325       31     
produce:pandoraTrack:LArPandoraTrackCreation            1.38539       3.53568       10.7755       3.30416       1.70401        31     
produce:pandoraShower:LArPandoraShowerCreation          1.75819       4.07027       9.95151       3.55748       1.86287        31     
produce:pandoracalo:Calorimetry                        0.861175       1.59866       4.82248       1.42213      0.799988        31     
produce:pandoracalonosce:Calorimetry                   0.669787       1.61207       5.58199       1.45693       0.87009        31     
produce:pandorapid:Chi2ParticleID                     0.00160269     0.0028277    0.00498634    0.00275158    0.000644906      31     
produce:pandoraShowercalo:ShowerCalorimetry             1.1053        3.3526        8.95896       3.07177       1.6485         31     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.13259       3.22341       9.41487       2.76172       1.6984         31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0933639     0.170504      0.288052       0.16507      0.0436577       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0327511     0.0605138     0.097846      0.0590133     0.016315        31     
produce:emtrkmichelid:EmTrackMichelId                   27.127        41.0632       59.9073       39.7254       7.54827        31     
[art]:TriggerResults:TriggerResultInserter            3.0848e-05    6.96286e-05   0.000167584    6.678e-05    2.3262e-05       32     
end_path:out1:RootOutput                               1.071e-05    2.03598e-05   4.8121e-05    1.93715e-05   7.72577e-06      32     
end_path:michelremoving:michelremoving                5.5083e-05     0.112556      0.477959      0.0686229     0.0974503       32     
end_path:michelremovinggnocchi:michelremoving         4.7199e-05     0.101674      0.464491      0.0522949     0.0941029       32     
end_path:calibanagnocchi:CalibAnaTree                 4.8862e-05      1.03934       3.51726      0.935921      0.599771        32     
end_path:out1:RootOutput(write)                        0.425919      0.963188       1.53213      0.948249      0.224528        32     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4990.2 MB
  Peak resident set size usage (VmHWM): 2418.3 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup.root
\tHists: np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728650421.0,
    "core.end_time": 1728654887.0,
    "core.events": [
      161648,
      161656,
      161664,
      161672,
      161680,
      161688,
      161696,
      161704,
      161712,
      161720,
      161728,
      161736,
      161744,
      161752,
      161760,
      161768,
      161776,
      161784,
      161792,
      161800,
      161808,
      161816,
      161824,
      161832,
      161840,
      161848,
      161856,
      161864,
      161872,
      161880,
      161888,
      161896
    ],
    "core.event_count": 32,
    "core.first_event_number": 161648,
    "core.last_event_number": 161896,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315_reco_stage1_reco_stage2_20241011T135445_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728650421.0,
    "core.end_time": 1728654887.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0631_dataflow0_datawriter_0_20240711T044315.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:55:17 UTC       justIN version: 01.01.09