justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 76700.61@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID76700.61@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3384
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 19:06:36
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2024-09-24 21:44:37
From worker nodeHostnameb9p13p1868.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-24 19:42:47
Input fileshd-protodune:np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259.hdf5
Outputting started2024-09-24 21:42:40
Output files
Finished2024-09-24 21:44:37
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

saving 55379 traces tagged "wiener"
FrameSaver: q=964570 n=699453 tag=wiener
5489 hits in TPC 0
3342 hits in TPC 1
4258 hits in TPC 2
2147 hits in TPC 3
3374 hits in TPC 4
4997 hits in TPC 5
3518 hits in TPC 6
2047 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 410 XUs and 284 XVs -> 25 XUVs
C:0 T:2 10009 XUs and 37766 XVs -> 1102 XUVs
C:0 T:3 15 XUs and 14 XVs -> 2 XUVs
C:0 T:4 7 XUs and 9 XVs -> 0 XUVs
C:0 T:5 32692 XUs and 17655 XVs -> 573 XUVs
C:0 T:6 6068 XUs and 13774 XVs -> 295 XUVs
C:0 T:7 43 XUs and 119 XVs -> 2 XUVs
1999 XUVs total
1010 collection wire objects
1999 potential space points
Neighbour search...
64883 tests to find 42676 neighbours
Iterating with no regularization...
Begin: 7.21915e+06
0 6.91638e+06
1 6.89293e+06
2 6.89065e+06
Now with regularization...
Begin: 6.42011e+06
0 6.41921e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 12896 TrkackID 7 startx, y, z 20.209 596.248 81.8937  wireno, peakt tpcno 193 2301.83 2 dist 479.09min T, max_T6.29589 2339.76
no of hits closeby  0   event 12896 TrkackID 7 startx, y, z 20.209 596.248 81.8937  wireno, peakt tpcno 193 2301.83 2 dist 479.09min T, max_T6.29589 2339.76
24-Sep-2024 23:42:10 CEST  Closed output file "np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup.root"
24-Sep-2024 23:42:10 CEST  Closed input file "np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              121.515       171.209       287.123       170.917       32.791         31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000558855   0.00217725    0.00631618    0.00133893    0.00185953       31     
produce:fembfilter:PDHDFEMBFilter                       1.03197       1.16103       1.29778       1.15692      0.0572709       31     
produce:wclsdatahd:WireCellToolkit                      72.7874       78.5646       83.2031       78.5738       2.22772        31     
produce:gaushit:GausHitFinder                          0.657882       1.28516       2.11082       1.32063      0.338005        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000360761   0.000608646   0.00176784    0.00058515    0.00023691       31     
produce:reco3d:SpacePointSolver                        0.377785       1.57529       4.72002       1.22371      0.974952        31     
produce:hitpdune:DisambigFromSpacePoints               0.359619       1.06903       2.43674      0.986072      0.503296        31     
produce:pandora:StandardPandora                         10.861        26.4681       70.6941       24.9991       12.9222        31     
produce:pandoraWriter:StandardPandora                   0.16201      0.282993       0.40829       0.29269      0.0585079       31     
produce:pandoraTrack:LArPandoraTrackCreation            1.30074       4.59521       11.5279       4.16916       2.06003        31     
produce:pandoraShower:LArPandoraShowerCreation          1.01703       4.74431       12.5958       4.52579       2.46718        31     
produce:pandoracalo:Calorimetry                        0.517685       1.82399       5.1844        1.67563      0.903331        31     
produce:pandoracalonosce:Calorimetry                   0.492624       1.73228       4.85631       1.58239      0.848133        31     
produce:pandorapid:Chi2ParticleID                     0.00201391    0.00329823    0.00572311    0.00301172    0.000771034      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.680454       4.01175       11.9469       3.69444       2.24363        31     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.6578        3.94222       13.2854       3.72253       2.35843        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.105957       0.23596      0.444933       0.23407      0.0702477       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0451035     0.0955406     0.164137      0.0962038     0.0251451       31     
produce:emtrkmichelid:EmTrackMichelId                   21.9132       36.2141       56.5234       35.3846       7.6875         31     
[art]:TriggerResults:TriggerResultInserter            5.6122e-05    7.76085e-05   0.000150912   7.5309e-05    1.65532e-05      31     
end_path:out1:RootOutput                               1.32e-05     4.35792e-05   0.000735212   2.0082e-05    0.000126412      31     
end_path:michelremoving:michelremoving                 0.0358932      0.17999      0.859139      0.0949743     0.183862        31     
end_path:michelremovinggnocchi:michelremoving          0.033417      0.173231      0.818871      0.0930082     0.178449        31     
end_path:calibanagnocchi:CalibAnaTree                  0.392242       1.3946        4.05974       1.30235      0.714486        31     
end_path:out1:RootOutput(write)                        0.713525       1.32503       2.16964       1.35996      0.311438        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5789.03 MB
  Peak resident set size usage (VmHWM): 2819.74 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup.root
\tHists: np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727208697.0,
    "core.end_time": 1727214132.0,
    "core.events": [
      12648,
      12656,
      12664,
      12672,
      12688,
      12696,
      12704,
      12712,
      12720,
      12728,
      12736,
      12744,
      12752,
      12760,
      12768,
      12776,
      12784,
      12792,
      12800,
      12808,
      12816,
      12824,
      12832,
      12840,
      12848,
      12856,
      12864,
      12872,
      12880,
      12888,
      12896
    ],
    "core.event_count": 31,
    "core.first_event_number": 12648,
    "core.last_event_number": 12896,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28893
    ],
    "core.runs_subruns": [
      2889300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259_reco_stage1_reco_stage2_20240924T214210_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727208697.0,
    "core.end_time": 1727214132.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28893
    ],
    "core.runs_subruns": [
      2889300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028893_0051_dataflow0_datawriter_0_20240825T081259.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:06:53 UTC       justIN version: 01.01.09