justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77733.30@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77733.30@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3454
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 22:43:55
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2024-09-26 02:42:56
From worker nodeHostnameccwcondor0557
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 01:12:54
Input fileshd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5
Outputting started2024-09-26 02:21:59
Output files
Finished2024-09-26 03:12:12
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

tagging trace set: wiener with 50924 traces, 50924 summary
Retagger: tagging trace set: gauss with 36978 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 36978 traces tagged "gauss"
FrameSaver: q=729171 n=648735 tag=gauss
wclsFrameSaver: saving 50924 traces tagged "wiener"
FrameSaver: q=800127 n=585574 tag=wiener
4296 hits in TPC 0
4731 hits in TPC 1
2565 hits in TPC 2
1365 hits in TPC 3
2561 hits in TPC 4
4110 hits in TPC 5
3457 hits in TPC 6
2468 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 12221 XUs and 10317 XVs -> 323 XUVs
C:0 T:2 3766 XUs and 5324 XVs -> 111 XUVs
C:0 T:3 53 XUs and 70 XVs -> 6 XUVs
C:0 T:4 978 XUs and 794 XVs -> 30 XUVs
C:0 T:5 12566 XUs and 12064 XVs -> 827 XUVs
C:0 T:6 9610 XUs and 23888 XVs -> 395 XUVs
C:0 T:7 366 XUs and 384 XVs -> 19 XUVs
1711 XUVs total
845 collection wire objects
1711 potential space points
Neighbour search...
65905 tests to find 37602 neighbours
Iterating with no regularization...
Begin: 4.04202e+06
0 3.73165e+06
1 3.7166e+06
2 3.71466e+06
Now with regularization...
Begin: 3.49165e+06
0 3.49115e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 04:21:23 CEST  Closed output file "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root"
26-Sep-2024 04:21:23 CEST  Closed input file "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.9795       103.76        154.029       107.513       17.8116        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00067169     0.0030645     0.0051898    0.00317343      0.00122        30     
produce:fembfilter:PDHDFEMBFilter                      0.574075      0.741517      0.883806      0.751255      0.0614363       30     
produce:wclsdatahd:WireCellToolkit                      38.6805       45.0174       48.2436       45.5583       2.57526        30     
produce:gaushit:GausHitFinder                          0.482153       0.7818        1.09674      0.781415      0.184561        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000263254   0.000411396   0.00136486    0.000372002   0.000190138      30     
produce:reco3d:SpacePointSolver                        0.207506       1.20361       3.45649       0.97182      0.831252        30     
produce:hitpdune:DisambigFromSpacePoints               0.186843      0.580862       1.11921      0.551582      0.246811        30     
produce:pandora:StandardPandora                         5.32594       12.4885       32.1298       11.9937       5.06398        30     
produce:pandoraWriter:StandardPandora                  0.107346      0.169156      0.242304      0.165676      0.0366419       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.513946       1.90354       4.13549       1.70098      0.842896        30     
produce:pandoraShower:LArPandoraShowerCreation          0.49293       2.23278       4.84679       2.2366        1.16455        30     
produce:pandoracalo:Calorimetry                        0.293022      0.891649       1.86632      0.879834      0.356124        30     
produce:pandoracalonosce:Calorimetry                   0.242552      0.812097       1.97477      0.731098      0.360285        30     
produce:pandorapid:Chi2ParticleID                     0.00131623    0.00224955    0.00369211    0.00225397    0.00052748       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.360999       1.89902       4.33614       1.91217      0.964921        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.305224       1.80115       3.88055       1.59767      0.892008        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.06916      0.168761      0.342758      0.155005      0.0525862       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0269071     0.0578124     0.0916362     0.055726      0.0166847       30     
produce:emtrkmichelid:EmTrackMichelId                   17.4769       31.2375       44.7196       32.3549       6.44855        30     
[art]:TriggerResults:TriggerResultInserter            4.2771e-05    7.4785e-05    0.000140423   7.3909e-05    1.69301e-05      30     
end_path:out1:RootOutput                               1.077e-05    2.07052e-05   5.9211e-05    1.92715e-05   8.76747e-06      30     
end_path:michelremoving:michelremoving                 0.0207984     0.0915267     0.381336      0.0590895     0.0848477       30     
end_path:michelremovinggnocchi:michelremoving          0.0169185     0.0817925     0.311665      0.0456785     0.0795839       30     
end_path:calibanagnocchi:CalibAnaTree                  0.177222      0.586042       1.30273      0.520467      0.240361        30     
end_path:out1:RootOutput(write)                        0.466724      0.787927       1.16526      0.772706      0.167298        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4906.87 MB
  Peak resident set size usage (VmHWM): 2327.71 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root
\tHists: np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727314080.0,
    "core.end_time": 1727317285.0,
    "core.events": [
      8186,
      8194,
      8202,
      8210,
      8218,
      8226,
      8234,
      8242,
      8250,
      8258,
      8266,
      8274,
      8282,
      8290,
      8298,
      8306,
      8314,
      8322,
      8330,
      8338,
      8346,
      8354,
      8362,
      8370,
      8378,
      8386,
      8394,
      8402,
      8410,
      8418
    ],
    "core.event_count": 30,
    "core.first_event_number": 8186,
    "core.last_event_number": 8418,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29108
    ],
    "core.runs_subruns": [
      2910800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727314080.0,
    "core.end_time": 1727317285.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29108
    ],
    "core.runs_subruns": [
      2910800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:06:11 UTC       justIN version: 01.01.09