justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263057.99@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263057.99@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:52:56
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 09:14:44
From worker nodeHostnameccwcondor0612
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:54:43
Input fileshd-protodune:np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254.hdf5
Outputting started2024-09-26 08:56:29
Output files
Finished2024-09-26 09:57:03
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ace set: gauss with 66686 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66686 traces tagged "gauss"
FrameSaver: q=1.36854e+06 n=1192258 tag=gauss
wclsFrameSaver: saving 90097 traces tagged "wiener"
FrameSaver: q=1.47619e+06 n=1065776 tag=wiener
4826 hits in TPC 0
6034 hits in TPC 1
6479 hits in TPC 2
3774 hits in TPC 3
4540 hits in TPC 4
8276 hits in TPC 5
7119 hits in TPC 6
4586 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1798 XUs and 1498 XVs -> 191 XUVs
C:0 T:2 28873 XUs and 21147 XVs -> 533 XUVs
C:0 T:3 294 XUs and 436 XVs -> 4 XUVs
C:0 T:4 74 XUs and 59 XVs -> 1 XUVs
C:0 T:5 40943 XUs and 34827 XVs -> 1256 XUVs
C:0 T:6 23104 XUs and 22518 XVs -> 532 XUVs
C:0 T:7 301 XUs and 515 XVs -> 27 XUVs
2544 XUVs total
1304 collection wire objects
2544 potential space points
Neighbour search...
70622 tests to find 43148 neighbours
Iterating with no regularization...
Begin: 7.75885e+06
0 7.25211e+06
1 7.21621e+06
2 7.21347e+06
Now with regularization...
Begin: 6.86648e+06
0 6.86553e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 10:55:55 CEST  Closed output file "np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup.root"
26-Sep-2024 10:55:55 CEST  Closed input file "np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.5422       92.9094       153.853       89.2477       20.2025        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000837727   0.00277239    0.00428018    0.00289578    0.00107579       30     
produce:fembfilter:PDHDFEMBFilter                      0.500686      0.622626      0.797087      0.617286      0.104316        30     
produce:wclsdatahd:WireCellToolkit                      31.6023       37.3574       44.6156       37.3054       3.93722        30     
produce:gaushit:GausHitFinder                           0.33103      0.660726       1.24813      0.615204      0.199119        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000226984   0.000320689   0.000439894   0.000322684   5.76489e-05      30     
produce:reco3d:SpacePointSolver                        0.159276      0.877842       3.40578      0.674439       0.66614        30     
produce:hitpdune:DisambigFromSpacePoints               0.148729      0.473784       1.11469      0.435637      0.210557        30     
produce:pandora:StandardPandora                         6.42485       12.5289       35.3346       10.4277       6.49607        30     
produce:pandoraWriter:StandardPandora                  0.0809545      0.14997      0.257415      0.142881      0.0469585       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.572799       1.70967       3.08459       1.50449      0.731514        30     
produce:pandoraShower:LArPandoraShowerCreation          0.63782       2.13098       6.03836       1.83444       1.2296         30     
produce:pandoracalo:Calorimetry                        0.333871      0.869724       1.83193      0.881461      0.375144        30     
produce:pandoracalonosce:Calorimetry                   0.235669      0.769629       1.60129      0.726515      0.341111        30     
produce:pandorapid:Chi2ParticleID                      0.0012286    0.00211327    0.00349754    0.00202707    0.000570746      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.463919       1.88466       3.89824       1.90732      0.841598        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.430518       1.72049       3.83036       1.53945      0.838634        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0621882     0.133725      0.225889      0.116386      0.0418761       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.023477      0.047693      0.0793188     0.0445563     0.0146434       30     
produce:emtrkmichelid:EmTrackMichelId                   20.3262       29.2256       47.6187       28.4671       6.56708        30     
[art]:TriggerResults:TriggerResultInserter            2.5698e-05    6.42808e-05   0.000106078   6.0959e-05    1.74047e-05      30     
end_path:out1:RootOutput                               1.071e-05    1.91917e-05   5.4111e-05    1.73825e-05   8.18983e-06      30     
end_path:michelremoving:michelremoving                 0.0221255     0.0966091     0.531121      0.0486738     0.104457        30     
end_path:michelremovinggnocchi:michelremoving          0.0207982     0.0908075     0.521465      0.0432146     0.103955        30     
end_path:calibanagnocchi:CalibAnaTree                  0.242104      0.635284       1.21175      0.614749      0.255832        30     
end_path:out1:RootOutput(write)                        0.452924      0.716765       1.18137      0.705861      0.176345        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4956.39 MB
  Peak resident set size usage (VmHWM): 2357.97 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup.root
\tHists: np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338128.0,
    "core.end_time": 1727340957.0,
    "core.events": [
      178324,
      178332,
      178340,
      178348,
      178356,
      178364,
      178372,
      178380,
      178388,
      178396,
      178404,
      178412,
      178420,
      178428,
      178436,
      178444,
      178452,
      178460,
      178468,
      178476,
      178484,
      178492,
      178500,
      178508,
      178516,
      178524,
      178532,
      178540,
      178548,
      178556
    ],
    "core.event_count": 30,
    "core.first_event_number": 178324,
    "core.last_event_number": 178556,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254_reco_stage1_reco_stage2_20240926T085555_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338128.0,
    "core.end_time": 1727340957.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0743_dataflow4_datawriter_0_20240905T044254.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:35:49 UTC       justIN version: 01.01.08