justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264786.142@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264786.142@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3512
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:05:13
SiteUS_UConn-HPC
EntryGLUEX_US_UConn-HPC_osgce
Last heartbeat2024-09-27 17:06:02
From worker nodeHostnamecn421
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 09:22:00
Input fileshd-protodune:np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835.hdf5
Outputting started2024-09-27 16:35:36
Output files
Finished2024-09-27 17:06:02
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 5166 XUs and 2139 XVs -> 198 XUVs
C:0 T:2 50914 XUs and 54640 XVs -> 6016 XUVs
C:0 T:3 296 XUs and 476 XVs -> 63 XUVs
C:0 T:4 285 XUs and 389 XVs -> 34 XUVs
C:0 T:5 8714 XUs and 8299 XVs -> 592 XUVs
C:0 T:6 33665 XUs and 20157 XVs -> 641 XUVs
C:0 T:7 150 XUs and 282 XVs -> 3 XUVs
7547 XUVs total
1538 collection wire objects
7547 potential space points
Neighbour search...
858533 tests to find 449422 neighbours
Iterating with no regularization...
Begin: 3.08972e+07
0 2.84288e+07
1 2.82044e+07
2 2.8161e+07
3 2.81476e+07
Now with regularization...
Begin: 2.61789e+07
0 2.61636e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  5   event 11625 TrkackID 3 startx, y, z 26.0933 592.431 372.535  wireno, peakt tpcno 184 5081.39 5 dist 4.0832min T, max_T4967.82 5772
no of hits closeby  5   event 11625 TrkackID 3 startx, y, z 26.0933 592.431 372.535  wireno, peakt tpcno 184 5081.39 5 dist 4.0832min T, max_T4967.82 5772
27-Sep-2024 12:35:27 EDT  Closed output file "np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup.root"
27-Sep-2024 12:35:27 EDT  Closed input file "np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              78.7123       119.034       175.089       112.208       27.3554        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000457675   0.00295642    0.00544116    0.00328369    0.00132612       35     
produce:fembfilter:PDHDFEMBFilter                      0.629444       0.8296        1.07696      0.838444      0.092267        35     
produce:wclsdatahd:WireCellToolkit                      33.5978       45.8487       49.9098       46.3619        3.079         35     
produce:gaushit:GausHitFinder                          0.480456      0.888986       1.53409      0.860525      0.266708        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000344461   0.000505703    0.0011546    0.00045496    0.000164258      35     
produce:reco3d:SpacePointSolver                        0.199419       1.31405       3.76496       1.0637       0.837323        35     
produce:hitpdune:DisambigFromSpacePoints               0.184739      0.840589       2.10534      0.747966      0.449286        35     
produce:pandora:StandardPandora                         7.07161       21.1682       47.5416       17.2764       11.5837        35     
produce:pandoraWriter:StandardPandora                  0.118759      0.194001      0.294353       0.18438      0.0522486       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.652336       2.05636       4.06388       1.89058      0.857316        35     
produce:pandoraShower:LArPandoraShowerCreation         0.588513       2.53593       6.75307       2.13431       1.46772        35     
produce:pandoracalo:Calorimetry                        0.346067      0.982788       2.13217      0.852687      0.418794        35     
produce:pandoracalonosce:Calorimetry                   0.281258      0.892907       1.72376      0.778599      0.387542        35     
produce:pandorapid:Chi2ParticleID                     0.00110662    0.00250987    0.00508601    0.00239299    0.00076737       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.452383       2.17837       5.59458       2.06283       1.1712         35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.541243       2.05396       4.76812       1.87425       1.0689         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.093339      0.179159      0.303563      0.175554      0.0528545       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0313213     0.0580733     0.0856254     0.0553182     0.0153571       35     
produce:emtrkmichelid:EmTrackMichelId                   18.8123       34.9729       56.3033       31.8795       9.22163        35     
[art]:TriggerResults:TriggerResultInserter            2.3654e-05    5.64765e-05   0.000109307   5.5766e-05    2.09049e-05      35     
end_path:out1:RootOutput                               1.069e-05    1.60289e-05   3.5557e-05    1.3456e-05    6.09723e-06      35     
end_path:michelremoving:michelremoving                 0.0175004     0.0964486     0.373858      0.0450709     0.0919625       35     
end_path:michelremovinggnocchi:michelremoving          0.0160673     0.0925008     0.360282      0.0419438     0.0893439       35     
end_path:calibanagnocchi:CalibAnaTree                  0.269908       0.69914       2.24358      0.569058      0.392704        35     
end_path:out1:RootOutput(write)                        0.575382      0.970233       1.76814      0.919502      0.280343        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4988.75 MB
  Peak resident set size usage (VmHWM): 2646.09 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup.root
\tHists: np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450717.0,
    "core.end_time": 1727454928.0,
    "core.events": [
      11489,
      11493,
      11497,
      11501,
      11505,
      11509,
      11513,
      11517,
      11521,
      11525,
      11529,
      11533,
      11537,
      11541,
      11545,
      11549,
      11553,
      11557,
      11561,
      11565,
      11569,
      11573,
      11577,
      11581,
      11585,
      11589,
      11593,
      11597,
      11601,
      11605,
      11609,
      11613,
      11617,
      11621,
      11625
    ],
    "core.event_count": 35,
    "core.first_event_number": 11489,
    "core.last_event_number": 11625,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27338
    ],
    "core.runs_subruns": [
      2733800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835_reco_stage1_reco_stage2_20240927T163527_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450717.0,
    "core.end_time": 1727454928.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27338
    ],
    "core.runs_subruns": [
      2733800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027338_0082_dataflow1_datawriter_0_20240621T113835.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:28:15 UTC       justIN version: 01.01.08