justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273172.177@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273172.177@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3670
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-11 01:44:38
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-10-11 04:47:16
From worker nodeHostnamemh-7662-7.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-11 03:17:58
Input fileshd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5
Outputting started2024-10-11 04:45:51
Output files
Finished2024-10-11 04:47:16
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

es, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41887 traces tagged "gauss"
FrameSaver: q=1.3801e+06 n=771512 tag=gauss
wclsFrameSaver: saving 54932 traces tagged "wiener"
FrameSaver: q=1.47488e+06 n=693200 tag=wiener
4798 hits in TPC 0
3943 hits in TPC 1
4960 hits in TPC 2
2047 hits in TPC 3
2902 hits in TPC 4
6190 hits in TPC 5
4380 hits in TPC 6
1837 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4930 XUs and 4956 XVs -> 294 XUVs
C:0 T:2 12855 XUs and 10496 XVs -> 174 XUVs
C:0 T:3 90 XUs and 42 XVs -> 3 XUVs
C:0 T:4 270 XUs and 475 XVs -> 9 XUVs
C:0 T:5 19280 XUs and 11529 XVs -> 199 XUVs
C:0 T:6 13153 XUs and 20479 XVs -> 276 XUVs
C:0 T:7 102 XUs and 107 XVs -> 1 XUVs
956 XUVs total
617 collection wire objects
956 potential space points
Neighbour search...
14588 tests to find 7880 neighbours
Iterating with no regularization...
Begin: 1.08992e+07
0 1.04523e+07
1 1.04434e+07
Now with regularization...
Begin: 1.01924e+07
0 1.0192e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

10-Oct-2024 21:45:43 PDT  Closed output file "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root"
10-Oct-2024 21:45:43 PDT  Closed input file "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              39.8765       80.1038       105.255       82.8057       13.2752        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00044572    0.00186562    0.00412792    0.00170331    0.000910168      40     
produce:fembfilter:PDHDFEMBFilter                      0.650588      0.675181       0.70221      0.678353      0.0128843       40     
produce:wclsdatahd:WireCellToolkit                      32.9981       35.6404       43.4442       34.7774       2.65081        40     
produce:gaushit:GausHitFinder                          0.401507      0.675743       1.61125      0.685549      0.188049        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000244946   0.000362758   0.000685645   0.000359453   8.36071e-05      40     
produce:reco3d:SpacePointSolver                        0.160934      0.862244       4.45465      0.564425       0.80845        39     
produce:hitpdune:DisambigFromSpacePoints               0.161383      0.468152       1.14188      0.454352      0.195113        39     
produce:pandora:StandardPandora                         5.29757       12.3349       28.7206       11.5181       4.5866         39     
produce:pandoraWriter:StandardPandora                  0.0867355     0.139472      0.191524      0.141646      0.0250031       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.438292       1.0503        1.54921       1.12046      0.290352        39     
produce:pandoraShower:LArPandoraShowerCreation         0.465902       1.24569       2.0544        1.22492      0.426299        39     
produce:pandoracalo:Calorimetry                        0.236362      0.525303      0.773161      0.550031      0.129349        39     
produce:pandoracalonosce:Calorimetry                    0.21646      0.482959      0.708987      0.500574      0.124826        39     
produce:pandorapid:Chi2ParticleID                     0.00108288    0.00179172    0.00404107     0.0017084    0.00049135       39     
produce:pandoraShowercalo:ShowerCalorimetry            0.417142       1.12502       1.89548       1.16267       0.38573        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.393257       1.06774       1.79397       1.09922      0.358056        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.083018      0.124789      0.176022      0.125603      0.0237605       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0283385     0.0428116     0.059712      0.0432878    0.00768486       39     
produce:emtrkmichelid:EmTrackMichelId                   14.9961       23.3637       31.7347       23.8906       4.16462        39     
[art]:TriggerResults:TriggerResultInserter             1.502e-05    2.76978e-05   6.7981e-05    2.5045e-05    1.21037e-05      40     
end_path:out1:RootOutput                               3.46e-06     7.19493e-06    2.392e-05     6.15e-06     3.7509e-06       40     
end_path:michelremoving:michelremoving                 2.157e-05     0.0429487     0.154664      0.0242773     0.0421598       40     
end_path:michelremovinggnocchi:michelremoving          6.63e-06      0.0419381     0.155411      0.0225349     0.0421218       40     
end_path:calibanagnocchi:CalibAnaTree                  5.51e-06      0.389081      0.687307      0.413681      0.126368        40     
end_path:out1:RootOutput(write)                        0.516406      0.770425       1.03591      0.776803      0.143714        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5016.83 MB
  Peak resident set size usage (VmHWM): 2669.69 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root
\tHists: np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728618704.0,
    "core.end_time": 1728621943.0,
    "core.events": [
      9394,
      9402,
      9410,
      9418,
      9426,
      9434,
      9442,
      9450,
      9458,
      9466,
      9474,
      9482,
      9490,
      9498,
      9506,
      9514,
      9522,
      9530,
      9538,
      9546,
      9554,
      9562,
      9570,
      9578,
      9586,
      9594,
      9602,
      9610,
      9618,
      9626,
      9634,
      9642,
      9650,
      9658,
      9666,
      9674,
      9682,
      9690,
      9698,
      9706
    ],
    "core.event_count": 40,
    "core.first_event_number": 9394,
    "core.last_event_number": 9706,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27940
    ],
    "core.runs_subruns": [
      2794000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325_reco_stage1_reco_stage2_20241011T044543_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728618704.0,
    "core.end_time": 1728621943.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27940
    ],
    "core.runs_subruns": [
      2794000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027940_0030_dataflow2_datawriter_0_20240710T074325.hdf5"
    }
  ]
}
justIN time: 2024-11-23 14:16:37 UTC       justIN version: 01.01.09