justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264630.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264630.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3510
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 04:02:08
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_condce_mcore
Last heartbeat2024-09-27 07:30:34
From worker nodeHostnamemwt2-c077.campuscluster.illinois.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 05:50:18
Input fileshd-protodune:np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904.hdf5
Outputting started2024-09-27 07:27:42
Output files
Finished2024-09-27 07:30:25
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ce set: gauss with 70775 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70775 traces tagged "gauss"
FrameSaver: q=2.56138e+06 n=1283610 tag=gauss
wclsFrameSaver: saving 91944 traces tagged "wiener"
FrameSaver: q=2.78357e+06 n=1161328 tag=wiener
8253 hits in TPC 0
6101 hits in TPC 1
7519 hits in TPC 2
3600 hits in TPC 3
6062 hits in TPC 4
6353 hits in TPC 5
9471 hits in TPC 6
5864 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 2112 XUs and 1235 XVs -> 159 XUVs
C:0 T:1 36690 XUs and 19512 XVs -> 2877 XUVs
C:0 T:2 31411 XUs and 37104 XVs -> 913 XUVs
C:0 T:3 751 XUs and 897 XVs -> 42 XUVs
C:0 T:4 168 XUs and 209 XVs -> 6 XUVs
C:0 T:5 24441 XUs and 22748 XVs -> 606 XUVs
C:0 T:6 80486 XUs and 95310 XVs -> 1947 XUVs
C:0 T:7 419 XUs and 329 XVs -> 9 XUVs
6559 XUVs total
2331 collection wire objects
6559 potential space points
Neighbour search...
293241 tests to find 128006 neighbours
Iterating with no regularization...
Begin: 5.22854e+07
0 4.95278e+07
1 4.93148e+07
2 4.93012e+07
Now with regularization...
Begin: 4.76713e+07
0 4.76667e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 02:27:34 CDT  Closed output file "np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup.root"
27-Sep-2024 02:27:34 CDT  Closed input file "np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              47.9975       89.8421       211.566       91.522        29.9271        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000347653   0.00157857     0.002892     0.00189029    0.000798279      35     
produce:fembfilter:PDHDFEMBFilter                      0.491594      0.512942      0.672391      0.506029      0.0347257       35     
produce:wclsdatahd:WireCellToolkit                      27.0018       28.7872       31.1662       28.8258      0.791948        35     
produce:gaushit:GausHitFinder                          0.282145      0.543991      0.973308      0.562632      0.145582        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000162274   0.000273745   0.000497493   0.000269145   6.54412e-05      35     
produce:reco3d:SpacePointSolver                        0.0867248     0.883772       2.55522      0.848715      0.556367        35     
produce:hitpdune:DisambigFromSpacePoints               0.0898501     0.548197       1.69457      0.522519      0.294349        35     
produce:pandora:StandardPandora                         3.51793       22.6629       106.609       17.9484       19.2295        35     
produce:pandoraWriter:StandardPandora                  0.0493022     0.110986      0.200955       0.11308      0.0327205       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.491613       1.37842       3.80049       1.36845      0.642526        35     
produce:pandoraShower:LArPandoraShowerCreation         0.414531       1.54747       4.41028       1.47734      0.800826        35     
produce:pandoracalo:Calorimetry                        0.254414      0.741349       2.08439      0.723376      0.335611        35     
produce:pandoracalonosce:Calorimetry                   0.234873      0.700455       1.92546      0.694185      0.316024        35     
produce:pandorapid:Chi2ParticleID                     0.000860885   0.00148193    0.00336544    0.00148937    0.000444615      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.393449       1.53422       4.14394       1.52718      0.769488        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.392642       1.46358       3.92456       1.44925      0.739932        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.051676      0.0865956     0.134302      0.0895644     0.020706        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0171837     0.0295089     0.0503978     0.0300736    0.00729476       35     
produce:emtrkmichelid:EmTrackMichelId                   12.6467       26.9161       46.5137       27.8516       6.87634        35     
[art]:TriggerResults:TriggerResultInserter            1.3816e-05    1.92999e-05   5.5605e-05    1.7983e-05    7.00714e-06      35     
end_path:out1:RootOutput                               5.109e-06    7.00469e-06   1.8505e-05     6.572e-06    2.17249e-06      35     
end_path:michelremoving:michelremoving                 0.0114888     0.0563452     0.284553      0.023835      0.0605952       35     
end_path:michelremovinggnocchi:michelremoving          0.0110489     0.0547849      0.28024      0.0207267     0.0605078       35     
end_path:calibanagnocchi:CalibAnaTree                  0.177877      0.556014       1.5055       0.529424      0.251447        35     
end_path:out1:RootOutput(write)                        0.308017      0.620563       1.07322      0.653096      0.152192        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5052.85 MB
  Peak resident set size usage (VmHWM): 2460.83 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup.root
\tHists: np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727418884.0,
    "core.end_time": 1727422054.0,
    "core.events": [
      14434,
      14438,
      14442,
      14446,
      14450,
      14454,
      14458,
      14462,
      14466,
      14470,
      14474,
      14478,
      14482,
      14486,
      14490,
      14494,
      14498,
      14502,
      14506,
      14510,
      14514,
      14518,
      14522,
      14526,
      14530,
      14534,
      14538,
      14542,
      14546,
      14550,
      14554,
      14558,
      14562,
      14566,
      14570
    ],
    "core.event_count": 35,
    "core.first_event_number": 14434,
    "core.last_event_number": 14570,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27325
    ],
    "core.runs_subruns": [
      2732500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904_reco_stage1_reco_stage2_20240927T072734_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727418884.0,
    "core.end_time": 1727422054.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27325
    ],
    "core.runs_subruns": [
      2732500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027325_0103_dataflow2_datawriter_0_20240620T121904.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:35:52 UTC       justIN version: 01.01.08