justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265189.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265189.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:37:10
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 18:58:06
From worker nodeHostnamemh-7662-5.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:38:32
Input fileshd-protodune:np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944.hdf5
JobscriptExit code0
Real time1h (4690s)
CPU time57m (3466s = 73%)
Outputting started2024-09-27 18:56:43
Output fileshd-protodune-det-reco:np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup.root
hd-protodune-det-reco:np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup_hists.root
Finished2024-09-27 18:58:06
Saved logsjustin-logs:265189.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 0
3405 hits in TPC 1
6138 hits in TPC 2
4145 hits in TPC 3
5048 hits in TPC 4
8749 hits in TPC 5
3223 hits in TPC 6
1233 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 212 XUs and 65 XVs -> 16 XUVs
C:0 T:1 4568 XUs and 1616 XVs -> 65 XUVs
C:0 T:2 26050 XUs and 21330 XVs -> 1403 XUVs
C:0 T:3 170 XUs and 156 XVs -> 4 XUVs
C:0 T:4 684 XUs and 430 XVs -> 9 XUVs
C:0 T:5 50908 XUs and 40198 XVs -> 1601 XUVs
C:0 T:6 5105 XUs and 8974 XVs -> 126 XUVs
C:0 T:7 114 XUs and 155 XVs -> 1 XUVs
3225 XUVs total
1302 collection wire objects
3225 potential space points
Neighbour search...
78403 tests to find 48628 neighbours
Iterating with no regularization...
Begin: 2.76371e+07
0 2.50959e+07
1 2.49017e+07
2 2.48762e+07
3 2.48692e+07
Now with regularization...
Begin: 2.35769e+07
0 2.35726e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 87500 TrkackID 3 startx, y, z 258.166 384.827 114.48  wireno, peakt tpcno 152 2584.96 5 dist 0min T, max_T5 3377.57
no of hits closeby  0   event 87500 TrkackID 3 startx, y, z 258.166 384.827 114.48  wireno, peakt tpcno 152 2584.96 5 dist 0min T, max_T5 3377.57
27-Sep-2024 11:56:34 PDT  Closed output file "np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup.root"
27-Sep-2024 11:56:34 PDT  Closed input file "np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              54.4529       78.3072       123.329       76.1014       15.6354        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000378029   0.00191217    0.00360439    0.00186596    0.000924416      35     
produce:fembfilter:PDHDFEMBFilter                      0.602867      0.638998       0.67872      0.635164      0.0148155       35     
produce:wclsdatahd:WireCellToolkit                      29.3798       31.4355       33.487        31.3489      0.893963        35     
produce:gaushit:GausHitFinder                          0.374059      0.622886       1.01299      0.609419      0.143813        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000233796   0.000338504   0.00047929    0.000335957   6.09733e-05      35     
produce:reco3d:SpacePointSolver                         0.13255      0.965755       4.40311       0.72331      0.871727        35     
produce:hitpdune:DisambigFromSpacePoints               0.133862      0.481919       1.09767      0.409362      0.241114        35     
produce:pandora:StandardPandora                         5.63832       13.3996       31.5799       12.5125       6.29386        35     
produce:pandoraWriter:StandardPandora                  0.0755804     0.138845      0.228151      0.138457      0.0356389       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.481847       1.18208       4.1829        1.09577      0.648798        35     
produce:pandoraShower:LArPandoraShowerCreation          0.45035       1.30882       3.24818       1.25853      0.662721        35     
produce:pandoracalo:Calorimetry                        0.252502      0.578789       1.70463      0.558286      0.261847        35     
produce:pandoracalonosce:Calorimetry                   0.212863      0.531172       1.58515      0.497081      0.245209        35     
produce:pandorapid:Chi2ParticleID                     0.00113054    0.00178025    0.00301916    0.00174018    0.000396403      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.401405       1.19361       3.00471       1.1332       0.574631        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.388758       1.14007       2.94453       1.10403      0.545854        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0738996     0.122645      0.177927      0.123151      0.0270156       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0260478     0.0425644     0.0603051     0.0421773     0.0088491       35     
produce:emtrkmichelid:EmTrackMichelId                   14.1952       23.0711       33.8492       22.8624       5.04304        35     
[art]:TriggerResults:TriggerResultInserter             1.596e-05    2.61091e-05   8.6142e-05     2.356e-05    1.3875e-05       35     
end_path:out1:RootOutput                               3.841e-06    5.56129e-06    3.145e-05     4.25e-06     5.35038e-06      35     
end_path:michelremoving:michelremoving                 0.0117247     0.0644469      0.18264      0.0244599     0.0567308       35     
end_path:michelremovinggnocchi:michelremoving          0.0114131     0.0619342     0.168967      0.0259442     0.0547339       35     
end_path:calibanagnocchi:CalibAnaTree                  0.161693      0.452207       1.45337      0.440464       0.22393        35     
end_path:out1:RootOutput(write)                        0.458185      0.774968       1.17301      0.751995      0.188157        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5042.87 MB
  Peak resident set size usage (VmHWM): 2679.57 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup.root
\tHists: np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727460618.0,
    "core.end_time": 1727463395.0,
    "core.events": [
      87364,
      87368,
      87372,
      87376,
      87380,
      87384,
      87388,
      87392,
      87396,
      87400,
      87404,
      87408,
      87412,
      87416,
      87420,
      87424,
      87428,
      87432,
      87436,
      87440,
      87444,
      87448,
      87452,
      87456,
      87460,
      87464,
      87468,
      87472,
      87476,
      87480,
      87484,
      87488,
      87492,
      87496,
      87500
    ],
    "core.event_count": 35,
    "core.first_event_number": 87364,
    "core.last_event_number": 87500,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944_reco_stage1_reco_stage2_20240927T185634_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727460618.0,
    "core.end_time": 1727463395.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0624_dataflow0_datawriter_0_20240624T043944.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:21:18 UTC       justIN version: 01.01.08