justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265281.6@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265281.6@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 18:41:11
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2024-09-27 20:17:32
From worker nodeHostnamemh-7662-9.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 18:42:43
Input fileshd-protodune:np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644.hdf5
JobscriptExit code0
Real time1h (5610s)
CPU time1h (4194s = 74%)
Outputting started2024-09-27 20:16:14
Output fileshd-protodune-det-reco:np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup.root
hd-protodune-det-reco:np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup_hists.root
Finished2024-09-27 20:17:32
Saved logsjustin-logs:265281.6-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

621 traces, 62621 summary
Retagger: tagging trace set: gauss with 47428 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47428 traces tagged "gauss"
FrameSaver: q=1.67578e+06 n=849461 tag=gauss
wclsFrameSaver: saving 62621 traces tagged "wiener"
FrameSaver: q=1.84128e+06 n=768007 tag=wiener
5478 hits in TPC 0
5190 hits in TPC 1
3478 hits in TPC 2
2524 hits in TPC 3
4872 hits in TPC 4
7064 hits in TPC 5
5282 hits in TPC 6
2292 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 33657 XUs and 16583 XVs -> 1917 XUVs
C:0 T:2 4995 XUs and 14446 XVs -> 201 XUVs
C:0 T:3 41 XUs and 68 XVs -> 0 XUVs
C:0 T:4 86 XUs and 119 XVs -> 4 XUVs
C:0 T:5 30925 XUs and 28429 XVs -> 1264 XUVs
C:0 T:6 13708 XUs and 19036 XVs -> 347 XUVs
C:0 T:7 1281 XUs and 1694 XVs -> 86 XUVs
3819 XUVs total
1506 collection wire objects
3819 potential space points
Neighbour search...
119947 tests to find 67790 neighbours
Iterating with no regularization...
Begin: 2.29603e+07
0 2.14054e+07
1 2.13142e+07
2 2.13085e+07
Now with regularization...
Begin: 2.03639e+07
0 2.03618e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:16:06 PDT  Closed output file "np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup.root"
27-Sep-2024 13:16:06 PDT  Closed input file "np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              47.082        100.268       165.368       98.148         26.47         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000534833   0.00184203    0.00365228    0.00180153    0.000865403      35     
produce:fembfilter:PDHDFEMBFilter                      0.547592      0.568479      0.585103      0.569042     0.00730341       35     
produce:wclsdatahd:WireCellToolkit                      25.5778       27.6306       33.4627       27.4399       1.28855        35     
produce:gaushit:GausHitFinder                          0.315407      0.679437       1.13583      0.704574      0.145355        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000210515   0.000389909   0.000693288    0.000402     8.09241e-05      35     
produce:reco3d:SpacePointSolver                        0.400815       1.27657       4.05419       1.15646      0.735663        35     
produce:hitpdune:DisambigFromSpacePoints               0.130626      0.680143       1.24342      0.636424      0.247479        35     
produce:pandora:StandardPandora                         4.38443       34.3042       90.9052       30.3342       18.6252        35     
produce:pandoraWriter:StandardPandora                  0.0713173     0.163305      0.256334      0.171548      0.0364646       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.481806       1.88026       3.67725       1.79306      0.775831        35     
produce:pandoraShower:LArPandoraShowerCreation         0.458814       1.81058       3.73575       1.70191      0.781788        35     
produce:pandoracalo:Calorimetry                        0.244585      0.878462       1.7746        0.83765      0.343153        35     
produce:pandoracalonosce:Calorimetry                   0.221722      0.823628       1.64277      0.786565      0.324918        35     
produce:pandorapid:Chi2ParticleID                     0.00105848    0.00195351    0.00356849    0.00193274    0.000465074      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.408257       1.58895       3.45395       1.40355      0.691402        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.395242       1.51105       3.13036       1.3244       0.644659        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0661749     0.121331      0.201908      0.121811      0.0261756       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0233118     0.0426153     0.0693115     0.0435263     0.0087572       35     
produce:emtrkmichelid:EmTrackMichelId                   12.4056       24.6064       30.0928       26.107        4.39443        35     
[art]:TriggerResults:TriggerResultInserter             1.514e-05    2.46705e-05   8.6012e-05     2.279e-05    1.10282e-05      35     
end_path:out1:RootOutput                               4.31e-06     7.64509e-06    2.828e-05      6.6e-06     3.88814e-06      35     
end_path:michelremoving:michelremoving                 0.0109818     0.0489969     0.284927      0.0250539     0.0525668       35     
end_path:michelremovinggnocchi:michelremoving          0.0105695     0.0472539     0.281917      0.0233486     0.0523254       35     
end_path:calibanagnocchi:CalibAnaTree                  0.189412      0.654801       1.25653      0.674777      0.242608        35     
end_path:out1:RootOutput(write)                        0.406933       0.83821       1.01789      0.901346      0.156081        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5023.03 MB
  Peak resident set size usage (VmHWM): 2630.72 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup.root
\tHists: np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727464623.0,
    "core.end_time": 1727468167.0,
    "core.events": [
      21703,
      21707,
      21711,
      21715,
      21719,
      21723,
      21727,
      21731,
      21735,
      21739,
      21743,
      21747,
      21751,
      21755,
      21759,
      21763,
      21767,
      21771,
      21775,
      21779,
      21783,
      21787,
      21791,
      21795,
      21799,
      21803,
      21807,
      21811,
      21815,
      21819,
      21823,
      21827,
      21831,
      21835,
      21839
    ],
    "core.event_count": 35,
    "core.first_event_number": 21703,
    "core.last_event_number": 21839,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644_reco_stage1_reco_stage2_20240927T201606_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727464623.0,
    "core.end_time": 1727468167.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0155_dataflow3_datawriter_0_20240621T042644.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:33:34 UTC       justIN version: 01.01.08