justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265285.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265285.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3515
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 18:42:56
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2024-09-27 20:20:21
From worker nodeHostnamemh-7763-5.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 18:44:17
Input fileshd-protodune:np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147.hdf5
JobscriptExit code0
Real time1h (5666s)
CPU time52m (3157s = 55%)
Outputting started2024-09-27 20:18:44
Output fileshd-protodune-det-reco:np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup.root
hd-protodune-det-reco:np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup_hists.root
Finished2024-09-27 20:20:21
Saved logsjustin-logs:265285.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wclsFrameSaver: saving 71451 traces tagged "wiener"
FrameSaver: q=2.10822e+06 n=941716 tag=wiener
5029 hits in TPC 0
4185 hits in TPC 1
7217 hits in TPC 2
4451 hits in TPC 3
2732 hits in TPC 4
7781 hits in TPC 5
5597 hits in TPC 6
3832 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 54 XUs and 15 XVs -> 0 XUVs
C:0 T:1 7504 XUs and 4035 XVs -> 93 XUVs
C:0 T:2 17308 XUs and 24519 XVs -> 1068 XUVs
C:0 T:3 889 XUs and 744 XVs -> 29 XUVs
C:0 T:4 107 XUs and 114 XVs -> 2 XUVs
C:0 T:5 31375 XUs and 22614 XVs -> 830 XUVs
C:0 T:6 10123 XUs and 17048 XVs -> 448 XUVs
C:0 T:7 370 XUs and 692 XVs -> 11 XUVs
2481 XUVs total
1716 collection wire objects
2481 potential space points
Neighbour search...
30149 tests to find 16740 neighbours
Iterating with no regularization...
Begin: 2.19162e+07
0 2.08907e+07
1 2.08505e+07
2 2.08481e+07
Now with regularization...
Begin: 1.90783e+07
0 1.90771e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:18:36 PDT  Closed output file "np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup.root"
27-Sep-2024 13:18:36 PDT  Closed input file "np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              32.2715       70.7417       100.017       67.902        12.3036        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000350239   0.00149328    0.00350609    0.00150734    0.000741636      35     
produce:fembfilter:PDHDFEMBFilter                       0.51555      0.559023      0.606692      0.558413      0.0234804       35     
produce:wclsdatahd:WireCellToolkit                      26.1156       27.5225       30.9609       27.1369       1.12578        35     
produce:gaushit:GausHitFinder                          0.395767      0.566676      0.870932      0.588285      0.109909        35     
produce:nhitsfilter:NumberOfHitsFilter                0.00020313    0.000283027   0.000485388   0.000272339   5.44957e-05      35     
produce:reco3d:SpacePointSolver                        0.243529      0.957856       3.1985       0.674804      0.731048        34     
produce:hitpdune:DisambigFromSpacePoints               0.183184      0.451817      0.977472      0.410354      0.185825        34     
produce:pandora:StandardPandora                         6.47398       12.1655       27.2528       10.8265       4.34736        34     
produce:pandoraWriter:StandardPandora                  0.0742253     0.113795      0.161167      0.110106      0.0219776       34     
produce:pandoraTrack:LArPandoraTrackCreation           0.653566       1.12287       2.10355       1.04858      0.343102        34     
produce:pandoraShower:LArPandoraShowerCreation          0.59099       1.29931       2.71176       1.23399      0.452234        34     
produce:pandoracalo:Calorimetry                        0.357257       0.60785       1.09085      0.569697      0.165667        34     
produce:pandoracalonosce:Calorimetry                    0.33016      0.564962       1.04389      0.530585      0.160068        34     
produce:pandorapid:Chi2ParticleID                     0.00107918    0.00163819    0.00320588     0.001563     0.000403531      34     
produce:pandoraShowercalo:ShowerCalorimetry             0.61328       1.2969        2.80445       1.22612      0.482525        34     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.570515       1.21605       2.40933       1.15549      0.427296        34     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.062681      0.0891212     0.134769      0.0867482     0.0170909       34     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0203814     0.030909      0.0414451     0.0304349    0.00554491       34     
produce:emtrkmichelid:EmTrackMichelId                   15.4983       22.1733       29.7079       21.8441       3.53082        34     
[art]:TriggerResults:TriggerResultInserter             1.411e-05    2.42044e-05    9.514e-05    2.0869e-05    1.41981e-05      35     
end_path:out1:RootOutput                                3.6e-06     6.35737e-06    3.317e-05     4.76e-06     4.99464e-06      35     
end_path:michelremoving:michelremoving                 1.606e-05     0.0416887     0.131006      0.0214553     0.0360479       35     
end_path:michelremovinggnocchi:michelremoving          6.57e-06      0.0401901     0.125469      0.0202055     0.0360147       35     
end_path:calibanagnocchi:CalibAnaTree                  4.95e-06      0.427862      0.805712      0.417387      0.142242        35     
end_path:out1:RootOutput(write)                         0.28601      0.591735       0.83289      0.585678      0.115163        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5004.95 MB
  Peak resident set size usage (VmHWM): 2638.95 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup.root
\tHists: np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727465809.0,
    "core.end_time": 1727468317.0,
    "core.events": [
      126141,
      126145,
      126149,
      126153,
      126157,
      126161,
      126165,
      126169,
      126173,
      126177,
      126181,
      126185,
      126189,
      126193,
      126197,
      126201,
      126205,
      126209,
      126213,
      126217,
      126221,
      126225,
      126229,
      126233,
      126237,
      126241,
      126245,
      126249,
      126253,
      126257,
      126261,
      126265,
      126269,
      126273,
      126277
    ],
    "core.event_count": 35,
    "core.first_event_number": 126141,
    "core.last_event_number": 126277,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147_reco_stage1_reco_stage2_20240927T201836_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727465809.0,
    "core.end_time": 1727468317.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0901_dataflow1_datawriter_0_20240623T040147.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:35:58 UTC       justIN version: 01.01.08