justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265290.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265290.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 18:44:32
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2024-09-27 20:34:46
From worker nodeHostnamemh-7662-4.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 18:46:04
Input fileshd-protodune:np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022.hdf5
JobscriptExit code0
Real time1h (6440s)
CPU time1h (5094s = 79%)
Outputting started2024-09-27 20:33:25
Output fileshd-protodune-det-reco:np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup.root
hd-protodune-det-reco:np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup_hists.root
Finished2024-09-27 20:34:46
Saved logsjustin-logs:265290.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ate correlation coefficient p-value for these numbers
----view 0: 5.26905e-05 5.26905e-05 5.26905e-05 0.000231564 0.000272453 0.000213802 2.93255e-05 2.93255e-05 2.93255e-05 2.92659e-05 2.93255e-05 
----view 1: 0.00121379 0.00172079 0.00108922 0.00143504 0.00107402 0.00124389 0.00469834 0.00118649 0.00118339 0.00126308 0.00273067 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 5.26905e-05 5.26905e-05 0.000231564 0.000272453 0.000213802 2.93255e-05 2.93255e-05 2.93255e-05 2.92659e-05 2.93255e-05 2.93255e-05 
----view 1: 0.00172079 0.00108922 0.00143504 0.00107402 0.00124389 0.00469834 0.00118649 0.00118339 0.00126308 0.00273067 0.00145429 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 4.3273e-05 4.3273e-05 4.3273e-05 0.000204742 0.000141203 0.000297546 2.40803e-05 2.40803e-05 2.40803e-05 2.40803e-05 2.40803e-05 2.40803e-05 2.40803e-05 
----view 1: 0.000669181 0.00107872 0.000673771 0.000850558 0.000656128 0.00068289 0.00306183 0.000683904 0.000719488 0.000705898 0.000696063 0.00182194 0.00169092 
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:33:16 PDT  Closed output file "np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup.root"
27-Sep-2024 13:33:16 PDT  Closed input file "np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.7257       124.74        253.091       116.889       39.7025        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000638289   0.00259195     0.0050596    0.00231825    0.00149018       35     
produce:fembfilter:PDHDFEMBFilter                      0.654953      0.710523       1.1253       0.696687      0.0754757       35     
produce:wclsdatahd:WireCellToolkit                      31.6503       34.8408       45.9518       34.5286       2.31315        35     
produce:gaushit:GausHitFinder                          0.468916      0.852005       1.22823      0.858386      0.190788        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000274448   0.000447885   0.000703812   0.000431183   9.91241e-05      35     
produce:reco3d:SpacePointSolver                        0.143283       1.96589       6.93015       1.5016        1.52308        35     
produce:hitpdune:DisambigFromSpacePoints               0.173562      0.879981       2.0312       0.832452      0.432819        35     
produce:pandora:StandardPandora                         7.22495       39.4406       130.54        35.7296       26.0194        35     
produce:pandoraWriter:StandardPandora                  0.0951616      0.20413      0.394976      0.207607      0.0584326       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.568347       2.33413       5.22342       2.21507       1.12896        35     
produce:pandoraShower:LArPandoraShowerCreation         0.496475       2.4146        5.45989       2.39492       1.18182        35     
produce:pandoracalo:Calorimetry                        0.303937       1.06745       2.22768       1.03606      0.471641        35     
produce:pandoracalonosce:Calorimetry                   0.264417      0.991252        2.078       0.946923      0.449586        35     
produce:pandorapid:Chi2ParticleID                      0.0014318    0.00229301    0.00436768     0.0022118    0.000625054      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.426336       2.10126       4.51981       1.87898       1.04608        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.406978       2.02334       4.25741       1.85348       1.00228        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0901071     0.158841      0.360975      0.155882      0.0477958       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0305941     0.0547583     0.109472      0.054137      0.0143984       35     
produce:emtrkmichelid:EmTrackMichelId                   17.162        32.4733       65.6941       33.3725       9.07299        35     
[art]:TriggerResults:TriggerResultInserter             2.065e-05    3.11513e-05   8.1413e-05    2.6671e-05    1.2168e-05       35     
end_path:out1:RootOutput                                4.7e-06     8.68194e-06   3.2631e-05     8.11e-06     4.34786e-06      35     
end_path:michelremoving:michelremoving                 0.0183384     0.0925211     0.320584      0.0391681     0.0847122       35     
end_path:michelremovinggnocchi:michelremoving          0.0166357     0.0905237     0.316742      0.0332452     0.0860463       35     
end_path:calibanagnocchi:CalibAnaTree                  0.246608      0.827374       1.66444      0.814843      0.368962        35     
end_path:out1:RootOutput(write)                        0.553143       1.07015       1.86996       1.08419      0.274033        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5090.05 MB
  Peak resident set size usage (VmHWM): 2736.46 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup.root
\tHists: np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727464792.0,
    "core.end_time": 1727469197.0,
    "core.events": [
      2666,
      2670,
      2674,
      2678,
      2682,
      2686,
      2690,
      2694,
      2698,
      2702,
      2706,
      2710,
      2714,
      2718,
      2722,
      2726,
      2730,
      2734,
      2738,
      2742,
      2746,
      2750,
      2754,
      2758,
      2762,
      2766,
      2770,
      2774,
      2778,
      2782,
      2786,
      2790,
      2794,
      2798,
      2802
    ],
    "core.event_count": 35,
    "core.first_event_number": 2666,
    "core.last_event_number": 2802,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27311
    ],
    "core.runs_subruns": [
      2731100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022_reco_stage1_reco_stage2_20240927T203316_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727464792.0,
    "core.end_time": 1727469197.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27311
    ],
    "core.runs_subruns": [
      2731100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027311_0019_dataflow2_datawriter_0_20240620T045022.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:29:53 UTC       justIN version: 01.01.08