justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79897.102@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79897.102@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3515
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:25:20
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 13:43:21
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 11:37:53
Input fileshd-protodune:np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546.hdf5
JobscriptExit code0
Real time2h (7422s)
CPU time1h (5112s = 68%)
Outputting started2024-09-27 13:41:36
Output fileshd-protodune-det-reco:np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup.root
hd-protodune-det-reco:np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup_hists.root
Finished2024-09-27 13:43:21
Saved logsjustin-logs:79897.102-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

35 XUVs
3845 XUVs total
1716 collection wire objects
3845 potential space points
Neighbour search...
106999 tests to find 65528 neighbours
Iterating with no regularization...
Begin: 3.33116e+07
0 2.89621e+07
1 2.87634e+07
2 2.87384e+07
Now with regularization...
Begin: 2.74055e+07
0 2.73973e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0243158 0.000161052 0.000160992 0.000161052 0.000161052 0.000178456 0.00125885 0 0 0 0 0 0 
----view 1: 4.1306e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0243158 0.000161052 0.000160992 0.000161052 0.000161052 0.000178456 0.00125885 0 0 0 0 0 0 
----view 1: 4.1306e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 4.1306e-05 4.12464e-05 4.1306e-05 4.1306e-05 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:41:14 UTC  Closed output file "np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup.root"
27-Sep-2024 13:41:14 UTC  Closed input file "np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.1328       115.141       154.553       114.591       17.3537        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00070299    0.00232585    0.00390739    0.00252829    0.00100604       35     
produce:fembfilter:PDHDFEMBFilter                       0.7318       0.809552       1.16293      0.747682      0.119401        35     
produce:wclsdatahd:WireCellToolkit                      45.2888       49.7175       56.304        48.5973       2.97292        35     
produce:gaushit:GausHitFinder                          0.644249      0.957308       1.36743       0.92516      0.174242        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000255232   0.000423866   0.000948913   0.000411337   0.000118278      35     
produce:reco3d:SpacePointSolver                        0.230138       1.14226       3.39977      0.945592      0.739366        35     
produce:hitpdune:DisambigFromSpacePoints                0.25133      0.744021       1.73505      0.724571      0.312351        35     
produce:pandora:StandardPandora                         10.7667       19.9334       40.2913       18.1401       6.67176        35     
produce:pandoraWriter:StandardPandora                  0.121457       0.17766      0.228042      0.175479      0.0278879       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.981167       2.25262       4.30882       2.16075      0.812092        35     
produce:pandoraShower:LArPandoraShowerCreation         0.847508       2.57696       5.74258       2.47952       1.1253         35     
produce:pandoracalo:Calorimetry                         0.44394       1.03488       1.59511       1.06086      0.309653        35     
produce:pandoracalonosce:Calorimetry                   0.389258       0.96297       1.60534      0.934989      0.307013        35     
produce:pandorapid:Chi2ParticleID                     0.00149752    0.00229249    0.00395471    0.00230332    0.000436394      35     
produce:pandoraShowercalo:ShowerCalorimetry             0.75773       2.18564       4.34512       1.93491      0.845424        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.719382       2.08273       3.93844       1.87593      0.770948        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0889851     0.153095      0.212482      0.147502      0.0297794       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0313522     0.0525216     0.0723288     0.0511441    0.00953684       35     
produce:emtrkmichelid:EmTrackMichelId                   19.1494       28.4152       38.2776       28.1697       4.91047        35     
[art]:TriggerResults:TriggerResultInserter            2.4683e-05    3.7212e-05    0.000103215   3.2438e-05    1.4344e-05       35     
end_path:out1:RootOutput                               8.773e-06    1.11699e-05   2.8733e-05    1.0317e-05    3.26665e-06      35     
end_path:michelremoving:michelremoving                 0.0204202     0.0990879     0.434406      0.0413948     0.101173        35     
end_path:michelremovinggnocchi:michelremoving          0.0186987      0.0948       0.425415      0.0369449     0.100121        35     
end_path:calibanagnocchi:CalibAnaTree                  0.349177      0.744088       1.31429      0.686262      0.238813        35     
end_path:out1:RootOutput(write)                        0.559175       0.88732       1.21193      0.877867      0.153242        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5003.74 MB
  Peak resident set size usage (VmHWM): 2651.68 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup.root
\tHists: np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727440391.0,
    "core.end_time": 1727444475.0,
    "core.events": [
      90444,
      90448,
      90452,
      90456,
      90460,
      90464,
      90468,
      90472,
      90476,
      90480,
      90484,
      90488,
      90492,
      90496,
      90500,
      90504,
      90508,
      90512,
      90516,
      90520,
      90524,
      90528,
      90532,
      90536,
      90540,
      90544,
      90548,
      90552,
      90556,
      90560,
      90564,
      90568,
      90572,
      90576,
      90580
    ],
    "core.event_count": 35,
    "core.first_event_number": 90444,
    "core.last_event_number": 90580,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546_reco_stage1_reco_stage2_20240927T134114_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727440391.0,
    "core.end_time": 1727444475.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0646_dataflow0_datawriter_0_20240623T015546.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:38:12 UTC       justIN version: 01.01.08