justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80094.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80094.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 10:33:53
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 17:00:08
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 14:25:39
Input fileshd-protodune:np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001.hdf5
JobscriptExit code0
Real time2h (7774s)
CPU time1h (5729s = 73%)
Outputting started2024-09-27 16:35:14
Output fileshd-protodune-det-reco:np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup.root
hd-protodune-det-reco:np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup_hists.root
Finished2024-09-27 17:00:08
Saved logsjustin-logs:80094.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e+06 n=1315128 tag=gauss
wclsFrameSaver: saving 89386 traces tagged "wiener"
FrameSaver: q=2.8618e+06 n=1204624 tag=wiener
10358 hits in TPC 0
6723 hits in TPC 1
6706 hits in TPC 2
4912 hits in TPC 3
7348 hits in TPC 4
9363 hits in TPC 5
7573 hits in TPC 6
3478 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 43467 XUs and 18987 XVs -> 3340 XUVs
C:0 T:2 67593 XUs and 74227 XVs -> 6303 XUVs
C:0 T:3 427 XUs and 356 XVs -> 9 XUVs
C:0 T:4 221 XUs and 223 XVs -> 10 XUVs
C:0 T:5 78834 XUs and 81926 XVs -> 2550 XUVs
C:0 T:6 21453 XUs and 33890 XVs -> 864 XUVs
C:0 T:7 576 XUs and 513 XVs -> 24 XUVs
13100 XUVs total
2898 collection wire objects
13100 potential space points
Neighbour search...
1760404 tests to find 691968 neighbours
Iterating with no regularization...
Begin: 1.04836e+08
0 9.71499e+07
1 9.63681e+07
2 9.63078e+07
Now with regularization...
Begin: 9.43594e+07
0 9.43353e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 16:35:06 UTC  Closed output file "np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup.root"
27-Sep-2024 16:35:06 UTC  Closed input file "np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               56.63        134.329       240.939       123.511       37.4083        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000394694   0.00184466     0.004092     0.00171871     0.0010639       35     
produce:fembfilter:PDHDFEMBFilter                      0.629504      0.697667      0.770825      0.710491      0.0456437       35     
produce:wclsdatahd:WireCellToolkit                      39.0975       43.6934       50.3894       43.2282       3.40102        35     
produce:gaushit:GausHitFinder                          0.264049      0.985042       1.48334       1.03491      0.258345        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000121896   0.000365229   0.000596619   0.000355314   0.000101145      35     
produce:reco3d:SpacePointSolver                        0.264661       1.47047       3.99214       1.31621      0.913011        35     
produce:hitpdune:DisambigFromSpacePoints               0.0727825      1.04125       1.98682       1.01601      0.484642        35     
produce:pandora:StandardPandora                         4.49699       39.3352       142.265       30.6495       27.4768        35     
produce:pandoraWriter:StandardPandora                  0.0448109     0.177977      0.238904      0.180288      0.0398249       35     
produce:pandoraTrack:LArPandoraTrackCreation            0.34108       2.52115       4.28165       2.51184       1.03813        35     
produce:pandoraShower:LArPandoraShowerCreation         0.206257       2.59171       5.14902       2.45093       1.19714        35     
produce:pandoracalo:Calorimetry                        0.172698       1.2378        2.14003       1.22486      0.511842        35     
produce:pandoracalonosce:Calorimetry                   0.155808       1.16756       2.06701       1.13284      0.497448        35     
produce:pandorapid:Chi2ParticleID                      0.0008458    0.00236727    0.00361225     0.0024022    0.000566786      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.165934       2.42589       4.77662       2.17811       1.20475        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.159211       2.33294       4.65804       2.04987       1.1496         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0401682     0.148869      0.228878      0.151259      0.0406235       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0136596     0.0515181     0.0799732     0.0498098     0.0141182       35     
produce:emtrkmichelid:EmTrackMichelId                   9.76579       32.223        43.1679       31.8327       7.31847        35     
[art]:TriggerResults:TriggerResultInserter            2.0073e-05    2.79497e-05   7.6475e-05    2.6195e-05    9.24259e-06      35     
end_path:out1:RootOutput                               6.825e-06    9.73997e-06   2.6179e-05     9.64e-06     2.9737e-06       35     
end_path:michelremoving:michelremoving                0.00959765     0.104053      0.494446      0.0379673     0.123099        35     
end_path:michelremovinggnocchi:michelremoving         0.00821761     0.099153      0.465097      0.034592      0.119398        35     
end_path:calibanagnocchi:CalibAnaTree                  0.126364      0.971177       1.81594      0.936175      0.409289        35     
end_path:out1:RootOutput(write)                        0.261089       0.95483       1.32803      0.972985      0.226321        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5057.37 MB
  Peak resident set size usage (VmHWM): 2705.41 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup.root
\tHists: np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450157.0,
    "core.end_time": 1727454907.0,
    "core.events": [
      104905,
      104909,
      104913,
      104917,
      104921,
      104925,
      104929,
      104933,
      104937,
      104941,
      104945,
      104949,
      104953,
      104957,
      104961,
      104965,
      104969,
      104973,
      104977,
      104981,
      104985,
      104989,
      104993,
      104997,
      105001,
      105005,
      105009,
      105013,
      105017,
      105021,
      105025,
      105029,
      105033,
      105037,
      105041
    ],
    "core.event_count": 35,
    "core.first_event_number": 104905,
    "core.last_event_number": 105041,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001_reco_stage1_reco_stage2_20240927T163506_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450157.0,
    "core.end_time": 1727454907.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0749_dataflow1_datawriter_0_20240620T043001.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:23:42 UTC       justIN version: 01.01.08