justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 82927.11@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID82927.11@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3693
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 03:31:20
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-17 13:31:32
From worker nodeHostnamedunegli-4188880-0-fnpc9060.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 10:42:41
Input fileshd-protodune:np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419.hdf5
JobscriptExit code0
Real time2h (8845s)
CPU time1h (6266s = 70%)
Outputting started2024-10-17 13:10:08
Output fileshd-protodune-det-reco:np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup.root
hd-protodune-det-reco:np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup_hists.root
Finished2024-10-17 13:31:32
Saved logsjustin-logs:82927.11-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

q=2.8205e+06 n=1149312 tag=wiener
2177 hits in TPC 0
2506 hits in TPC 1
10622 hits in TPC 2
6081 hits in TPC 3
7924 hits in TPC 4
9548 hits in TPC 5
9683 hits in TPC 6
4774 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4305 XUs and 5407 XVs -> 842 XUVs
C:0 T:2 70807 XUs and 82928 XVs -> 1696 XUVs
C:0 T:3 1128 XUs and 1505 XVs -> 24 XUVs
C:0 T:4 1758 XUs and 1518 XVs -> 120 XUVs
C:0 T:5 75519 XUs and 72653 XVs -> 3381 XUVs
C:0 T:6 57310 XUs and 53898 XVs -> 2947 XUVs
C:0 T:7 1232 XUs and 1496 XVs -> 25 XUVs
9035 XUVs total
3296 collection wire objects
9035 potential space points
Neighbour search...
600525 tests to find 294162 neighbours
Iterating with no regularization...
Begin: 5.06384e+07
0 4.48347e+07
1 4.43048e+07
2 4.42529e+07
3 4.42361e+07
Now with regularization...
Begin: 4.23139e+07
0 4.23029e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 6578 TrkackID 5 startx, y, z -110.287 536.367 377.639  wireno, peakt tpcno 48 4.01461 2 dist 0min T, max_T4.01461 1436.59
no of hits closeby  1   event 6578 TrkackID 5 startx, y, z -110.287 536.367 377.639  wireno, peakt tpcno 48 4.01461 2 dist 0min T, max_T4.01461 1436.59
17-Oct-2024 13:09:58 UTC  Closed output file "np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup.root"
17-Oct-2024 13:09:58 UTC  Closed input file "np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              83.1341       147.962       382.791       132.004       59.8447        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000560897   0.00286789    0.00584319     0.0035734     0.0016574       35     
produce:fembfilter:PDHDFEMBFilter                      0.948569       1.1262        1.66802       1.02026      0.212908        35     
produce:wclsdatahd:WireCellToolkit                      41.5318       47.3707       73.2724       43.5651        8.795         35     
produce:gaushit:GausHitFinder                          0.526164      0.998998       1.89027      0.941575      0.280979        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000333176   0.000502596   0.000885628   0.000488573   0.000123617      35     
produce:reco3d:SpacePointSolver                        0.271519       1.45917       5.43437       1.22007       1.0934         35     
produce:hitpdune:DisambigFromSpacePoints               0.235293       1.10942       4.44535       0.92966      0.802721        35     
produce:pandora:StandardPandora                         10.0525       43.8271       224.644       34.8513       39.906         35     
produce:pandoraWriter:StandardPandora                  0.134898      0.253565      0.796757      0.210219      0.137041        35     
produce:pandoraTrack:LArPandoraTrackCreation            1.01727       3.76977       9.5762        3.00528       2.13157        35     
produce:pandoraShower:LArPandoraShowerCreation          1.08249       3.77453       8.2073        3.64688       1.82383        35     
produce:pandoracalo:Calorimetry                        0.575009       1.62006       3.7868        1.3623       0.852184        35     
produce:pandoracalonosce:Calorimetry                   0.536583       1.52589       3.83611       1.30501      0.822619        35     
produce:pandorapid:Chi2ParticleID                     0.00150738    0.00256683    0.00469599    0.00231192    0.000762981      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.0172        3.21551       6.85499        2.861        1.56547        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.957655       3.05451       6.89485       2.66983       1.5444         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0982897     0.156886      0.298444      0.143119      0.0539636       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0351147     0.0576324     0.105965      0.0530073     0.0187058       35     
produce:emtrkmichelid:EmTrackMichelId                   17.0045       31.9653       58.0074       30.9071       8.33115        35     
[art]:TriggerResults:TriggerResultInserter            1.9376e-05    3.47495e-05   8.3155e-05    3.2952e-05    1.18663e-05      35     
end_path:out1:RootOutput                               6.616e-06    9.37589e-06   2.6663e-05     8.549e-06    3.4024e-06       35     
end_path:michelremoving:michelremoving                 0.0304753     0.0982538     0.409497      0.0590003     0.0777399       35     
end_path:michelremovinggnocchi:michelremoving          0.028951      0.0961711     0.404721      0.0585396     0.0766895       35     
end_path:calibanagnocchi:CalibAnaTree                   0.57294       1.28264       3.50597      0.969366      0.747965        35     
end_path:out1:RootOutput(write)                        0.549598       1.06231       2.01102      0.925642      0.359835        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5006.07 MB
  Peak resident set size usage (VmHWM): 2676.98 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup.root
\tHists: np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729165334.0,
    "core.end_time": 1729170599.0,
    "core.events": [
      6442,
      6446,
      6450,
      6454,
      6458,
      6462,
      6466,
      6470,
      6474,
      6478,
      6482,
      6486,
      6490,
      6494,
      6498,
      6502,
      6506,
      6510,
      6514,
      6518,
      6522,
      6526,
      6530,
      6534,
      6538,
      6542,
      6546,
      6550,
      6554,
      6558,
      6562,
      6566,
      6570,
      6574,
      6578
    ],
    "core.event_count": 35,
    "core.first_event_number": 6442,
    "core.last_event_number": 6578,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27331
    ],
    "core.runs_subruns": [
      2733100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419_reco_stage1_reco_stage2_20241017T130958_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729165334.0,
    "core.end_time": 1729170599.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27331
    ],
    "core.runs_subruns": [
      2733100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027331_0046_dataflow2_datawriter_0_20240620T160419.hdf5"
    }
  ]
}
justIN time: 2024-11-24 05:03:01 UTC       justIN version: 01.01.09