justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 82927.19@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID82927.19@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3693
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 03:31:20
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-17 13:34:51
From worker nodeHostnamedunegli-4188968-0-fnpc17141.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 10:42:50
Input fileshd-protodune:np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800.hdf5
JobscriptExit code0
Real time2h (9015s)
CPU time1h (6726s = 74%)
Outputting started2024-10-17 13:13:07
Output fileshd-protodune-det-reco:np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup.root
hd-protodune-det-reco:np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup_hists.root
Finished2024-10-17 13:34:51
Saved logsjustin-logs:82927.19-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

r: tagging trace set: wiener with 95193 traces, 95193 summary
Retagger: tagging trace set: gauss with 73168 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73168 traces tagged "gauss"
FrameSaver: q=2.5247e+06 n=1304037 tag=gauss
wclsFrameSaver: saving 95193 traces tagged "wiener"
FrameSaver: q=2.76735e+06 n=1181741 tag=wiener
11673 hits in TPC 0
7957 hits in TPC 1
4010 hits in TPC 2
3913 hits in TPC 3
7597 hits in TPC 4
10384 hits in TPC 5
6976 hits in TPC 6
3378 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 21980 XUs and 16142 XVs -> 851 XUVs
C:0 T:2 14461 XUs and 19346 XVs -> 688 XUVs
C:0 T:3 73 XUs and 68 XVs -> 4 XUVs
C:0 T:4 221 XUs and 285 XVs -> 12 XUVs
C:0 T:5 90298 XUs and 81036 XVs -> 3651 XUVs
C:0 T:6 23508 XUs and 30321 XVs -> 507 XUVs
C:0 T:7 451 XUs and 470 XVs -> 8 XUVs
5721 XUVs total
2513 collection wire objects
5721 potential space points
Neighbour search...
207697 tests to find 90918 neighbours
Iterating with no regularization...
Begin: 4.76358e+07
0 4.16188e+07
1 4.11584e+07
2 4.1121e+07
Now with regularization...
Begin: 3.87852e+07
0 3.87704e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

17-Oct-2024 13:12:53 UTC  Closed output file "np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup.root"
17-Oct-2024 13:12:53 UTC  Closed input file "np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              95.6421       158.724       272.009       146.165       45.0292        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000717554   0.00418596     0.0507297    0.00277511    0.00814178       35     
produce:fembfilter:PDHDFEMBFilter                       0.71019       1.23685       1.77886       1.2096       0.225541        35     
produce:wclsdatahd:WireCellToolkit                      43.4386       49.3093       68.543        47.0897       5.82464        35     
produce:gaushit:GausHitFinder                           0.69688       1.08578       1.62163       1.08824      0.230562        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000383398   0.00282134     0.0790125    0.00057509     0.0130671       35     
produce:reco3d:SpacePointSolver                        0.471755       1.89311       6.00238       1.51884       1.28297        35     
produce:hitpdune:DisambigFromSpacePoints               0.436072       1.08024       2.09334       1.02761      0.429061        35     
produce:pandora:StandardPandora                         11.6352       42.2861       122.511        29.78        28.6361        35     
produce:pandoraWriter:StandardPandora                  0.142847      0.266471      0.772325      0.239796      0.123421        35     
produce:pandoraTrack:LArPandoraTrackCreation            1.86867       5.33357       10.1592       4.38114       2.57847        35     
produce:pandoraShower:LArPandoraShowerCreation          1.92522       6.03324       15.4606       5.3489        3.66108        35     
produce:pandoracalo:Calorimetry                        0.683198       2.09024       6.89924       1.66676       1.21841        35     
produce:pandoracalonosce:Calorimetry                   0.632447       1.99536       5.93228       1.47356       1.14061        35     
produce:pandorapid:Chi2ParticleID                     0.00169882    0.00281215    0.00499411    0.00268333    0.000631645      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.38189       4.43732       12.5314       3.60495       2.58282        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.31382       4.18563       9.95749       3.51825       2.34109        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0978934      0.17076      0.385021      0.154375      0.0642496       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0395011     0.065684      0.151533      0.0565102     0.0248335       35     
produce:emtrkmichelid:EmTrackMichelId                   21.8305       34.1044       44.9821       34.2486       6.49563        35     
[art]:TriggerResults:TriggerResultInserter            3.0806e-05    5.77074e-05   9.4458e-05    5.9214e-05    1.29529e-05      35     
end_path:out1:RootOutput                               8.369e-06    1.37107e-05   2.7904e-05    1.3354e-05    4.04879e-06      35     
end_path:michelremoving:michelremoving                 0.0317021     0.0921035     0.379579      0.0562978     0.0780956       35     
end_path:michelremovinggnocchi:michelremoving          0.0264312     0.0851235     0.377995      0.0534189     0.0774366       35     
end_path:calibanagnocchi:CalibAnaTree                  0.705906       1.55018       4.5325        1.15342      0.932551        35     
end_path:out1:RootOutput(write)                        0.729957       1.17748       2.81389       1.13835      0.374251        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5057.45 MB
  Peak resident set size usage (VmHWM): 2722.99 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup.root
\tHists: np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729165149.0,
    "core.end_time": 1729170779.0,
    "core.events": [
      7283,
      7287,
      7291,
      7295,
      7299,
      7303,
      7307,
      7311,
      7315,
      7319,
      7323,
      7327,
      7331,
      7335,
      7339,
      7343,
      7347,
      7351,
      7355,
      7359,
      7363,
      7367,
      7371,
      7375,
      7379,
      7383,
      7387,
      7391,
      7395,
      7399,
      7403,
      7407,
      7411,
      7415,
      7419
    ],
    "core.event_count": 35,
    "core.first_event_number": 7283,
    "core.last_event_number": 7419,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27331
    ],
    "core.runs_subruns": [
      2733100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800_reco_stage1_reco_stage2_20241017T131253_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729165149.0,
    "core.end_time": 1729170779.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27331
    ],
    "core.runs_subruns": [
      2733100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027331_0052_dataflow3_datawriter_0_20240620T160800.hdf5"
    }
  ]
}
justIN time: 2024-11-24 05:07:37 UTC       justIN version: 01.01.09