justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80358.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80358.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3515
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:46:48
SiteUS_UConn-HPC
EntryGLUEX_US_UConn-HPC_osgce
Last heartbeat2024-09-27 19:30:07
From worker nodeHostnamecn429
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:48:36
Input fileshd-protodune:np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044.hdf5
JobscriptExit code0
Real time1h (5952s)
CPU time1h (5402s = 90%)
Outputting started2024-09-27 19:27:49
Output fileshd-protodune-det-reco:np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup.root
hd-protodune-det-reco:np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup_hists.root
Finished2024-09-27 19:30:07
Saved logsjustin-logs:80358.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

PC 2
4057 hits in TPC 3
3411 hits in TPC 4
8798 hits in TPC 5
10459 hits in TPC 6
7802 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1264 XUs and 1789 XVs -> 69 XUVs
C:0 T:2 16472 XUs and 18221 XVs -> 559 XUVs
C:0 T:3 88 XUs and 128 XVs -> 11 XUVs
C:0 T:4 103 XUs and 126 XVs -> 4 XUVs
C:0 T:5 20827 XUs and 28525 XVs -> 668 XUVs
C:0 T:6 74212 XUs and 166638 XVs -> 6105 XUVs
C:0 T:7 92 XUs and 126 XVs -> 5 XUVs
7421 XUVs total
2195 collection wire objects
7421 potential space points
Neighbour search...
387629 tests to find 199658 neighbours
Iterating with no regularization...
Begin: 4.9785e+07
0 3.99382e+07
1 3.91982e+07
2 3.90792e+07
3 3.90387e+07
4 3.90195e+07
Now with regularization...
Begin: 3.71436e+07
0 3.71294e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 129217 TrkackID 27 startx, y, z 23.5497 446.384 10.4698  wireno, peakt tpcno 57 395.79 2 dist 69.865min T, max_T6.15017 424.438
no of hits closeby  0   event 129217 TrkackID 27 startx, y, z 23.5497 446.384 10.4698  wireno, peakt tpcno 57 395.79 2 dist 69.865min T, max_T6.15017 424.438
27-Sep-2024 15:27:40 EDT  Closed output file "np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup.root"
27-Sep-2024 15:27:40 EDT  Closed input file "np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              74.2789       131.966       215.676       128.43        29.4994        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000676357   0.00327623     0.0162516    0.00265071    0.00266787       35     
produce:fembfilter:PDHDFEMBFilter                      0.749036      0.801135       1.02869      0.791314      0.049168        35     
produce:wclsdatahd:WireCellToolkit                      41.0186       48.8031       53.5111       48.9865       2.30825        35     
produce:gaushit:GausHitFinder                          0.393916      0.912898       1.34791      0.902245      0.225428        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000250632   0.000479825   0.000896203   0.000468225   0.000110344      35     
produce:reco3d:SpacePointSolver                        0.187065       1.56163       6.81782       1.19582       1.32945        35     
produce:hitpdune:DisambigFromSpacePoints               0.151757      0.801382       2.12353      0.738398      0.379325        35     
produce:pandora:StandardPandora                         5.30758       21.8867       51.0762       21.1077       9.41994        35     
produce:pandoraWriter:StandardPandora                  0.0991318     0.210618      0.308863      0.210196      0.0441283       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.584167       3.06984       7.74518       2.73934       1.35893        35     
produce:pandoraShower:LArPandoraShowerCreation         0.288914       4.11696       12.9687       3.71303       2.56194        35     
produce:pandoracalo:Calorimetry                        0.261344       1.42576       3.90942       1.32451      0.721184        35     
produce:pandoracalonosce:Calorimetry                   0.234691       1.28144       3.56011       1.19093      0.618797        35     
produce:pandorapid:Chi2ParticleID                     0.00178337    0.00266882    0.00525022    0.00258609    0.000584739      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.274904       3.3265        11.8991       3.01978       2.24729        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.255018       3.0262        10.5751       2.6336        2.00057        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0577102     0.186845      0.330609      0.191397      0.0525756       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0202343     0.0622701     0.098957      0.0635247     0.0158969       35     
produce:emtrkmichelid:EmTrackMichelId                   16.2711       38.0754       58.9826       38.9817       9.13513        35     
[art]:TriggerResults:TriggerResultInserter            3.9234e-05    5.97035e-05   0.000122041    5.821e-05    1.2389e-05       35     
end_path:out1:RootOutput                              1.2033e-05    2.45875e-05   3.2121e-05    2.5157e-05    4.41183e-06      35     
end_path:michelremoving:michelremoving                 0.0166477     0.141124      0.614361      0.0657286     0.141513        35     
end_path:michelremovinggnocchi:michelremoving          0.0187599     0.138914      0.604911      0.0600728      0.14125        35     
end_path:calibanagnocchi:CalibAnaTree                  0.201207      0.919617       2.65853      0.873484      0.476015        35     
end_path:out1:RootOutput(write)                         0.36011       0.97056       1.62354      0.968365      0.257919        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5003.32 MB
  Peak resident set size usage (VmHWM): 2669.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup.root
\tHists: np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727460593.0,
    "core.end_time": 1727465261.0,
    "core.events": [
      129081,
      129085,
      129089,
      129093,
      129097,
      129101,
      129105,
      129109,
      129113,
      129117,
      129121,
      129125,
      129129,
      129133,
      129137,
      129141,
      129145,
      129149,
      129153,
      129157,
      129161,
      129165,
      129169,
      129173,
      129177,
      129181,
      129185,
      129189,
      129193,
      129197,
      129201,
      129205,
      129209,
      129213,
      129217
    ],
    "core.event_count": 35,
    "core.first_event_number": 129081,
    "core.last_event_number": 129217,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044_reco_stage1_reco_stage2_20240927T192740_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727460593.0,
    "core.end_time": 1727465261.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0922_dataflow1_datawriter_0_20240623T042044.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:27:44 UTC       justIN version: 01.01.08