justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265210.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265210.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:46:45
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2024-09-27 19:41:58
From worker nodeHostnamemh-7662-11.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:53:15
Input fileshd-protodune:np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712.hdf5
JobscriptExit code0
Real time1h (6446s)
CPU time1h (4723s = 73%)
Outputting started2024-09-27 19:40:42
Output fileshd-protodune-det-reco:np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup.root
hd-protodune-det-reco:np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup_hists.root
Finished2024-09-27 19:41:58
Saved logsjustin-logs:265210.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ed "gauss"
FrameSaver: q=3.57596e+06 n=1687233 tag=gauss
wclsFrameSaver: saving 125338 traces tagged "wiener"
FrameSaver: q=3.9355e+06 n=1534580 tag=wiener
11777 hits in TPC 0
9208 hits in TPC 1
5813 hits in TPC 2
3655 hits in TPC 3
10805 hits in TPC 4
13181 hits in TPC 5
11478 hits in TPC 6
7079 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 47060 XUs and 31549 XVs -> 2957 XUVs
C:0 T:2 33457 XUs and 50647 XVs -> 809 XUVs
C:0 T:3 7390 XUs and 12800 XVs -> 1150 XUVs
C:0 T:4 982 XUs and 1207 XVs -> 34 XUVs
C:0 T:5 78359 XUs and 77623 XVs -> 2793 XUVs
C:0 T:6 90479 XUs and 82637 XVs -> 1953 XUVs
C:0 T:7 19 XUs and 40 XVs -> 3 XUVs
9699 XUVs total
3839 collection wire objects
9699 potential space points
Neighbour search...
453355 tests to find 210030 neighbours
Iterating with no regularization...
Begin: 8.59114e+07
0 8.13595e+07
1 8.11041e+07
2 8.10772e+07
Now with regularization...
Begin: 7.77627e+07
0 7.77517e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:40:34 PDT  Closed output file "np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup.root"
27-Sep-2024 12:40:34 PDT  Closed input file "np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              68.2272       111.571       226.759       102.979       35.2226        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000472451   0.00239642    0.00465579    0.00205761    0.00124514       35     
produce:fembfilter:PDHDFEMBFilter                      0.595861      0.626772      0.657606      0.629803      0.0140592       35     
produce:wclsdatahd:WireCellToolkit                      29.9184       31.5489       33.1153       31.6741      0.825214        35     
produce:gaushit:GausHitFinder                          0.575777      0.866344       1.22559      0.851779      0.179587        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000293007   0.000430346   0.000562173   0.00042291    7.62096e-05      35     
produce:reco3d:SpacePointSolver                        0.334912       1.85066       8.20502       1.34814       1.50535        35     
produce:hitpdune:DisambigFromSpacePoints               0.358112      0.793524       1.71376      0.670159      0.394061        35     
produce:pandora:StandardPandora                         10.1901       33.6289       131.127       27.0343       23.5426        35     
produce:pandoraWriter:StandardPandora                  0.119981      0.191617      0.280869      0.184846      0.0454883       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.757892       2.38026       5.1485        1.98029       1.18727        35     
produce:pandoraShower:LArPandoraShowerCreation         0.757056       2.42359       6.17147       2.29409       1.22965        35     
produce:pandoracalo:Calorimetry                         0.3798        1.01727       2.18102      0.898176      0.453092        35     
produce:pandoracalonosce:Calorimetry                   0.323199      0.950187       2.05624      0.840635      0.434529        35     
produce:pandorapid:Chi2ParticleID                     0.00125937    0.00216768    0.00358142    0.00214274    0.000508898      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.752084       1.95904       4.5985        1.75898      0.981866        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.710799       1.84426       4.40654       1.57001      0.942627        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.088918      0.138308       0.19472      0.137686      0.0257926       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0331698     0.0484553     0.0726083     0.0476744    0.00963303       35     
produce:emtrkmichelid:EmTrackMichelId                   18.8525       29.3067       42.2518       28.5006       6.48815        35     
[art]:TriggerResults:TriggerResultInserter            1.6561e-05    3.21465e-05   8.0442e-05    2.8271e-05    1.25228e-05      35     
end_path:out1:RootOutput                               3.97e-06     8.24194e-06   2.7331e-05     6.91e-06     3.84854e-06      35     
end_path:michelremoving:michelremoving                 0.0172849     0.0611659     0.377474      0.0301686     0.0745648       35     
end_path:michelremovinggnocchi:michelremoving          0.0160025     0.0576298     0.376215      0.0264905     0.074539        35     
end_path:calibanagnocchi:CalibAnaTree                  0.244093      0.769122       1.78898      0.652216      0.362336        35     
end_path:out1:RootOutput(write)                        0.656048      0.961123       1.41515      0.938707      0.204913        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5065.52 MB
  Peak resident set size usage (VmHWM): 2693.72 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup.root
\tHists: np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462094.0,
    "core.end_time": 1727466035.0,
    "core.events": [
      88245,
      88249,
      88253,
      88257,
      88261,
      88265,
      88269,
      88273,
      88277,
      88281,
      88285,
      88289,
      88293,
      88297,
      88301,
      88305,
      88309,
      88313,
      88317,
      88321,
      88325,
      88329,
      88333,
      88337,
      88341,
      88345,
      88349,
      88353,
      88357,
      88361,
      88365,
      88369,
      88373,
      88377,
      88381
    ],
    "core.event_count": 35,
    "core.first_event_number": 88245,
    "core.last_event_number": 88381,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712_reco_stage1_reco_stage2_20240927T194034_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462094.0,
    "core.end_time": 1727466035.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0630_dataflow1_datawriter_0_20240620T032712.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:25:38 UTC       justIN version: 01.01.08