justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265826.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265826.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3543
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 10:12:25
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-28 10:17:36
From worker nodeHostnameccwcondor0702.in2p3.fr
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 10:14:00
Input fileshd-protodune:np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110.hdf5
JobscriptExit code0
Real time2m (159s)
CPU time1m (112s = 70%)
Outputting started2024-09-28 10:16:40
Output fileshd-protodune-det-reco:np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup.root
hd-protodune-det-reco:np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup_hists.root
Finished2024-09-28 10:17:36
Saved logsjustin-logs:265826.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

.66215e-05   3.79396e-05       4     
produce:tpcrawdecoder:PDHDTPCReader                4.14938       4.3619        4.56474       4.36674       0.15234         4     
produce:triggerrawdecoder:PDHDTriggerReader3      0.0737585     0.0835348     0.0936608     0.0833601    0.00763002        4     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0027505    0.00288492    0.00307658    0.00285631    0.000119678       4     
produce:pdhddaphne:DAPHNEReaderPDHD              8.8026e-05    0.000215533   0.000464373   0.000154867   0.000147198       4     
produce:fembfilter:PDHDFEMBFilter                7.0162e-05    0.000202125   0.000500421   0.000118959   0.000173373       4     
[art]:TriggerResults:TriggerResultInserter        1.095e-05    2.48115e-05   5.0965e-05    1.86655e-05   1.55536e-05       4     
end_path:out1:RootOutput                          4.629e-06    1.12863e-05   2.6991e-05    6.7625e-06    9.10895e-06       4     
end_path:out1:RootOutput(write)                    1.97874       2.02282       2.08843       2.01205      0.0422919        4     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2424.14 MB
  Peak resident set size usage (VmHWM): 874.004 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  calibana
  crtreco
  crttag
  opdec
  opflash
  ophitspe
  opslicer
  pdhddaphne
  timingrawdecoder
  tpcrawdecoder
  triggerrawdecoder
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_02d01/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25608 nodes/ 5535 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
DAPHNE Channel Map: Building DAPHNE channel map from file DAPHNE_test5_ChannelMap_v1.txt
PD2HD Channel Map: Building TPC wiremap from file PD2HDChannelMap_WIBEth_electronics_v1.txt
tf_graph loaded ProtoBuf graph with status: OK
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
28-Sep-2024 12:16:20 CEST  Initiating request to open input file "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1.root"
28-Sep-2024 12:16:21 CEST  Opened input file "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1.root"
job begin...
job begin...
Scale HitLimit based on readout window size 5859
HitLimit = 19530
Begin processing the 1st record. run: 29382 subRun: 1 event: 5540 at 28-Sep-2024 12:16:21 CEST
28-Sep-2024 12:16:22 CEST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 5542 at 28-Sep-2024 12:16:23 CEST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 5544 at 28-Sep-2024 12:16:24 CEST
Begin processing the 4th record. run: 29382 subRun: 1 event: 5546 at 28-Sep-2024 12:16:24 CEST
28-Sep-2024 12:16:25 CEST  Closed output file "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup.root"
28-Sep-2024 12:16:25 CEST  Closed input file "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.537146      0.612483       0.66973      0.621528      0.0484163        4     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000293612   0.000499086   0.00102104    0.000340846   0.000302019       4     
produce:fembfilter:PDHDFEMBFilter                 0.535209      0.608911      0.667372      0.616532      0.0476719        4     
[art]:TriggerResults:TriggerResultInserter       4.1418e-05    6.40683e-05   0.00011693    4.89625e-05   3.09098e-05       4     
end_path:out1:RootOutput                          6.311e-06     1.079e-05    2.1571e-05     7.639e-06    6.25558e-06       4     
end_path:michelremoving:michelremoving           1.2714e-05    6.99215e-05   0.000225344   2.0814e-05     8.982e-05        4     
end_path:michelremovinggnocchi:michelremoving     4.399e-06    1.93493e-05   6.1295e-05    5.8515e-06    2.42327e-05       4     
end_path:calibanagnocchi:CalibAnaTree             4.478e-06    1.80237e-05   5.7368e-05    5.1245e-06    2.2717e-05        4     
end_path:out1:RootOutput(write)                  0.000656054   0.00237792    0.00622005    0.00131778    0.00224065        4     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3638.67 MB
  Peak resident set size usage (VmHWM): 1041.46 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup.root
\tHists: np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727518538.0,
    "core.end_time": 1727518586.0,
    "core.events": [
      5540,
      5542,
      5544,
      5546
    ],
    "core.event_count": 4,
    "core.first_event_number": 5540,
    "core.last_event_number": 5546,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110_reco_stage1_reco_stage2_20240928T101625_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727518538.0,
    "core.end_time": 1727518586.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0071_dataflow0_datawriter_0_20240928T095110.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:33:37 UTC       justIN version: 01.01.08