justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269292.84@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269292.84@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3584
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:57:15
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-04 21:29:05
From worker nodeHostnamedunegli-4177636-0-fnpc17148.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 18:16:46
Input fileshd-protodune:np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813.hdf5
JobscriptExit code0
Real time3h (11473s)
CPU time2h (8125s = 70%)
Outputting started2024-10-04 21:28:00
Output fileshd-protodune-det-reco:np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup.root
hd-protodune-det-reco:np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup_hists.root
Finished2024-10-04 21:29:05
Saved logsjustin-logs:269292.84-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

hits in TPC 0
3062 hits in TPC 1
5665 hits in TPC 2
2870 hits in TPC 3
5699 hits in TPC 4
6245 hits in TPC 5
3604 hits in TPC 6
2573 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3437 XUs and 3273 XVs -> 266 XUVs
C:0 T:2 15415 XUs and 8790 XVs -> 268 XUVs
C:0 T:3 129 XUs and 86 XVs -> 5 XUVs
C:0 T:4 150 XUs and 88 XVs -> 3 XUVs
C:0 T:5 35492 XUs and 117414 XVs -> 3059 XUVs
C:0 T:6 6888 XUs and 7302 XVs -> 430 XUVs
C:0 T:7 61 XUs and 103 XVs -> 1 XUVs
4032 XUVs total
1099 collection wire objects
4032 potential space points
Neighbour search...
350804 tests to find 180464 neighbours
Iterating with no regularization...
Begin: 2.10505e+07
0 1.9011e+07
1 1.8844e+07
2 1.88189e+07
3 1.88128e+07
Now with regularization...
Begin: 1.78293e+07
0 1.7826e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 3040 TrkackID 25 startx, y, z 24.7436 580.966 355.367  wireno, peakt tpcno 47 2.85584 5 dist 0min T, max_T2.64465 478.004
no of hits closeby  0   event 3040 TrkackID 25 startx, y, z 24.7436 580.966 355.367  wireno, peakt tpcno 47 2.85584 5 dist 0min T, max_T2.64465 478.004
04-Oct-2024 21:27:47 UTC  Closed output file "np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup.root"
04-Oct-2024 21:27:47 UTC  Closed input file "np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.6102       183.544       386.836       165.312       70.4785        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000812032   0.00380014     0.0107289    0.00401782    0.00203139       40     
produce:fembfilter:PDHDFEMBFilter                       1.17818       1.59721       2.06085       1.56185      0.201081        40     
produce:wclsdatahd:WireCellToolkit                      51.001        67.035        84.4485       68.5885       8.23602        40     
produce:gaushit:GausHitFinder                          0.611855       1.37636       2.64699       1.33586      0.466218        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000419384   0.000738915   0.00173119    0.000651769   0.000281444      40     
produce:reco3d:SpacePointSolver                        0.281855       4.55039       19.4435       1.66318       5.8042         38     
produce:hitpdune:DisambigFromSpacePoints               0.316932       1.46644       4.92787       1.13951       1.08498        38     
produce:pandora:StandardPandora                         6.38478       33.3237       95.3766       26.5856       22.1705        38     
produce:pandoraWriter:StandardPandora                  0.144624      0.300122      0.568772      0.287891      0.0996155       38     
produce:pandoraTrack:LArPandoraTrackCreation            1.77854       6.18049       16.5768       5.34146       3.36079        38     
produce:pandoraShower:LArPandoraShowerCreation          1.67102       7.65742       21.5361       6.25465       4.67912        38     
produce:pandoracalo:Calorimetry                        0.589585       2.58816       6.87287       2.12296       1.5623         38     
produce:pandoracalonosce:Calorimetry                   0.549091       2.4798        6.83773       2.15198       1.50023        38     
produce:pandorapid:Chi2ParticleID                     0.00151609     0.0034978    0.00750847    0.00338413    0.00119709       38     
produce:pandoraShowercalo:ShowerCalorimetry             1.03518       6.43276       20.9799       4.92713       4.37777        38     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.02841       6.20928       20.6166       4.75557       4.1752         38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.100156      0.220571      0.375411      0.221597      0.0691821       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0379069     0.0883891      0.16832      0.0845442     0.0307994       38     
produce:emtrkmichelid:EmTrackMichelId                   20.5163       43.637        92.9897       40.2263       15.6489        38     
[art]:TriggerResults:TriggerResultInserter            4.7648e-05    7.41935e-05   0.00010199    7.58405e-05   1.14106e-05      40     
end_path:out1:RootOutput                              1.1423e-05    2.05301e-05   3.3895e-05    2.05995e-05   4.87444e-06      40     
end_path:michelremoving:michelremoving                6.5901e-05     0.177391       0.65206      0.109547      0.145228        40     
end_path:michelremovinggnocchi:michelremoving         4.3753e-05     0.168386      0.656108      0.102702      0.144638        40     
end_path:calibanagnocchi:CalibAnaTree                 3.9651e-05      2.04365       5.87469       1.71408       1.34067        40     
end_path:out1:RootOutput(write)                        0.733901       1.49622       3.28674       1.37791      0.532093        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5052.01 MB
  Peak resident set size usage (VmHWM): 2705.08 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup.root
\tHists: np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728069869.0,
    "core.end_time": 1728077269.0,
    "core.events": [
      3001,
      3002,
      3003,
      3004,
      3005,
      3006,
      3007,
      3008,
      3009,
      3010,
      3011,
      3012,
      3013,
      3014,
      3015,
      3016,
      3017,
      3018,
      3019,
      3020,
      3021,
      3022,
      3023,
      3024,
      3025,
      3026,
      3027,
      3028,
      3029,
      3030,
      3031,
      3032,
      3033,
      3034,
      3035,
      3036,
      3037,
      3038,
      3039,
      3040
    ],
    "core.event_count": 40,
    "core.first_event_number": 3001,
    "core.last_event_number": 3040,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27704
    ],
    "core.runs_subruns": [
      2770400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813_reco_stage1_reco_stage2_20241004T212747_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728069869.0,
    "core.end_time": 1728077269.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27704
    ],
    "core.runs_subruns": [
      2770400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027704_0075_dataflow0_datawriter_0_20240705T025813.hdf5"
    }
  ]
}
justIN time: 2024-11-24 11:40:12 UTC       justIN version: 01.01.09