Building Distributed Big Data Processing Platforms

A working programme in distributed big data platforms for managers who have to deliver with existing resources.

📍 Istanbul🗓️ 5 training days📚 4 modules🎓 Accredited certificate
5intensive training days
4scientific modules
8training sessions
32detailed points

Course Overview

Technical debt in distributed big data platforms is borrowed against future delivery capacity, at compound interest. Most outages involving data platforms are triggered by a change somebody considered routine. They acquire practical criteria for judging when the technology and systems delivery discipline is working and when it is only appearing to. Exercises escalate in difficulty, ending with the ambiguous situations that make distributed big data platforms hard in practice. Field experience suggests that the barrier to better this aspect of technology and systems delivery is rarely technical. It suits anyone whose decisions touch data platforms, in large organisations and small ones alike. Improvement in distributed big data platforms stalls when it depends on one capable individual rather than a defined method. The programme converts data platforms from an area of general awareness into a set of repeatable practices. The final session converts the week's work on the wider technology and systems delivery agenda into commitments with owners and dates.

Expected Learning Outcomes

01

Measure delivery and reliability of distributed big data platforms with indicators teams trust.

02

Design a training and briefing approach that sustains competence in data platforms.

03

Structure the service desk and support model for distributed big data platforms.

04

Select indicators that show whether data platforms is improving, and reject those that only look useful.

05

Document distributed big data platforms to the level a new engineer could operate it.

06

Plan capacity for data platforms against measured growth rather than optimism.

07

Document decisions about distributed big data platforms in a form that remains useful after the people change.

Who Should Attend

01

IT managers and service owners responsible for distributed big data platforms.

02

Vendor managers overseeing suppliers involved in data platforms.

03

Project and programme managers whose delivery depends on distributed big data platforms.

04

IT governance and audit staff reviewing data platforms.

05

Managers with direct responsibility for distributed big data platforms within the technical platform.

06

Network and communications engineers supporting data platforms.

Course Modules

01

Distributed big data platforms: security, identity and least privilege

2 sessions · 8 points

Session 1The cost of distributed big data platforms and how to present it

  • Map the handovers in distributed big data platforms between functions and secure them.
  • Inventory third-party dependencies inside data platforms and their update status.
  • Assess the exit route from any cloud or vendor dependency in distributed big data platforms.
  • State the availability and recovery objectives for data platforms as numbers.

Session 2Designing data platforms around how it will fail

  • Establish what evidence demonstrates distributed big data platforms is under control.
  • Plan the sequence in which improvements to data platforms will be introduced.
  • Define incident severity levels for distributed big data platforms and the response each triggers.
  • Measure current load on data platforms and project it forward twelve months.
02

Data platforms: architecture and designing for failure

2 sessions · 8 points

Session 1Dependencies and supply chain risk in data platforms

  • Assign responsibility for keeping documentation of distributed big data platforms current.
  • Restore a backup of data platforms in a test environment and time it.
  • Identify the single points of failure in distributed big data platforms.
  • Set the review interval for data platforms and who attends.

Session 2Setting availability and recovery targets for data platforms honestly

  • Agree the indicators that will show whether distributed big data platforms is improving.
  • Run a load test on data platforms at expected peak plus a margin.
  • Record what was learned when distributed big data platforms did not go as planned.
  • Arrange the handover of data platforms so capability survives staff changes.
03

Data platforms: capacity, performance and load

2 sessions · 8 points

Session 1What has to be agreed before work on data platforms starts

  • Remove steps in distributed big data platforms that add effort without adding assurance.
  • Rehearse the briefing on data platforms that would follow an incident.
  • Test the failover for distributed big data platforms rather than assuming it works.
  • Confirm that reporting on data platforms reaches the people who can act.

Session 2Documenting distributed big data platforms so someone else can operate it

  • Confirm data retention and deletion rules applied within distributed big data platforms.
  • Apply change control to data platforms including emergency changes.
  • Plan the decommissioning of the legacy component distributed big data platforms replaces.
  • Establish the boundary of data platforms and record what sits outside it.
04

Data platforms: build, pipeline and release discipline

2 sessions · 8 points

Session 1Getting other functions to support data platforms

  • Configure alerting on distributed big data platforms that reflects what users experience.
  • Set delivery and reliability indicators for data platforms the team trusts.
  • Review logging on distributed big data platforms for coverage and retention.
  • Write down the assumptions underpinning the approach to data platforms.

Session 2Making releases of data platforms routine instead of risky

  • Define acceptance criteria for distributed big data platforms in advance.
  • Agree the smallest change to data platforms that would be visibly useful.
  • Review access rights on distributed big data platforms and remove what is no longer needed.
  • Confirm that those complying with data platforms understand why it exists.

Choose the package that suits you

Silver Package

At least 3 people

USD1,250
  • Workshop or Program Participation
  • Airport Transfers
  • Customized Badge
  • Expert Mentorship (Private Sessions)
  • Supervision & Secretarial Services
  • Accredited Certificate of Participation
  • Complete Training Kit
  • Coffee Break
  • Closing Ceremony

Gold Package

At least 3 people

USD1,850
  • 5-night stay in a 5-star hotel
  • Workshop or Program Participation
  • Airport Transfers
  • Customized Badge
  • Expert Mentorship (Private Sessions)
  • Supervision & Secretarial Services
  • Accredited Certificate of Participation
  • Complete Training Kit
  • Coffee Break
  • Closing Ceremony

Complete your registration

We will contact you within one business day to confirm.