Building Flexible Infrastructure for Big Data Analysis

Practical training in flexible big data infrastructure, grounded in real cases and applied to your own operation.

📍 Cairo🗓️ 5 training days📚 4 modules🎓 Accredited certificate
5intensive training days
4scientific modules
8training sessions
32detailed points

Course Overview

Availability targets for flexible big data infrastructure are commercial commitments, whatever the engineering team calls them. Security and delivery speed are traded against each other in data infrastructure whether or not anyone says so. The course covers the wider technology and systems delivery agenda at the level of detail needed to act, and stops there. Applied research in technology and systems delivery consistently shows that early structure around flexible big data infrastructure reduces downstream rework. The method assumes participants will be challenged on their handling of this aspect of technology and systems delivery and prepares them for it. The version of data infrastructure described in the manual and the version practised on the floor tend to diverge over time. They leave able to brief senior management on flexible big data infrastructure in terms that support a decision. The material serves both public bodies and commercial organisations dealing with data infrastructure. The course ends by identifying what the participant will stop doing to make this area of technology and systems delivery sustainable.

Expected Learning Outcomes

01

Define the availability, performance and recovery targets for flexible big data infrastructure.

02

Prepare a short, evidence-based briefing on data infrastructure for senior management.

03

Design the architecture of flexible big data infrastructure around its failure modes, not only its happy path.

04

Set acceptance criteria for data infrastructure before work begins rather than after.

05

Build a concise technical standard for flexible big data infrastructure that colleagues can follow without further explanation.

06

Assess and manage third-party and cloud dependencies in data infrastructure.

07

Measure delivery and reliability of flexible big data infrastructure with indicators teams trust.

Who Should Attend

01

Members of committees that take decisions affecting flexible big data infrastructure.

02

Infrastructure and platform engineers operating data infrastructure.

03

Technical staff being prepared for supervisory responsibility over flexible big data infrastructure.

04

IT governance and audit staff reviewing data infrastructure.

05

IT managers and service owners responsible for flexible big data infrastructure.

06

Database administrators managing data within data infrastructure.

Course Modules

01

Flexible big data infrastructure: architecture and designing for failure

2 sessions · 8 points

Session 1Dependencies and supply chain risk in flexible big data infrastructure

  • Confirm every release of flexible big data infrastructure can be rolled back within a defined time.
  • State the availability and recovery objectives for data infrastructure as numbers.
  • Measure current load on flexible big data infrastructure and project it forward twelve months.
  • Set delivery and reliability indicators for data infrastructure the team trusts.

Session 2Proving the backup of data infrastructure by restoring it

  • Identify the single points of failure in flexible big data infrastructure.
  • Remove steps in data infrastructure that add effort without adding assurance.
  • Map the handovers in flexible big data infrastructure between functions and secure them.
  • Test the procedure for data infrastructure against a realistic scenario.
02

Data infrastructure: monitoring, alerting and observability

2 sessions · 8 points

Session 1Reviewing data infrastructure when nothing has gone wrong

  • Restore a backup of flexible big data infrastructure in a test environment and time it.
  • Close out actions on data infrastructure rather than leaving them open indefinitely.
  • Agree the smallest change to flexible big data infrastructure that would be visibly useful.
  • Confirm that reporting on data infrastructure reaches the people who can act.

Session 2The cost of data infrastructure and how to present it

  • Estimate the resource flexible big data infrastructure requires to run as designed.
  • Test the failover for data infrastructure rather than assuming it works.
  • Run a load test on flexible big data infrastructure at expected peak plus a margin.
  • Record what was learned when data infrastructure did not go as planned.
03

Data infrastructure: security, identity and least privilege

2 sessions · 8 points

Session 1Retiring the legacy part of data infrastructure

  • Inventory third-party dependencies inside flexible big data infrastructure and their update status.
  • Rehearse the briefing on data infrastructure that would follow an incident.
  • Apply change control to flexible big data infrastructure including emergency changes.
  • Define incident severity levels for data infrastructure and the response each triggers.

Session 2Who answers for flexible big data infrastructure, and to whom

  • Set out the decisions in flexible big data infrastructure that require sign-off and by whom.
  • Set escalation thresholds for data infrastructure that work out of hours.
  • Establish what evidence demonstrates flexible big data infrastructure is under control.
  • Document the runbook for data infrastructure to the level a new engineer could use.
04

Data infrastructure: build, pipeline and release discipline

2 sessions · 8 points

Session 1Designing data infrastructure around how it will fail

  • Plan the decommissioning of the legacy component flexible big data infrastructure replaces.
  • Confirm the support model and escalation path for data infrastructure.
  • Agree the indicators that will show whether flexible big data infrastructure is improving.
  • Assess the exit route from any cloud or vendor dependency in data infrastructure.

Session 2Monitoring data infrastructure from the user's point of view

  • Arrange the handover of flexible big data infrastructure so capability survives staff changes.
  • Distinguish symptoms from causes when data infrastructure underperforms.
  • Decide what will be stopped to create capacity for flexible big data infrastructure.
  • Review logging on data infrastructure for coverage and retention.

Choose the package that suits you

Silver Package

At least 3 people

USD1,250
  • Workshop or Program Participation
  • Airport Transfers
  • Customized Badge
  • Expert Mentorship (Private Sessions)
  • Supervision & Secretarial Services
  • Accredited Certificate of Participation
  • Complete Training Kit
  • Coffee Break
  • Closing Ceremony

Gold Package

At least 3 people

USD1,850
  • 5-night stay in a 5-star hotel
  • Workshop or Program Participation
  • Airport Transfers
  • Customized Badge
  • Expert Mentorship (Private Sessions)
  • Supervision & Secretarial Services
  • Accredited Certificate of Participation
  • Complete Training Kit
  • Coffee Break
  • Closing Ceremony

Complete your registration

We will contact you within one business day to confirm.