Test Management Forum - 27 January 2016

The 49th Test Management Forum will take place on Wednesday 27 January 2016 at the conference centre at Balls's Brothers, Minster Pavement

Sponsored by CA Technologies

Eventbrite - Test Management Forum - Wednesday 27 January 2016


13:30pm Tea/Coffee
14:00pm Introductions

Session A

Rod Armstrong, EasyJet, Asia Shahzad, Hotels.com, "Brave New World – a Workshop on Fostering Change"​

Rod and Asia's Slides are here

Session B

Rob Lambert, New Voice Media, "Our Industry Needs Better Managers. Period"

Rob's Slides are here

Session C

David Parker, Metaswitch Networks, "Early lessons in testing the Internet of Things"

15:30pm Tea/Coffee

Session D

William Sault, CA Technologies, "Requirements from Data – Auto-Finding the Logic in the Data"

Will has written a blog post on the discussion here.

Session E

Paul Gerrard, Gerrard Consulting, "Digital, Testing and Automation"

Session F

Richard Bishop,TrustIV, "Network Virtualisation in Testing"

Richards slides are here and here's a link to a video of him presenting at the North West Test Gathering earlier this month.


17:15pm Drinks Reception


Rob Lambert, New Voice Media, "Our Industry Needs Better Managers. Period"

If we, as a community of testers, don't pull our thumbs out and our socks up, will be left behind as "development" managers will predominantely come from a development background (which may not be a bad thing, but who's going to advocate at an exec level for good testing?)

The idea of a "Test Manager" and a "Development Manager" running side by side is out-dated and managers of the future (and now) will manage many disciplines/skills - but where does this leave "Test Managers" who mostly only know how to manager "Testing" and not "Testers".

It will be an interactive discussion which will cover these topics:

  • Is the world of Test Management really that bad? (I believe it is)
  • Is the world of Test Managers really being disrupted by multi-discipline Dev Managers? (I believe it is)
  • Why are our conferences not focusing on creating good managers who can manage people, and instead tend to focus on the process of managing "testing". Testing and Testers are two different things.
  • And what topics could we suggest to conferences
  • What can we collective do within the testing community to help nurture the next generation of Development Managers who care about good testing?
  • Why are so many people suffering in companies with bad management and not revolting on the streets and starting riots? Or at least protesting slightly louder than they appear to be? (life is short and all that)

It's clear from my attendance at conferences over the last year that people are being strangled in their careers and growth by bad management.....but how can we solve this problem?

Paul Gerrard, Gerrard Consulting, "Digital, Testing and Automation"

Digital is the buzz-phrase of the moment. Almost all the people that I know working on projects of some size say their project title is some part of a 'Digital Transformation'. Transformations in business and IT of any flavour are ambitious and not undertaken lightly. Digital must be important then. But what is it?

Could be labelled: "Software Development at the pace of marketing"?

Marketers see IT as the vehicle for doing rapid, continuous, relentless experiments in parallel with rapid, continuous, relentless delivery of new features to keep up with the Digital competition.

The barrier to achieving success in the software delivery process is likely to be the inability of testers to align testing and automated testing in particular to the development processes. Our track record in test automation is not good enough.

Paul will describe what the 'Digital Revolution' is and how it affects testing. There are some serious issues to consider, not least of which is that testing may be seen to be the bottleneck. How will we avoid that?

William Sault, CA Technologies, "Requirements from Data – Auto-Finding the Logic in the Data"

Applications are growing ever-more complex, and are producing more live system data than ever before. This is only getting worse, while testers sometimes find that the documentation is scarce, and knowledge of these complex systems is confined to subject matter experts. Imagine you are facing a massively complicated system, where solid documentation and subject matter expertise is unavailable. One available source of information is the data that goes in, and the data that comes out. This data can be found in numerous forms, such as live traffic, web logs and user interactions. How do you move from this to sufficiently testing a system?

This session will consider how, starting with complex live data, the knowledge of a system needed for rigorous testing can be derived. It will consider how data visualization can be used to model complex data, before applying rule-learning algorithms to reverse-engineer the constraints which led to the data flow. Not only does this help resolve the challenge of “technical debt”, but can be used to construct an accurate picture of the logic behind live systems, which might then be used to drive Model-Based Testing. Test cases and automated tests can be systematically derived from this model, in effect moving from unwieldy data to the smallest set of test cases needed for rigorous testing.

David Parker, Metaswitch Networks, "Early lessons in testing the Internet of Things"

Over the last decade, the introduction of Voice over IP technology has resulted in millions of phones in homes and businesses, being replaced by smart IP-enabled devices connected via the internet. This early wave of the “Internet of Things” has presented a number of specific challenges for testing, many of which will be applicable as the Internet of Things explodes to new levels of scale and complexity in the coming decade.

In this session, I will share some of our experiences testing Voice over IP solutions and IP networking software over the past decade. I’ll pull out the themes which I think will be particularly relevant for those testing IoT devices and services in the future. Here’s a taster of some areas which we may cover.

  • Testing without a GUI (or with a very limited one)
  • Machine-machine interfaces - Embedded software
  • Complex interoperability requirements
  • Testing at massive scale (millions of connected devices)
  • Bulk failure or load spike scenarios (e.g. citywide power failure and recovery)
  • Complex distributed systems
  • Tooling/automation. These can be specialist and therefore expensive - building your own can be more cost effective.
  • Software/firmware upgrade of remote devices
  • Security concerns for non web application software
  • Impact of underlying network performance
  • Managing configuration on remote devices
  • Analytics and diagnostics

Rod Armstrong, EasyJet, Asia Shahzad, Hotels.com, "Brave New World - workshop"

In our interactive session Brave New World we will introduce a thinking tool that will allow you and your organisation to not only accept change, but to actively embrace it and follow a flow that will take that change through to a conclusion. We will illustrate the concepts with some examples of successes and also with some of significant failures within organisations that did not successfully apply this kind of model.  

We anticipate that this tool will be relevant to everyone no matter what their specific level or role is within an organisation and when applied can lead to you looking at all situations, both professionally and personally with a new perspective.

Richard Bishop,TrustIV, "Network Virtualisation in Testing"

Network virtualisation helps you to emulate real-world environments adding realism to your functional and performance tests. In this session, Richard will introduce the concept of network virtualisation in testing and include a short video demonstration of HPE Network Virtualization (formerly Shunra) in use for both performance and functional tests.

After the demonstration and an overview of the potential “use cases” for this technology, Richard will host a Q&A session and discussion with the attendees to discuss the impact of the network in production and test environments. Both from a customer-facing perspective as well as when considering the performance of third-party links.

The presentation and subsequent discussion will draw on real world examples of mobile network performance based on the use of network performance monitoring tools within the UK as well as anecdotal information from other sources.

Eventbrite - Test Management Forum - Wednesday 27 January 2016