Example 1: Evaluating a new mobile phone handset

Consider a couple example situations to describe application benefits of the MDT testing methodology. First, a cell phone manufacturer is to introduce a new version of its phone operating system. Before it is initially released, the company would like confidence that the new software will work in various hardware and software configurations across all customers and mobile phone operators. The following 14 factors were to be considered in this evaluation:

  • 4 languages
  • GPS (yes, no)
  • 4 network protocols (2g, 3g, HPSA+, LTE)
  • 4 cell communication frequencies
  • Two communication types (GSM CDMA)
  • WIFI (two types)
  • Function A (yes, no)
  • Function B (yes, no)
  • Function C (yes, no)
  • Function D (yes, no)
  • Function F (yes, no)
  • Function G (yes, no)
  • Function H (yes, no)
  • Function I (yes, no)

An all-combinations test for this set of conductions would require 262,144 unique hardware-software integration tests. Using MDT, the prior list of factors could be tested with 32 unique tests and cover 96% of the two factor compatibilities and 85 % of the three factor compatibilities. MDT provides over 99.98% testing reduction, while providing very good coverage to the types of problems frequently encountered; e.g., the product fails when I do X with Y and Z – group size of 3 factors has 85% coverage of all possible combinations. 

Now look at MTD Example 2, Evaluating a new pc for compatibility with current hardware and networks