Activity (5) includes careful
analysis of commercial and legal requirements of current or future MHP Test
Suites, as well as the developing framework for Java Test Suites
The project started with a set of existing test
assets which were partly validated tests, implemented but not validated tests,
or test assertions. Some parts of these assets were already contained in the
official DVB MHP 1.0.2.b Test Suite valid at the time of the start of the
project. These assets were further developed by the following activities:
Based on a coverage analysis of the current Test Suite
1.0.2.b and on the analysis of current interoperability problems experienced in
the market with practical applications, the project identified areas where
further test development should focus.
The project prioritised the results of that analysis,
and defined clear areas which would benefit from additional conformance
testing. From this work, a series of technical descriptions were created which
served as a basis for implementation of new tests.
After implementation, tests were validated in a close
and joint co-operation of the project partners as a major work item of the
project. A joint approach is absolutely required for conformance tests, since
these tests need to be of very high quality, need to stick exactly o the
underlying specification, and must not test extra implementation specific
details beyond the specification. The project established working methods and
develop technical infrastucture to support processing of several thousands of
tests in an effective way.