MTest: Frequently Asked Questions

Some of the most frequently asked questions are listed below:

General Questions
Specific Questions

 

General Questions

How do I contact the MTest support team?

You can access the MTest support website at https://model-engineers.com/support/mtest-support where you can submit a support request. Alternatively, you can contact the MTest support team directly via email mtest@model-engineers.com or telephone at +49 30 2091 6463 40.

Go top

What system requirements do I need to run MTest?

The following system requirements must be in place in order to use MTest with MATLAB®, Simulink®, Stateflow®, Embedded Coder®, and TargetLink®:

  • Microsoft Windows® operating system
  • MATLAB® R2013b to R2021b
  • Simulink® and Stateflow® (according to the corresponding MATLAB® version), depending on the models you wish to test
  • (Optional) TargetLink® v 3.x to 5.1 (base suite)
  • (Optional) Embedded Coder® inside R2011a, R2011b, R2012a, R2012b, R2013a, R2014a, R2014b, R2015a, R2015b, R2016b, R2017b, R2018b
  • (Optional) Oracle Java SE Runtime Environment 8, 64 bit, or newer (for use with the MTest Specification Editor)

Go top

Which MATLAB® versions are MTest compatible with?

MTest is compatible with MATLAB® R2013b to R2021b.

Go top

Which TargetLink® version does MTest support?

MTest is compatible with dSPACE TargetLink® v3.x - v5.1 (base suite).

Go top

Where do I download the latest version of MTest?

You can download the latest version of MTest at https://model-engineers.com/support/download/.

Go top

How do I install MTest?

MTest ships as a zip file. Unzip the file into a folder. Include the ...\MTest\bin directory in your MATLAB® path (only the \bin directory). Please note: You need write access to these directories (some files are rewritten during MTest execution).

Go top

How do I configure my license?

MTest ships with three license options available. Information on the steps necessary to set up an installation for each license model is available at:
http://www.model-examiner.de/gEJjlmzs1nRdUljMYYUO/Readme_License_Setup.html

For all license types, you can retrieve info on the license currently used directly from the GUI (Help ▷ View License Info), or via the command line (after you have opened MTest):
>> MTest_getLicenseInfo<br< When using MTest within a CI environment license injection is performed by the MES Jenkins Plugin, provided it has been configured properly. For more information about the MES Jenkins Plugin please contact support@model-engineers.com.

Go top

Is MTest certified in any form?

There is an ISO 26262 Qualification Kit available. It provides a framework

  • to determine the required level of confidence in a software tool, and
  • to qualify a software tool to create evidence that the tool is suitable to be used to tailor the activities or tasks required by ISO 26262,

so that the tool user can rely on the correct functioning of the software tool for those activities or tasks required by ISO 26262. The ISO 26262 Qualification Kit includes a wide set of document templates (e.g. tool application guide, tool criteria evaluation report, tool qualification report) as well as a user guide. The official certification is in progress.

Go top

Does MTest support test processes with respect to ISO 26262?

Yes. MTest supports testing units and integration testing of models with regard to ISO 26262. Moreover, the verification of software requirements is supported by

  • a requirement-based method for specifying tests (including functional test case generation),
  • requirements traceability,
  • the measurement of requirements coverage and structural coverage,
  • back-to-back testing of MiL/SiL/PiL, and
  • regression testing.

Go top

 

Specific Questions

Which types of models can be tested with MTest?

In general, all Simulink®- and Stateflow®-based models can be tested, which includes TargetLink® models.

Go top

Which model parts can be tested with MTest?

In principle, all subsystems and Stateflow® charts can be handled as test objects.

Go top

How do I specify my test cases?

MTest provides several approaches for coming up with a requirements-based test case specification:

  • Manual test case specification: Using MTest’s own test specification syntax (MTCD), that allows you to define test specifications
  • Test case variation: Allows for specification of logical test cases (using MTCD syntax) from which actual test cases are derived automatically
  • Functional test case generation: Based on formalized requirements (using MARS) test specifications are automatically generated based on the requirements’ trigger conditions

Regardless of which approach you use, MTest is capable of generating the actual test cases automatically (including the provision of test data).

Go top

How does MTest test my model?

After selecting a subsystem, the test environment is generated separately from the source model. During automatic creation the source model’s configuration, the signal specifications and parameters are detected automatically and carried over to the test environment.

Go top

What does MTCD mean?

MTCD is short for Model Test Case Design. This is a method to structure, implement, and document requirements-based tests. It increases efficiency while securing requirements traceability in comprehensive test projects.

Go top

What does MARS mean?

The MTest Assessable Requirements Syntax (MARS) is a natural language pattern, based approach to formal requirements. MARS was developed by MES in order to increase the quality of software requirements. It enables the specification of concise, unambiguous, and verifiable requirements that are easy to read and formulate. A MARS requirement is transferred automatically into an MTest assessment function that will act as a requirement observer while evaluating test data in MTest.

Go top

Is it possible to generate test cases with MTest?

MTest is able to automatically create functional test cases that aim to stimulate the requirements’ trigger condition for certain types of MARS requirements. This reduces the effort and time required for manual test case development.

Go top

How do I generate test cases?

MTest provides several approaches for coming up with a requirements-based test case specification:

  • Functional test case generation: Based on formalized requirements (using MARS) test specifications are automatically generated based on the requirements’ trigger conditions and the model’s signal specification (e.g. data type, signal range, and resolution).
  • Test case variation: Allows for specification of logical test cases (using MTCD syntax) from which actual test cases are derived automatically.

Go top

How should I structure my test suites?

MTest manages test projects hierarchically. Test projects can include multiple models that may contain multiple test objects (i.e. test items). Your test cases can be bundled by means of test groups (i.e. test suites).

Go top

How do I connect MTest with my Application Lifecycle Management (ALM) software?

MTest supports the import of requirements via Microsoft Excel® or ReqIF format. MTest enables you to export your test results via HTML and XML format. Formalized requirements can be exported via Microsoft Excel® and ReqIF.

Go top

How do I import my requirements into MTest?

MTest supports the import of requirements via Microsoft Excel® or ReqIF format.

Go top

How do I formalize requirements?

You can formalize your requirements using the MTest Specification Editor. Formalized requirements can be created easily and used for automatic generation of test cases and test assessments by means of templates, content assist, and syntax highlighting.

Go top

How do I link test cases to requirements?

When specifying test descriptions with MTCD each test case has an attribute containing the requirement ID. This is the only information MTest needs to create the trace between requirements, test cases, and your test evaluation results. Moreover, test cases can refer to multiple requirement IDs.

Go top

How do I include measurement data for use within my test cases?

Using MTest’s own test specification method (MTCD) it is easy to load measurement data from different file formats such as ASCII, MAT, and Microsoft Excel®.

Go top

How do I record signals and states that are neither input nor output signals?

MTest supports the data logging of internal signals for Simulink®, Stateflow®, and TargetLink® models.

Go top

How do I generate and simulate my code?

MTest handles code generation for you. It supports the code generators TargetLink® and Embedded Coder. Once code generation is invoked MTest automatically incorporates the code into the test environment.

Go top

How do I check if my model meets its requirements?

The easiest method for checking your model’s requirements compliance is to use test assessments. Assessments are requirement observers that functionally evaluate your test data. Based on formalized requirements (MARS) assessments are created automatically. However, you can also create them manually.

Go top

How do I check my requirements coverage?

The MTest test documentation reports a metric measuring the linkage of at least one test case to a respective requirement. Moreover, in-depth tracing information is provided as well.

Go top

How do I run my test projects automatically?

MTest provides comprehensive batch test capabilities including a large list of possible batch actions such as test data import, test harness creation, code generation, MiL/SiL simulation, test evaluation, test documentation, and so on. Furthermore, MTest can be used within a Jenkins automation server by means of the MES Jenkins Plugin. For more information on MES Jenkins Plugin please contact support@model-engineers.com.

Go top

How do I export my test results?

MTest supports the export of test results via XML and HTML format. Formalized requirements can be exported via Microsoft Excel® and ReqIF files.

Go top

Can I execute MTest and MXAM at the same time?

MTest and MXAM both require Java libraries. MTest and MXAM must initialize their paths in a separate step, before executing either tool. MTest ships with a demo initialization script that helps you with setting up your environment.

Go top

How do I track my project progress and integrity?

In MTest, important test artifacts (e.g. test cases and assessment) possess status attributes mapping onto their respective work progress. This data is taken into consideration for computing a quality/progress metric for your test project. Moreover, MTest can check its test projects with regard to their levels of completeness, correctness, and consistency.

Go top