Skip to content
This repository has been archived by the owner on Oct 2, 2024. It is now read-only.
David edited this page Nov 7, 2013 · 2 revisions

Introduction

The OVAL Test Content is a set of OVAL Definitions that provides a simple way to test the capability of OVAL Definition Evaluators. After running the OVAL Test Content through an OVAL Definition Evaluator, the OVAL Results will show the user which tests are properly supported by that tool. This allows users to perform unit testing of tools against the OVAL Language. Over time, the OVAL Test Content will cover the basic behavior of all tests and capabilities in the OVAL Language.

Version Information

The OVAL Test Content has four components to its version. The first three components align with the major, minor, and update release versions of the OVAL Language. The fourth component is the build number of the OVAL Test Content. This build number is incremented as we produce and test new releases of the OVAL Test Content. The complete version identifier has the following form: MAJOR.MINOR.UPDATE.BUILD. For example, "5.10.1.1".

All new content (definitions, tests, objects, etc.) starts with a version of '1'. For updated content, the version will be incremented by one for all changes (including non-functional updates, such as comment only changes). This applies to all items (definitions, tests, objects, etc.). Additionally, all items that make use of the updated item will also have their version incremented by one (this is done recursively). Note that this recursive version incrementing does not continue past the definition level. That is, if a definition that has been updated is extended by another definition, the extending definition will not have its version incremented.

Supported Platforms and Constructs

The OVAL Test Content should be considered an initial draft. The content does not test all OVAL Language capabilities and has been developed and tested on a small number of systems. It has been released at this early stage because it provides value to the community as a draft and because the best way to mature this test content is through active use and collaboration with the community. Future releases will address that feedback. For a complete listing of the tests that are supported see the [Supported Constructs] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs) page.

Red Hat Linux

The OVAL Test Content is currently developed and tested on the 32-bit version of Red Hat Enterprise Linux 5. [Supported Constructs for Linux] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#linux).

Sun Solaris

The OVAL Test Content is currently developed and tested on the 32-bit version of Sun Solaris 10. [Supported Constructs for Solaris] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#solaris).

Microsoft Windows

The OVAL Test Content is currently developed and tested on the 64-bit version of Microsoft Windows 7. [Supported Constructs for Windows] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#windows).

Mac OS

The OVAL Test Content is currently developed and tested on the 32-bit version of Apple Mac OSX 10.6. [Supported Constructs for Mac OS] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#mac-os).

Using the OVAL Test Content

Quick Start Guide

  1. Set up Git on your system
  2. Create a new issue to request a new feature or to report a bug in the OVAL Test Content Tracker
  3. Fork the OVAL Test Content Repository
  4. [Make changes] (https://github.com/OVALProject/Test-Content/wiki/Make-Changes) to your fork
  5. Send a pull request
  6. [Sync] (https://help.github.com/articles/syncing-a-fork) your fork to get the latest changes

Preparing the System

First, extract the OVAL Test Content to a directory of your choice. Then unzip support.zip to the following location depending on the platform of the system being tested.

Windows: C:\support

Linux, Mac OS, Solaris: /tmp/support

Running the Content

Run each of the OVAL Definition documents in the platform directory of the system being tested against your OVAL Definition Evaluator.

Expected Results

Each OVAL Definition document is written to evaluate to true unless otherwise specified.

Requesting New OVAL Test Content

To request new OVAL Test Content, please add a feature request tracker item, with a brief description of the content that you would like to see created. We will be adding new OVAL Test Content as we implement new features in the OVAL Interpreter, however, if the OVAL Community would like to see certain content get created, we would be happy to accommodate that need.

Reporting Problems

To report a problem with the OVAL Test Content, please add a [bug tracker] (https://github.com/OVALProject/Test-Content/issues/new?&labels=bug) item, with a brief description of the problem. Please include the platform and version of the OVAL Test Content, the name of the OVAL Definitions document, and the identifier of the affected construct.

Useful Links

The [Useful Links] (https://github.com/OVALProject/Test-Content/wiki/Useful-Links) page contains links to resources that will help with the OVAL Test Content and GitHub among other things.