Version 5 supported

Unit and integration testing

A Unit Test is an automated piece of code that invokes a unit of work in the application and then checks the behavior to ensure that it works as it should. A simple example would be to test the result of a PHP method.

// app/src/Page.php
namespace {
    use SilverStripe\CMS\Model\SiteTree;

    class Page extends SiteTree
    {
        public static function myMethod()
        {
            return (1 + 1);
        }
    }
}
// app/tests/PageTest.php
namespace App\Test;

use Page;
use SilverStripe\Dev\SapphireTest;

class PageTest extends SapphireTest
{
    public function testMyMethod()
    {
        $this->assertEquals(2, Page::myMethod());
    }
}

Tests for your application should be stored in the app/tests directory. Test cases for add-ons should be stored in the (modulename)/tests directory.

Test case classes should end with Test (e.g. PageTest) and test methods must start with test (e.g. testMyMethod).

Ensure you import any classes you need for the test, including SilverStripe\Dev\SapphireTest or SilverStripe\Dev\FunctionalTest.

A Silverstripe CMS unit test is created by extending one of two classes, SapphireTest or FunctionalTest.

SapphireTest is used to test your model logic (such as a DataObject), and FunctionalTest is used when you want to test a Controller, Form or anything that requires a web page.

FunctionalTest is a subclass of SapphireTest so will inherit all of the behaviors. By subclassing FunctionalTest you gain the ability to load and test web pages on the site.

SapphireTest in turn, extends PHPUnit\Framework\TestCase. For more information on PHPUnit\Framework\TestCase see the PHPUnit documentation. It provides a lot of fundamental concepts that we build on in this documentation.

Test databases and fixtures

As the test runner will create new databases for the tests to run, the database user should have the appropriate permissions to create new databases on your server.

Silverstripe CMS tests create their own database when the test starts and fixture files are specified. New ss_tmp databases are created using the same connection details you provide for the main website. The new ss_tmp database does not copy what is currently in your application database. To provide seed data use a Fixture file.

The test database is rebuilt every time one of the test methods is run and is removed afterwards. If the test is interrupted, the database will not be removed. Over time, you may have several hundred test databases on your machine. To get rid of them, run sake dev/tasks/CleanupTestDatabasesTask.

Custom PHPUnit configuration

The phpunit executable can be configured by command line arguments or through an XML file. Silverstripe CMS comes with a default phpunit.xml.dist that you can use as a starting point. Copy the file into phpunit.xml and customize to your needs.

<!-- phpunit.xml -->
<phpunit bootstrap="vendor/silverstripe/framework/tests/bootstrap.php" colors="true">
    <testsuites>
        <testsuite name="Default">
            <directory>app/tests</directory>
        </testsuite>
    </testsuites>
    <groups>
        <exclude>
            <group>sanitychecks</group>
        </exclude>
    </groups>
</phpunit>

SetUp() and tearDown()

In addition to loading data through a Fixture File, a test case may require some additional setup work to be run before each test method. For this, use the PHPUnit setUp and tearDown methods. These are run at the start and end of each test.

namespace App\Test;

use SilverStripe\Core\Config\Config;
use SilverStripe\Dev\SapphireTest;
use SilverStripe\Versioned\Versioned;

class PageTest extends SapphireTest
{
    protected $usesDatabase = true;

    protected function setUp(): void
    {
        parent::setUp();

        // create 100 pages
        for ($i = 0; $i < 100; $i++) {
            $page = new Page(['Title' => "Page $i"]);
            $page->write();
            $page->copyVersionToStage(Versioned::DRAFT, Versioned::LIVE);
        }

        // set custom configuration for the test.
        Config::modify()->update('Foo', 'bar', 'Hello!');
    }

    public function testMyMethod()
    {
        // ...
    }

    public function testMySecondMethod()
    {
        // ...
    }
}

tearDownAfterClass and setUpBeforeClass can be used to run code just once for the file rather than before and after each individual test case. Remember to class the parent method in each method to ensure the core boot-strapping of tests takes place.

namespace App\Test;

use SilverStripe\Dev\SapphireTest;

class PageTest extends SapphireTest
{
    public static function setUpBeforeClass(): void
    {
        parent::setUpBeforeClass();

        // ...
    }

    public static function tearDownAfterClass(): void
    {
        parent::tearDownAfterClass();

        // ...
    }

    // ...
}

Config and injector nesting

A powerful feature of both Config and Injector is the ability to "nest" them so that you can make changes that can easily be discarded without having to manage previous values.

The testing suite makes use of this to "sandbox" each of the unit tests as well as each suite to prevent leakage between tests.

If you need to make changes to Config (or Injector) for each test (or the whole suite) you can safely update Config (or Injector) settings in the setUp or tearDown functions.

It's important to remember that the parent::setUp(); functions will need to be called first to ensure the nesting feature works as expected.

namespace App\Test;

use SilverStripe\Core\Config\Config;
use SilverStripe\Dev\SapphireTest;

class MyTest extends SapphireTest
{
    public static function setUpBeforeClass(): void
    {
        parent::setUpBeforeClass();
        //this will remain for the whole suite and be removed for any other tests
        Config::inst()->update('ClassName', 'var_name', 'var_value');
    }

    public function testFeatureDoesAsExpected()
    {
        //this will be reset to 'var_value' at the end of this test function
        Config::inst()->update('ClassName', 'var_name', 'new_var_value');
    }

    public function testAnotherFeatureDoesAsExpected()
    {
        // this will be 'var_value'
        Config::inst()->get('ClassName', 'var_name');
    }
}

Related documentation

API documentation