Moodle PHP Documentation 4.5
Moodle 4.5dev (Build: 20240606) (d3ae1391abe)
|
Helper base class for question walk-through tests. More...
Public Member Functions | |
assert ($expectation, $compare, $notused='') | |
assert_same_xml ($expectedxml, $xml) | |
Check that 2 XML strings are the same, ignoring differences in line endings. | |
assert_select_options ($expectation, $html) | |
Use this function rather than assert when checking the value of options within a select element. | |
assertDebuggingCalled ($debugmessage=null, $debuglevel=null, $message='') | |
Assert that exactly debugging was just called once. | |
assertdebuggingcalledcount ($expectedcount, $debugmessages=[], $debuglevels=[], $message='') | |
Asserts how many times debugging has been called. | |
assertDebuggingNotCalled ($message='') | |
Call when no debugging() messages expected. | |
assertEqualsIgnoringWhitespace ($expected, $actual, string $message='') | |
Assert that two Date/Time strings are equal. | |
assertEventContextNotUsed (\core\event\base $event, $message='') | |
Assert that various event methods are not using event->context. | |
assertEventLegacyData ($expected, core\event\base $event, $message='') | |
Assert that an event legacy data is equal to the expected value. | |
assertEventLegacyLogData ($expected, core\event\base $event, $message='') | |
Assert that an event legacy log data is equal to the expected value. | |
assertTimeCurrent ($time, $message='') | |
Assert that: start < $time < time() | |
getDebuggingMessages () | |
Return debugging messages from the current test. | |
getExternalTestFileUrl ($path, $https=false) | |
Returns UTL of the external test file. | |
mock_clock_with_frozen (?int $time=null,) | |
Mock the clock with a frozen clock. | |
mock_clock_with_incrementing (?int $starttime=null,) | |
Mock the clock with an incrementing clock. | |
preventResetByRollback () | |
Call this method from test if you want to make sure that the resetting of database is done the slow way without transaction rollback. | |
recurseFolders ($path, $callback, $fileregexp='/.*/', $exclude=false, $ignorefolders=array()) | |
Recursively visit all the files in the source tree. | |
redirectEmails () | |
Starts email redirection. | |
redirectEvents () | |
Starts event redirection. | |
redirectHook (string $hookname, callable $callback) | |
Override hook callbacks. | |
redirectMessages () | |
Starts message redirection. | |
resetAfterTest ($reset=true) | |
Reset everything after current test. | |
resetDebugging () | |
Clear all previous debugging messages in current test and revert to default DEVELOPER_DEBUG level. | |
runBare () | |
Runs the bare test sequence. | |
setCurrentTimeStart () | |
Stores current time as the base for assertTimeCurrent(). | |
stopHookRedirections () | |
Remove all hook overrides. | |
waitForSecond () | |
Wait for a second to roll over, ensures future calls to time() return a different result. | |
Static Public Member Functions | |
static | assertNotTag ($matcher, $actual, $message='', $ishtml=true) |
Note: we are overriding this method to remove the deprecated error. | |
static | assertTag ($matcher, $actual, $message='', $ishtml=true) |
Note: we are overriding this method to remove the deprecated error. | |
static | assertValidKeys (array $hash, array $validKeys) |
Validate list of keys in the associative array. | |
static | findNodes (DOMDocument $dom, array $options, $isHtml=true) |
Parse out the options from the tag using DOM object tree. | |
static | getDataGenerator () |
Get data generator. | |
static | resetAllData ($detectchanges=false) |
Reset all database tables, restore global state and clear caches and optionally purge dataroot dir. | |
static | setAdminUser () |
Set current $USER to admin account, reset access cache. | |
static | setGuestUser () |
Set current $USER to guest account, reset access cache. | |
static | setTimezone ($servertimezone='Australia/Perth', $defaultphptimezone='Australia/Perth') |
Change server and default php timezones. | |
static | setUser ($user=null) |
Set current $USER, reset access cache. | |
Public Attributes | |
const | GRADE_DELTA = 0.00000005 |
Tolerance accepted in some unit tests when float operations are involved. | |
Protected Member Functions | |
add_mocked_plugin (string $plugintype, string $pluginname, string $path,) | |
Add a mocked plugin to Moodle. | |
add_mocked_plugintype (string $plugintype, string $path,) | |
Add a mocked plugintype to Moodle. | |
check_comment ($comment, $commentformat) | |
Asserts if the manual comment for the question is equal to the provided arguments. | |
check_current_mark ($mark) | |
check_current_output () | |
check_current_state ($state) | |
check_output_contains ($string) | |
check_output_contains_hidden_input ($name, $value) | |
check_output_contains_lang_string ($identifier, $component='', $a=null) | |
check_output_contains_selectoptions (... $expectations) | |
Use this function rather than check_current_output for select expectations where checking the value of the options is required. | |
check_output_contains_text_input ($name, $value=null, $enabled=true) | |
check_output_contains_text_input_with_class ($name, $class=null) | |
check_output_does_not_contain ($string) | |
check_output_does_not_contain_text_input_with_class ($name, $class=null) | |
check_step_count ($expectednumsteps) | |
createArrayDataSet () | |
createCsvDataSet () | |
createXMLDataSet () | |
dataset_from_array (array $data) | |
Creates a new dataset from PHP array. | |
dataset_from_files (array $files) | |
Creates a new dataset from CVS/XML files. | |
dataset_from_string (string $content, string $type, ?string $table=null) | |
Creates a new dataset from string (CSV or XML). | |
delete_quba () | |
finish () | |
get_contains_button_expectation ($name, $value=null, $enabled=null) | |
get_contains_cbm_radio_expectation ($certainty, $enabled=null, $checked=null) | |
get_contains_checkbox_expectation ($baseattr, $enabled, $checked) | |
get_contains_correct_expectation () | |
get_contains_corrupted_subquestion_message () | |
Returns an expectation that a string contains a corrupted subquestion message. | |
get_contains_corruption_notification () | |
Returns an expectation that a string contains a corrupted question notification. | |
get_contains_general_feedback_expectation ($question) | |
get_contains_hidden_expectation ($name, $value=null) | |
get_contains_hint_expectation ($hinttext) | |
get_contains_incorrect_expectation () | |
get_contains_mark_summary ($mark) | |
get_contains_marked_out_of_summary () | |
get_contains_mc_checkbox_expectation ($index, $enabled=null, $checked=null) | |
get_contains_mc_radio_expectation ($index, $enabled=null, $checked=null) | |
get_contains_num_parts_correct ($num) | |
get_contains_partcorrect_expectation () | |
get_contains_question_text_expectation ($question) | |
get_contains_radio_expectation ($baseattr, $enabled, $checked) | |
get_contains_select_expectation ($name, $choices, $selected=null, $enabled=null) | |
get_contains_standard_correct_combined_feedback_expectation () | |
get_contains_standard_incorrect_combined_feedback_expectation () | |
get_contains_standard_partiallycorrect_combined_feedback_expectation () | |
get_contains_submit_button_expectation ($enabled=null) | |
Returns an epectation that a string contains the HTML of a button with name {question-attempt prefix}-submit, and eiter enabled or not. | |
get_contains_tf_false_radio_expectation ($enabled=null, $checked=null) | |
get_contains_tf_true_radio_expectation ($enabled=null, $checked=null) | |
get_contains_try_again_button_expectation ($enabled=null) | |
get_contains_validation_error_expectation () | |
get_does_not_contain_correctness_expectation () | |
get_does_not_contain_feedback_expectation () | |
get_does_not_contain_hidden_expectation ($name, $value=null) | |
get_does_not_contain_mark_summary () | |
get_does_not_contain_num_parts_correct () | |
get_does_not_contain_specific_feedback_expectation () | |
get_does_not_contain_submit_button_expectation () | |
Returns an epectation that a string does not contain the HTML of a button with name {question-attempt prefix}-submit. | |
get_does_not_contain_try_again_button_expectation () | |
get_does_not_contain_validation_error_expectation () | |
get_invalid_answer_expectation () | |
get_mc_right_answer_index ($mc) | |
get_no_hint_visible_expectation () | |
get_question_attempt () | |
get_step ($stepnum) | |
get_step_count () | |
get_tag_matcher ($tag, $attributes) | |
get_tries_remaining_expectation ($n) | |
load_quba (moodle_database $db=null) | |
loadDataSet () | |
manual_grade ($comment, $mark, $commentformat=null) | |
process_autosave ($data) | |
process_submission ($data) | |
render () | |
Generate the HTML rendering of the question in its current state in $this->currentoutput so that it can be verified. | |
response_data_to_post ($data) | |
Convert an array of data destined for one question to the equivalent POST data. | |
run_all_adhoc_tasks () | |
Run adhoc tasks. | |
runAdhocTasks ($matchclass='', $matchuserid=null) | |
Run adhoc tasks, optionally matching the specified classname. | |
save_quba (moodle_database $db=null) | |
setUp () | |
start_attempt_at_question ($question, $preferredbehaviour, $maxmark=null, $variant=1) | |
tearDown () | |
Static Protected Member Functions | |
static | getDescendants (DOMNode $node) |
Recursively get flat array of all descendants of this node. | |
static | getElementsByCaseInsensitiveTagName (DOMDocument $dom, $tag) |
Gets elements by case insensitive tagname. | |
static | getNodeText (DOMNode $node) |
Get the text value of this node's child text node. | |
Protected Attributes | |
string | $currentoutput = '' |
after render() has been called, this contains the display of the question in its current state. | |
question_display_options | $displayoptions |
question_usage_by_activity | $quba |
int | $slot |
The slot number of the question_attempt we are using in $quba. | |
Helper base class for question walk-through tests.
The purpose of tests that use this base class is to simulate the entire interaction of a student making an attempt at a question. Therefore, these are not really unit tests. They would more accurately be described as integration tests. However, whether they are unit tests or not, it works well to implement them in PHPUnit.
Historically, tests like this were made because Moodle did not have anything like Behat for end-to-end testing. Even though we do now have Behat, it makes sense to keep these walk-through tests. They run massively faster than Behat tests, which gives you a much faster feedback loop while doing development. They also make it quite easy to test things like regrading the attempt after the question has been edited, which would be possible but very fiddly in Behat.
Ideally, the full set of tests for the question class of a question type would be:
What one would expect to see in one of these walk-through tests is:
// 1. Set up a question: $q.
// 2. A call to $this->start_attempt_at_question($q, ...); with the relevant options.
// 3. Some number of calls to $this->process_submission passing an array of simulated // POST data that matches what would be sent back be submitting a form that contains // the form fields that are output by rendering the question. This is like clicking // the 'Check' button in a question, or navigating to the next page in a quiz.
// 4. A call to $this->finish(); which is the equivalent of clicking // 'Submit all and finish' in the quiz.
// 5. After each of steps 2-4 above, one would expect to see a certain amount of // validation of the state of the question and how the question is rendered, // using methods like $this->check_current_state(), $this->check_current_output, etc.
The best way to work out how to write tests like this is probably to look at some examples in other question types or question behaviours.
In writing these tests, it is worth noting the following points:
a) The easiest mistake to make is at step 3. You need to ensure that your simulated post data actually matches what gets sent back when the question is submitted in the browser. Try checking it against the HTTP POST requests you see in your browser when the question is submitted. Some question types have a $q->prepare_simulated_post_data() method that can help with this.
b) In the past, tests like these used to contain even more repetitive code, and so they were re-factored to add the helper methods like start_attempt_at_question, process_submission, finish. That change had good effects, like reducing duplicate code. However, there were down-sides. The extra layers of indirection hide what is going on, which means these tests are harder to understand until you know what the helpers are doing. If you want an interesting exercise, take one of the walk-through tests, and inline all the helpers. This might be a good way to understand more about the question engine API. However, having made the everything-inlined code and learned from the process, you should then just throw it away.
c) The way check_current_output works is weird. When these tests were first written Moodle used SimpleTest for unit tests and check_current_output os written in a style that made sense there. When we moved to PHPUnit, a quick and dirty conversion was done. That was a pragmatic move at the time, and we just have to live with the result. Sorry. (And: don't copy that style for new things.)
|
protectedinherited |
Add a mocked plugin to Moodle.
A new plugin name must be provided with a path to the plugin's root. The plugin type must already exist (or have been mocked separately).
Please note that tests calling this method must be run in separate isolation mode. Please avoid using this if at all possible.
string | $plugintype | The name of the plugintype |
string | $pluginname | The name of the plugin |
string | $path | The path to the plugin's root |
|
protectedinherited |
Add a mocked plugintype to Moodle.
A new plugintype name must be provided with a path to the plugintype's root.
Please note that tests calling this method must be run in separate isolation mode. Please avoid using this if at all possible.
string | $plugintype | The name of the plugintype |
string | $path | The path to the plugintype's root |
|
inherited |
Check that 2 XML strings are the same, ignoring differences in line endings.
string | $expectedxml | The expected XML string |
string | $xml | The XML string to check |
|
inherited |
Use this function rather than assert when checking the value of options within a select element.
question_contains_select_expectation | $expectation | The select expectation class |
string | $html | The rendered output to check against |
|
inherited |
Assert that exactly debugging was just called once.
Discards the debugging message if successful.
null | string | $debugmessage | null means any |
null | string | $debuglevel | null means any |
string | $message |
|
inherited |
Asserts how many times debugging has been called.
int | $expectedcount | The expected number of times |
array | $debugmessages | Expected debugging messages, one for each expected message. |
array | $debuglevels | Expected debugging levels, one for each expected message. |
string | $message |
void |
|
inherited |
Call when no debugging() messages expected.
string | $message |
|
inherited |
Assert that two Date/Time strings are equal.
The strings generated by DateTime, strtotime, date, time, etc. are generated outside of our control. From time-to-time string changes are made. One such example is from ICU 72.1 which changed the time format to include a narrow-non-breaking-space (U+202F) between the time and AM/PM.
We should not update our tests to match these changes, as it is not our code that is generating the strings and they may change again. In addition, the changes are not equal amongst all systems as they depend on the version of ICU installed.
string | $expected | |
string | $actual | |
string | $message |
|
inherited |
Assert that various event methods are not using event->context.
While restoring context might not be valid and it should not be used by event url or description methods.
core\event\base | $event | the event object. |
string | $message |
void |
|
inherited |
Assert that an event legacy data is equal to the expected value.
mixed | $expected | expected data. |
core\event\base | $event | the event object. |
string | $message |
void |
|
inherited |
Assert that an event legacy log data is equal to the expected value.
mixed | $expected | expected data. |
core\event\base | $event | the event object. |
string | $message |
void |
|
staticinherited |
Note: we are overriding this method to remove the deprecated error.
array | $matcher | |
string | $actual | |
string | $message | |
boolean | $ishtml |
|
staticinherited |
Note: we are overriding this method to remove the deprecated error.
array | $matcher | |
string | $actual | |
string | $message | |
boolean | $ishtml |
|
inherited |
|
staticinherited |
Validate list of keys in the associative array.
array | $hash | |
array | $validKeys |
array |
PHPUnit\Framework\Exception |
|
protected |
Asserts if the manual comment for the question is equal to the provided arguments.
$comment | Comment text |
$commentformat | Comment format |
|
protected |
$condition | one or more Expectations. (users varargs). |
|
protected |
Use this function rather than check_current_output for select expectations where checking the value of the options is required.
check_current_output only checks that the right number of options are available.
question_contains_select_expectation | $expectations | One or more expectations. |
|
protectedinherited |
|
protectedinherited |
|
protectedinherited |
|
protectedinherited |
Creates a new dataset from PHP array.
array | $data | array of tables, see { |
phpunit_dataset |
|
protectedinherited |
Creates a new dataset from CVS/XML files.
This method accepts an array of full paths to CSV or XML files to be loaded into the dataset. For CSV files, the name of the table which the file belongs to needs to be specified. Example:
$fullpaths = [ '/path/to/users.xml', 'course' => '/path/to/courses.csv', ];
array | $files | full paths to CSV or XML files to load. |
phpunit_dataset |
|
protectedinherited |
Creates a new dataset from string (CSV or XML).
string | $content | contents (CSV or XML) to load. |
string | $type | format of the content to be loaded (csv or xml). |
string | $table | name of the table which the file belongs to (only for CSV files). |
phpunit_dataset |
|
staticinherited |
Parse out the options from the tag using DOM object tree.
DOMDocument | $dom | |
array | $options | |
bool | $isHtml |
array |
|
protected |
Returns an expectation that a string contains a corrupted subquestion message.
question_pattern_expectation | an expectation for use with check_current_output. |
|
protected |
Returns an expectation that a string contains a corrupted question notification.
question_pattern_expectation | an expectation for use with check_current_output. |
|
protected |
Returns an epectation that a string contains the HTML of a button with name {question-attempt prefix}-submit, and eiter enabled or not.
bool | $enabled | if not null, check the enabled/disabled state of the button. True = enabled. |
question_contains_tag_with_attributes | an expectation for use with check_current_output. |
|
protected |
Returns an epectation that a string does not contain the HTML of a button with name {question-attempt prefix}-submit.
question_contains_tag_with_attributes | an expectation for use with check_current_output. |
|
staticinherited |
Get data generator.
testing_data_generator |
|
inherited |
Return debugging messages from the current test.
array | with instances having 'message', 'level' and 'stacktrace' property. |
|
staticprotectedinherited |
Recursively get flat array of all descendants of this node.
DOMNode | $node |
array |
|
staticprotectedinherited |
Gets elements by case insensitive tagname.
DOMDocument | $dom | |
string | $tag |
DOMNodeList |
|
inherited |
Returns UTL of the external test file.
The result depends on the value of following constants:
They should point to standard external test files repository, it defaults to 'http://download.moodle.org/unittest'.
False value means skip tests that require external files.
string | $path | |
bool | $https | true if https required |
string | url |
|
staticprotectedinherited |
Get the text value of this node's child text node.
DOMNode | $node |
string |
|
protectedinherited |
|
inherited |
|
inherited |
Mock the clock with an incrementing clock.
null | int | $starttime |
incrementing_clock |
|
inherited |
Call this method from test if you want to make sure that the resetting of database is done the slow way without transaction rollback.
This is useful especially when testing stuff that is not compatible with transactions.
void |
|
inherited |
Recursively visit all the files in the source tree.
Calls the callback function with the pathname of each file found.
string | $path | the folder to start searching from. |
string | $callback | the method of this class to call with the name of each file found. |
string | $fileregexp | a regexp used to filter the search (optional). |
bool | $exclude | If true, pathnames that match the regexp will be ignored. If false, only files that match the regexp will be included. (default false). |
array | $ignorefolders | will not go into any of these folders (optional). |
void |
|
inherited |
Starts email redirection.
You can verify if email were sent or not by inspecting the email array in the returned phpmailer sink instance. The redirection can be stopped by calling $sink->close();
phpunit_message_sink |
|
inherited |
Starts event redirection.
You can verify if events were triggered or not by inspecting the events array in the returned event sink instance. The redirection can be stopped by calling $sink->close();
phpunit_event_sink |
|
inherited |
Override hook callbacks.
string | $hookname | |
callable | $callback |
void |
|
inherited |
Starts message redirection.
You can verify if messages were sent or not by inspecting the messages array in the returned messaging sink instance. The redirection can be stopped by calling $sink->close();
phpunit_message_sink |
|
inherited |
Reset everything after current test.
bool | $reset | true means reset state back, false means keep all data for the next test, null means reset state and show warnings if anything changed |
void |
|
staticinherited |
Reset all database tables, restore global state and clear caches and optionally purge dataroot dir.
bool | $detectchanges | true - changes in global state and database are reported as errors false - no errors reported null - only critical problems are reported as errors |
void |
|
protected |
Convert an array of data destined for one question to the equivalent POST data.
array | $data | the data for the quetsion. |
array | the complete post data. |
|
protectedinherited |
Run adhoc tasks, optionally matching the specified classname.
string | $matchclass | The name of the class to match on. |
int | $matchuserid | The userid to match. |
|
staticinherited |
Set current $USER to admin account, reset access cache.
void |
|
inherited |
Stores current time as the base for assertTimeCurrent().
Note: this is called automatically before calling individual test methods.
int | current time |
|
staticinherited |
Set current $USER to guest account, reset access cache.
void |
|
staticinherited |
Change server and default php timezones.
string | $servertimezone | timezone to set in $CFG->timezone (not validated) |
string | $defaultphptimezone | timezone to fake default php timezone (must be valid) |
|
staticinherited |
Set current $USER, reset access cache.
null | int | stdClass | $user | user record, null or 0 means non-logged-in, positive integer means userid |
void |
|
inherited |
Remove all hook overrides.
void |
|
inherited |
Wait for a second to roll over, ensures future calls to time() return a different result.
This is implemented instead of sleep() as we do not need to wait a full second. In some cases due to calls we may wait more than sleep() would have, on average it will be less.