autograder
The autograder.cli.testing package contains tools to test, debug, and develop courses and assignments.
This package contains the following CLI tools:
Generate test data by starting the specified server and running all tests in this project.
usage: python3 -m autograder.cli.testing.generate-test-data
[-h] [--version] [--testing-mode]
[--server-output-file SERVER_OUTPUT_PATH]
[--server-stop-command SERVER_STOP_COMMAND] [--startup-skip-identify]
[--startup-wait STARTUP_WAIT_SECS]
RUN_SERVER_COMMAND
Setup a directory as if it is being graded. This is useful for seeing what the autograder will see right before grading begins.
usage: python3 -m autograder.cli.testing.setup-grading-dir [-h] [--version]
[--testing-mode] -a
ASSIGNMENT -s
SUBMISSION
[-o OUT_DIR] [-ss]
Submit multiple assignments to an autograder and ensure the output is as expected.
usage: python3 -m autograder.cli.testing.test-remote-submissions
[-h] [--version] [--server SERVER] [--user USER] [--pass PASS]
[--course COURSE] [--assignment ASSIGNMENT] [--message MESSAGE]
[--allow-late] [--testing-mode]
SUBMISSIONS_DIR
Run a grader against multiple test assignments and ensure the output matches the expected output.
usage: python3 -m autograder.cli.testing.test-submissions [-h] [--version]
[--testing-mode]
[-a ASSIGNMENT] -s
SUBMISSIONS
Verify test data by starting the specified server and testing HTTP exchanges against it.
usage: python3 -m autograder.cli.testing.verify-test-data [-h] [--version]
[--testing-mode]
[--server-output-file SERVER_OUTPUT_PATH]
[--server-stop-command SERVER_STOP_COMMAND]
[--startup-skip-identify]
[--startup-wait STARTUP_WAIT_SECS]
RUN_SERVER_COMMAND
TEST_DATA_DIR