Configuration Options#

              /\___/\              ,'.-.'.           .-"-.
              `)9 9('              '\~ o/`          /|6 6|\
              {_:Y:.}_              { @ }          {/(_0_)\}
--------------( )U-'( )----------oOo-----oOo------oOo--U--oO--------------------
____|_______|_______|_______|_______|_______|_______|_______|_______|_______|___

Configuration Module#

Poodle imports module poodle_config.py, if available, to set configuration options.

Configuration File#

Poodle will search for available configuration files, and use the first available file from this list:

poodle.toml
pyproject.toml

Command Line#

Usage: poodle [OPTIONS] [SOURCES]...

  Poodle Mutation Test Tool.

Options:
  -c PATH         Configuration File.
  -q              Quiet mode: q, qq, or qqq
  -v              Verbose mode: v, vv, or vvv
  -w INTEGER      Maximum number of parallel workers.
  --exclude TEXT  Add a regex exclude file filter. Multiple allowed.
  --only TEXT     Glob pattern for files to mutate. Multiple allowed.
  --help          Show this message and exit.

Command Line Options#

SOURCES source_folders
-c config_file
-q Quiet
-v Verbose
-w max_workers
–exclude file_filters
–only only_files

Quiet or Verbose#

The -q and -v flags control how quiet or verbose poodle will be. These flags influence the values of echo_enabled and log_level.

Command Line	echo_enabled	log_level
`poodle -qqq`	`False`	`logging.CRITICAL`
`poodle -qq`	`False`	`logging.ERROR`
`poodle -q`	`False`	`logging.WARN`
`poodle` (default)	`True`	`logging.WARN`
`poodle -v`	`True`	`logging.INFO`
`poodle -vv`	`True`	`logging.DEBUG`
`poodle -vvv`	`True`	`logging.NOTSET`

OPTIONS#

Unless otherwise stated, options are chosen in this priority order:

Command Line options
Module poodle_config.py
Chosen Configuration File

config_file#

By default, Poodle will search for available configuration files, and use the first available file from this list:

poodle.toml
pyproject.toml

the config_file option is used to specify an alternate config file.

Do not use config_file for specifying location of poodle_config.py

Accepted formats: toml

Command Line

poodle -c=config.toml

poodle_config.py

config_file = "config.toml"

source_folders#

Folder(s) that contain your modules and/or packages.

Default: [“src”, “lib”]

Running each Trial consists of 3 steps:

Copy contents of a source folder to a temporary location.
Apply a single mutation to the copy of the source file.
Run test suite with the temporary folder added to the python path.

The list of source folders is a root folder that should be copied to a temporary location.

Typically, this is a folder like ‘src’ or ‘lib’. But could be almost anything depending on your project structure.

It should be the folder that contains your top level modules and/or packages. It should not be the package folder itself.

If the python files are in the working folder, specify this as ‘.’

More than one can be specified.

Note

Any folders specified in command line or in config files must exist. If none is specified, it will use ‘src’ and/or ‘lib’ only if they exist.

Command Line

poodle myapp myotherapp

poodle_config.py

source_folders = ["myapp", "myotherapp"]

poodle.toml

[poodle]
source_folders = ["myapp", "myotherapp"]

pyproject.toml

[tool.poodle]
source_folders = ["myapp", "myotherapp"]

only_files#

Only run mutation on files that match specified GLOB patterns.

When not specified, all python files that are in a source_folder, and don’t match a file_filter are mutated.

Default: None

Command Line

poodle --only cli.py --only model_*.py

poodle_config.py

only_files = ["cli.py", "model_*.py"]

poodle.toml

[poodle]
only_files = ["cli.py", "model_*.py"]

pyproject.toml

[tool.poodle]
only_files = ["cli.py", "model_*.py"]

file_filters#

Files that match these filters will NOT be mutated.

Poodle uses glob matching from the wcmatch package for matching and filtering files.

Default: ["test_*.py", "*_test.py"]

Command Line

poodle --exclude sql_*.py --only text_*.py

poodle_config.py

file_filters = ["sql_*.py", "text_*.py"]

poodle.toml

[poodle]
file_filters = ["sql_*.py", "text_*.py"]

pyproject.toml

[tool.poodle]
file_filters = ["sql_*.py", "text_*.py"]

file_flags#

This option is to set the flags used when searching source folders for files to mutate, and applying exclude filters. These flags are used either for searching with only_files or with file_filters.

Poodle uses glob matching from the wcmatch package for matching and filtering files.

Default: wcmatch.glob.GLOBSTAR | wcmatch.glob.NODIR

poodle_config.py

from wcmatch import glob
file_flags = glob.GLOBSTAR | glob.NODIR | glob.DOTGLOB

poodle.toml

[poodle]
file_flags = 16704

pyproject.toml

[tool.poodle]
file_flags = 16704

Tip

Recommend setting this value in poodle_config.py only. It must resolve to an int value.

Setting this in toml has to be resolved int value of combining the flags.

file_copy_filters#

Files that match these filters will NOT be copied to the temporary location.

Poodle uses glob matching from the wcmatch package for matching and filtering files.

Default: ["test_*.py", "*_test.py", "__pycache__/**"]

poodle_config.py

file_copy_filters = ["log.txt", "*.mdb"]

poodle.toml

[poodle]
file_copy_filters = ["log.txt", "*.mdb"]

pyproject.toml

[tool.poodle]
file_copy_filters = ["log.txt", "*.mdb"]

file_copy_flags#

This option is to set the flags used when searching source folders for files copy to the temporary location. These flags are used for searching with file_copy_filters.

Poodle uses glob matching from the wcmatch package for matching and filtering files.

Default: wcmatch.glob.GLOBSTAR | wcmatch.glob.NODIR

poodle_config.py

from wcmatch import glob
file_copy_flags = glob.GLOBSTAR | glob.NODIR | glob.DOTGLOB

poodle.toml

[poodle]
file_copy_flags = 16704

pyproject.toml

[tool.poodle]
file_copy_flags = 16704

Tip

Recommend setting this value in poodle_config.py only. It must resolve to an int value.

Setting this in toml has to be resolved int value of combining the flags.

work_folder#

Folder where temporary files will be stored. Folder is deleted before and after execution.

Default: .poodle-temp

poodle_config.py

work_folder = "temp-files"

poodle.toml

[poodle]
work_folder = "temp-files"

pyproject.toml

[tool.poodle]
work_folder = "temp-files"

max_workers#

By default, poodle sets the number of workers to be one less than the available CPUs from os.sched_getaffinity or os.cpu_count. Use this option to manually set the number of workers. With too few workers, available CPU is underutilized. With too many workers, additional overhead of process switching slows execution.

Command Line

poodle -w 4

poodle_config.py

max_workers = 4

poodle.toml

[poodle]
max_workers = 4

pyproject.toml

[tool.poodle]
max_workers = 4

log_format#

Logging Format for python’s logging package.

Default: "%(levelname)s [%(process)d] %(name)s.%(funcName)s:%(lineno)d - %(message)s"

poodle_config.py

log_format = "%(levelname)s - %(message)s"

poodle.toml

[poodle]
log_format = "%(levelname)s - %(message)s"

pyproject.toml

[tool.poodle]
log_format = "%(levelname)s - %(message)s"

log_level#

Logging Level for python’s logging package.

Default: logging.WARN

Command Line

python -v

See: Quiet or Verbose

poodle_config.py

log_level = logging.INFO

poodle.toml

[poodle]
log_level = "INFO"

pyproject.toml

[tool.poodle]
log_level = "INFO"

echo_enabled#

This determines if Poodle’s normal output should be enabled or not.

Default: True

Command Line

python -q

See: Quiet or Verbose

poodle_config.py

echo_enabled = False

poodle.toml

[poodle]
echo_enabled = "False"

pyproject.toml

[tool.poodle]
echo_enabled = "False"

add_mutators#

Additional mutators to be used when creating mutations. This list can contain any of the following:

Reference to the Mutator Class type
Reference to the Mutator Function
String fully qualified name of the Mutator Class
String fully qualified name of the Mutator Function

Default: []

poodle_config.py

from poodle import Mutator

class CustomMutator(Mutator):
  ...

def other_mutator(config, echo, parsed_ast, *_, *__,):
  ...

add_mutators = [
    CustomMutator,
    other_mutator,
    "poodle-ext.mutators.SpecialObjectMutator",
    "poodle-ext.mutators.my_object_mutator",
]

poodle.toml

[poodle]
add_mutators = [
    "poodle-ext.mutators.SpecialObjectMutator",
    "poodle-ext.mutators.my_object_mutator",
]

pyproject.toml

[tool.poodle]
add_mutators = [
    "poodle-ext.mutators.SpecialObjectMutator",
    "poodle-ext.mutators.my_object_mutator",
]

skip_mutators#

Disables selected builtin mutators. Specify the name of the mutator. See Poodle’s Mutators

Default: []

poodle_config.py

skip_mutators = ["FuncCall","DictArray"]

poodle.toml

[poodle]
skip_mutators = ["FuncCall","DictArray"]

pyproject.toml

[tool.poodle]
skip_mutators = ["FuncCall","DictArray"]

mutator_opts#

This dict contains options that are used by various mutators. Options for builtin mutators are listed below, and detailed on the Mutator page.

Default: {}

poodle_config.py

mutator_opts = {"operator_level":"min"}

poodle.toml

[poodle.mutator_opts]
operator_level = "min"

pyproject.toml

[tool.poodle.mutator_opts]
operator_level = "min"

Builtin mutator_opts#

compare_filters: ComparisonMutator
operator_level: OperationMutator

runner#

Indicates which trial runner to use. Can be any of the following:

Name of a builtin Runner Function
Reference to the Runner Function
String fully qualified name of the Runner Function

Default: “command_line”

poodle_config.py

def my_runner(config, echo, run_folder, mutant, timeout, *_, *__,):
  ...

runner = my_runner

poodle_config.py

runner = "poodle-ext.runners.cool_runner"

poodle.toml

[poodle]
runner = "poodle-ext.runners.cool_runner"

pyproject.toml

[tool.poodle]
runner = "poodle-ext.runners.cool_runner"

runner_opts#

This dict contains options that are used by various runners. Options for builtin runners are listed below, and detailed on the Runner page.

Default: {"command_line": "pytest -x --assert=plain -o pythonpath="}

poodle_config.py

runner_opts = {
  "command_line":"pytest -x --assert=plain -o pythonpath= --sort-mode=fastest",
  "command_line_env":{"RUN_MODE":"MUTATION"},
}

poodle.toml

[poodle.runner_opts]
command_line = "pytest -x --assert=plain -o pythonpath= --sort-mode=fastest"

[poodle.runner_opts.command_line_env]
RUN_MODE = "MUTATION"

pyproject.toml

[tool.poodle.runner_opts]
command_line = "pytest -x --assert=plain -o pythonpath= --sort-mode=fastest"

[tool.poodle.runner_opts.command_line_env]
RUN_MODE = "MUTATION"

Builtin runner_opts#

command_line: Command Line Runner
command_line_env: Command Line Runner

min_timeout#

Default: 10 (seconds)

Shortest timeout value, in seconds, that can be used in the runner.

Timeout value is calculated as longest run from clean run tests, multiplied by timeout_multiplier.

If this calculated value is smaller than min_timeout, min_timeout is used instead.

poodle_config.py

min_timeout = 15

poodle.toml

[poodle]
min_timeout = 15

pyproject.toml

[tool.poodle]
min_timeout = 15

timeout_multiplier#

Used to calculate timeout value to use in runner. Timeout value is calculated as longest run from clean run tests, multiplied by timeout_multiplier.

Default: 10

poodle_config.py

timeout_multiplier = 2

poodle.toml

[poodle]
timeout_multiplier = 2

pyproject.toml

[tool.poodle]
timeout_multiplier = 2

reporters#

List of all mutators to be used after all trials are completed. This list can contain any of the following:

Name of a Builtin Reporter
Reference to the Mutator Class type
Reference to the Mutator Function
String fully qualified name of the Mutator Class
String fully qualified name of the Mutator Function

Default: ["summary", "not_found"]

poodle_config.py

def my_reporter(config, echo, testing_results, *_, **__):
   ...

reporters = [
    "summary",
    my_reporter,
    "poodle-ext.reporters.UploadToResultsServer",
    "poodle-ext.reporters.text_errors_file",
]

poodle.toml

[poodle]
add_mutators = [
    "summary",
    "poodle-ext.reporters.UploadToResultsServer",
    "poodle-ext.reporters.text_errors_file",
]

pyproject.toml

[tool.poodle]
add_mutators = [
    "summary",
    "poodle-ext.reporters.UploadToResultsServer",
    "poodle-ext.reporters.text_errors_file",
]

reporter_opts#

This dict contains options that are used by various reporters. Options for builtin reporters are listed below, and detailed on the Reporter page.

Default: {}

poodle_config.py

reporter_opts = {"not_found_file":"mutants-not-found.txt"}

poodle.toml

[poodle.reporter_opts]
not_found_file = "mutants-not-found.txt"

pyproject.toml

[tool.poodle.reporter_opts]
not_found_file = "mutants-not-found.txt"

Builtin reporter_opts#

not_found_file: Not Found Reporter