neleval rank-systems
¶
Get filenames corresponding to best-ranked systems
Usage summary¶
$ neleval rank-systems --help
usage: neleval rank-systems [-h] [-m NAME] [--metric NAME]
[--group-re GROUP_RE] [--short-names]
[--group-limit GROUP_LIMIT | --group-max GROUP_MAX]
[--limit LIMIT | --max MAX]
FILE [FILE ...]
Get filenames corresponding to best-ranked systems
Given evaluation outputs, ranks the system by some measure(s), or
best per name group.
This is a useful command-line helper before plotting to ensure all have
same systems.
positional arguments:
FILE
optional arguments:
-h, --help show this help message and exit
-m NAME, --measure NAME
Which measures to use: specify a name (or group name)
from the list-measures command. This flag may be
repeated.
--metric NAME
--group-re GROUP_RE Rank systems within groups, where a system's group
label is extracted from its path by this PCRE
--short-names Strip common prefix/suffix off system names
--group-limit GROUP_LIMIT
Max number of entries per group (breaking ties
arbitrarily)
--group-max GROUP_MAX
Max rank per group
--limit LIMIT Max number of entries (breaking ties arbitrarily)
--max MAX Max rank