neleval confidence
¶
Calculate percentile bootstrap confidence intervals for a system
Usage summary¶
$ neleval confidence --help
usage: neleval confidence [-h] -g GOLD [-n TRIALS] [-j N_JOBS]
[-p PERCENTILES] [--metrics METRICS] [-m NAME]
[--type-weights FILE] [-f {json,none,tab}]
FILE
Calculate percentile bootstrap confidence intervals for a system
positional arguments:
FILE
optional arguments:
-h, --help show this help message and exit
-g GOLD, --gold GOLD
-n TRIALS, --trials TRIALS
-j N_JOBS, --n_jobs N_JOBS
Number of parallel processes, use -1 for all CPUs
-p PERCENTILES, --percentiles PERCENTILES
Output confidence intervals at these percentiles
(default: 90,95,99)
--metrics METRICS Calculate CIs for which metrics (default:
precision,recall,fscore)
-m NAME, --measure NAME
Which measures to use: specify a name (or group name)
from the list-measures command. This flag may be
repeated.
--type-weights FILE File mapping gold and sys types to a weight, such as
produced by weights-for-hierarchy
-f {json,none,tab}, --fmt {json,none,tab}