neleval confidence

Calculate percentile bootstrap confidence intervals for a system

Usage summary

$ neleval confidence --help
usage: neleval confidence [-h] -g GOLD [-n TRIALS] [-j N_JOBS]
                          [-p PERCENTILES] [--metrics METRICS] [-m NAME]
                          [--type-weights FILE] [-f {json,none,tab}]
                          FILE

Calculate percentile bootstrap confidence intervals for a system

positional arguments:
  FILE

optional arguments:
  -h, --help            show this help message and exit
  -g GOLD, --gold GOLD
  -n TRIALS, --trials TRIALS
  -j N_JOBS, --n_jobs N_JOBS
                        Number of parallel processes, use -1 for all CPUs
  -p PERCENTILES, --percentiles PERCENTILES
                        Output confidence intervals at these percentiles
                        (default: 90,95,99)
  --metrics METRICS     Calculate CIs for which metrics (default:
                        precision,recall,fscore)
  -m NAME, --measure NAME
                        Which measures to use: specify a name (or group name)
                        from the list-measures command. This flag may be
                        repeated.
  --type-weights FILE   File mapping gold and sys types to a weight, such as
                        produced by weights-for-hierarchy
  -f {json,none,tab}, --fmt {json,none,tab}