Command-line reference

neleval is mostly used through its command-line interface.

• neleval --help: usage overview

Evaluation and analysis of a single system

• neleval evaluate
  • Usage summary
  • Evaluating each document separately
• neleval analyze
  • Usage summary
• neleval significance
  • Usage summary
• neleval confidence
  • Usage summary

Comparison of multiple systems’ results

• neleval compare-measures
  • Usage summary
• neleval rank-systems
  • Usage summary
• neleval plot-systems
  • Usage summary

Task definition and metric meddling

• neleval list-measures
  • Usage summary
  • List all predefined measures
• neleval compose-measures
  • Usage summary
• neleval select-alternatives
  • Usage summary
• neleval to-weak
  • Usage summary
• neleval weights-for-hierarchy
  • Usage summary
  • Converting JSON type hierarchy to weights

Data preparation and validation

• neleval validate-spans
  • Usage summary
• neleval prepare-tac
  • Usage summary
• neleval prepare-tac15
  • Usage summary
• neleval prepare-brat
  • Usage summary
• neleval prepare-conll-coref
  • Usage summary