neurovlm.evaluation.ComparisonSelection

class neurovlm.evaluation.ComparisonSelection(family: 'str', task: 'str', domain: 'str | None' = None, variant: 'str | None' = None, checkpoint: 'str | Path | None' = None, from_run: 'str | Path | None' = None, evaluation_domain: 'str | None' = None)

Parameters:

• family (str)

• task (str)

• domain (str | None)

• variant (str | None)

• checkpoint (str | Path | None)

• from_run (str | Path | None)

• evaluation_domain (str | None)

__init__(family, task, domain=None, variant=None, checkpoint=None, from_run=None, evaluation_domain=None)

Parameters:

• family (str)

• task (str)

• domain (str | None)

• variant (str | None)

• checkpoint (str | Path | None)

• from_run (str | Path | None)

• evaluation_domain (str | None)

Return type:

None

Methods

__init__(family, task[, domain, variant, ...])
load_kwargs()

Attributes

checkpoint
domain
evaluation_domain
from_run
model_id
variant
family
task