neurovlm.models.Specter

neurovlm.models.Specter#

class neurovlm.models.Specter(model='allenai/specter2_aug2023refresh', adapter='adhoc_query', orthgonalize=True, pooling=None, device='cpu')[source]#

Wrapper for Specter model.

__init__(model='allenai/specter2_aug2023refresh', adapter='adhoc_query', orthgonalize=True, pooling=None, device='cpu')[source]#

Initialize.

Parameters:

  • model ({"allenai/specter2_aug2023refresh", allenai/specter2"}) – Base model.

  • adapter ({"adhoc_query", "classification", "regression", "proximity"}) – Adapter to attach to the model, for specific use cases.

Methods

__init__([model, adapter, orthgonalize, ...])

Initialize.

from_pretrained()

Load pretrained Specter - an alias to init to keep api consistent.

orthogonalize(embedding)

pool(hidden, attention_mask[, method])

Pool embedding matrix.

to(device)

Move model to device.
Contents