Legacy

Legacy functions and architectures

Archived implementations available through spacy-legacy

The spacy-legacy package includes outdated registered functions and architectures. It is installed automatically as a dependency of spaCy, and provides backwards compatibility for archived functions that may still be used in projects.

You can find the detailed documentation of each such legacy function on this page.

Architectures

These functions are available from @spacy.registry.architectures.

spacy.Tok2Vec.v1

The spacy.Tok2Vec.v1 architecture was expecting an encode model of type Model[Floats2D, Floats2D] such as spacy.MaxoutWindowEncoder.v1 or spacy.MishWindowEncoder.v1.

Construct a tok2vec model out of two subnetworks: one for embedding and one for encoding. See the “Embed, Encode, Attend, Predict” blog post for background.

NameDescription
embedEmbed tokens into context-independent word vector representations. For example, CharacterEmbed or MultiHashEmbed. Model[List[Doc], List[Floats2d]]
encodeEncode context into the embeddings, using an architecture such as a CNN, BiLSTM or transformer. For example, MaxoutWindowEncoder.v1. Model[Floats2d, Floats2d]

spacy.MaxoutWindowEncoder.v1

The spacy.MaxoutWindowEncoder.v1 architecture was producing a model of type Model[Floats2D, Floats2D]. Since spacy.MaxoutWindowEncoder.v2, this has been changed to output type Model[List[Floats2d], List[Floats2d]].

Encode context using convolutions with maxout activation, layer normalization and residual connections.

NameDescription
widthThe input and output width. These are required to be the same, to allow residual connections. This value will be determined by the width of the inputs. Recommended values are between 64 and 300. int
window_sizeThe number of words to concatenate around each token to construct the convolution. Recommended value is 1. int
maxout_piecesThe number of maxout pieces to use. Recommended values are 2 or 3. int
depthThe number of convolutional layers. Recommended value is 4. int

spacy.MishWindowEncoder.v1

The spacy.MishWindowEncoder.v1 architecture was producing a model of type Model[Floats2D, Floats2D]. Since spacy.MishWindowEncoder.v2, this has been changed to output type Model[List[Floats2d], List[Floats2d]].

Encode context using convolutions with Mish activation, layer normalization and residual connections.

NameDescription
widthThe input and output width. These are required to be the same, to allow residual connections. This value will be determined by the width of the inputs. Recommended values are between 64 and 300. int
window_sizeThe number of words to concatenate around each token to construct the convolution. Recommended value is 1. int
depthThe number of convolutional layers. Recommended value is 4. int

spacy.TextCatEnsemble.v1

The spacy.TextCatEnsemble.v1 architecture built an internal tok2vec and linear_model. Since spacy.TextCatEnsemble.v2, this has been refactored so that the TextCatEnsemble takes these two sublayers as input.

Stacked ensemble of a bag-of-words model and a neural network model. The neural network has an internal CNN Tok2Vec layer and uses attention.

NameDescription
exclusive_classesWhether or not categories are mutually exclusive. bool
pretrained_vectorsWhether or not pretrained vectors will be used in addition to the feature vectors. bool
widthOutput dimension of the feature encoding step. int
embed_sizeInput dimension of the feature encoding step. int
conv_depthDepth of the tok2vec layer. int
window_sizeThe number of contextual vectors to concatenate from the left and from the right. int
ngram_sizeDetermines the maximum length of the n-grams in the BOW model. For instance, ngram_size=3would give unigram, trigram and bigram features. int
dropoutThe dropout rate. float
nOOutput dimension, determined by the number of different labels. If not set, the TextCategorizer component will set it when initialize is called. Optional[int]

spacy.HashEmbedCNN.v1

Identical to spacy.HashEmbedCNN.v2 except using spacy.StaticVectors.v1 if vectors are included.

spacy.MultiHashEmbed.v1

Identical to spacy.MultiHashEmbed.v2 except with spacy.StaticVectors.v1 if vectors are included.

spacy.CharacterEmbed.v1

Identical to spacy.CharacterEmbed.v2 except using spacy.StaticVectors.v1 if vectors are included.

Layers

These functions are available from @spacy.registry.layers.

spacy.StaticVectors.v1

Identical to spacy.StaticVectors.v2 except for the handling of tokens without vectors.

Loggers

These functions are available from @spacy.registry.loggers.

spacy.WandbLogger.v1

The first version of the WandbLogger did not yet support the log_dataset_dir and model_log_interval arguments.