feat: add static-embeddings like F16 safetensors lookup table

#1
by itsclelia - opened
No description provided.
Qdrant org

FastEmbed side: https://github.com/qdrant/fastembed/pull/832. Merge this PR first, then that one right after.

Pushed 8312f3f:

  • model.safetensors now holds the released int8 rows as embeddings and their per-row scales as weights (30 MB). FastEmbed's output matches the released encoder exactly.
  • zero_encoder.py is back to the released version. FastEmbed now handles special tokens and sqrt pooling itself.
  • The test script checks the file against the released encoder, with special tokens on.
jmzzomg changed pull request status to merged

Sign up or log in to comment