Skip to content

Contextualized embedding endpoint #866

@francoisWeber

Description

@francoisWeber

Feature request

Hi Team,
Some embedding models have a "contextual" version where chunks of one document are jointly embedded to mutualize relevant info across individual embeddings. Example with pplx-embed-context-v1-0.6b which is the contextualized version of pplx-embed-v1-0.6b (now supported thanks to this PR. See examples on PPLX doc: https://docs.perplexity.ai/docs/embeddings/contextualized-embeddings#basic-usage

Have such an "contextualized-embed" endpoint could leverage this cool model family.

Motivation

The goal of contextual embeddings is to jointly embed chunks that are related to the same document in order to propagate information across every chunks.

Your contribution

Sorry I never wrote a single line of Rust

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions