Skip to content

README.md: set HF_TOKEN also in remote endpoint case#1164

Merged
lianhao merged 1 commit into
opea-project:mainfrom
intel-ai-tce:remote_readme_fix
Jul 17, 2025
Merged

README.md: set HF_TOKEN also in remote endpoint case#1164
lianhao merged 1 commit into
opea-project:mainfrom
intel-ai-tce:remote_readme_fix

Conversation

@louie-tsai

@louie-tsai louie-tsai commented Jul 16, 2025

Copy link
Copy Markdown
Contributor

Description

Remote Endpoint case miss HF Token for TEI and TEI Reranking.

Issues

[#1163 ]

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

NA

Tests

Test on customer cluster

@eero-t eero-t left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved. I just tested this, and bumped on it also myself.

Btw. Another PR would be needed for adding external support also for OpenAI API embedding inferencing endpoint, not just for LLM inferencing endpoint.

(AFAIK reranking inferencing does not have yet OpenAI API, so that would need to use some other API.)

@eero-t eero-t changed the title Update README.md README.md: add HF_TOKEN setting also for remote endpoint case Jul 16, 2025
@eero-t eero-t changed the title README.md: add HF_TOKEN setting also for remote endpoint case README.md: set HF_TOKEN also in remote endpoint case Jul 16, 2025
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
@lianhao lianhao merged commit fc68528 into opea-project:main Jul 17, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants