Feature: Add API_KEY option for CLI#10
Open
TheBlackHacker wants to merge 2 commits into
Open
Conversation
facebook-github-bot
added
the
CLA Signed
SuienS
suggested changes
Jul 4, 2025
SuienS
left a comment
SuienS
left a comment
There was a problem hiding this comment.
Add api_key under vllm in the configs
| self.model = model_name or vllm_config.get('model') | ||
| self.max_retries = max_retries or vllm_config.get('max_retries') | ||
| self.retry_delay = retry_delay or vllm_config.get('retry_delay') | ||
| self.api_key = api_key or vllm_config.get('api_key') # save API key |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces support for specifying an API key to authenticate requests to the VLLM server. The API key can now be passed as a CLI option (--api-key) to the relevant commands, or in config file. When provided, the API key is added to the HTTP headers in requests made to the server.
Changes:
api_keyCLI option to commands such assystem-check,create, andcurate. Also added intollm_client.py.Motivation and Context: