Skip to content

feat: add dd-trace for Datadog LLM Observability#16

Merged
inodb merged 2 commits into
cBioPortal:v0.8.3-rc1-custom-v9from
dippindots:enable-dd-llmobs
Jun 10, 2026
Merged

feat: add dd-trace for Datadog LLM Observability#16
inodb merged 2 commits into
cBioPortal:v0.8.3-rc1-custom-v9from
dippindots:enable-dd-llmobs

Conversation

@dippindots

Copy link
Copy Markdown

Summary

  • Adds dd-trace as a root dependency so it is available in the Docker image
  • Enables Datadog LLM Observability auto-instrumentation of Anthropic/OpenAI SDK calls via NODE_OPTIONS=--require dd-trace/init (set in the K8s deployment)
  • No code changes required — ddtrace patches the SDKs at startup automatically

Deployment

The following env vars are set in the K8s deployment (values.yaml):

NODE_OPTIONS=--require dd-trace/init
DD_LLMOBS_ENABLED=1
DD_LLMOBS_ML_APP=cbioagent
DD_LLMOBS_AGENTLESS_ENABLED=true
DD_SITE=datadoghq.com
DD_API_KEY=<from librechat-credentials-env secret>

Test plan

🤖 Generated with Claude Code

Adds dd-trace as a root dependency so NODE_OPTIONS=--require dd-trace/init
can auto-instrument Anthropic/OpenAI SDK calls at pod startup, enabling
token and cost tracking in the Datadog LLM Observability dashboard.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@inodb inodb changed the base branch from main to v0.8.3-rc1-custom-v9 June 10, 2026 15:46
@inodb inodb merged commit 327396e into cBioPortal:v0.8.3-rc1-custom-v9 Jun 10, 2026
1 check failed
@dippindots dippindots deleted the enable-dd-llmobs branch June 10, 2026 17:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants