Skip to content

[Scout] Raise server.maxPayload to 50MB in evals_security_persona_matrix config set #286201

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
patrykkopycinski wants to merge 3 commits into from
+12 −1
Closed

[Scout] Raise server.maxPayload to 50MB in evals_security_persona_matrix config set #286201

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
2bc04c1
[Scout] Raise server.maxPayload to 50MB in evals_security_persona_mat…
patrykkopycinski Aug 20, 2026
52d042f
Merge branch 'main' of https://github.com/elastic/kibana into ao-pr-e…
patrykkopycinski Aug 20, 2026
bdb16f3
Merge branch 'main' of https://github.com/elastic/kibana into ao-pr-e…
patrykkopycinski Aug 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion ...ers/configs/config_sets/evals_security_persona_matrix/stateful/classic.stateful.config.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,15 +43,26 @@ import { servers as evalsTracingConfig } from '../../evals_tracing/stateful/clas
* alert-analysis, alert-triage, workflow-authoring, entity-analytics (v1 path),
* detection-rule-edit (base), find-security-ml-jobs.
*
* `server.maxPayload` is raised from the Scout default (1.6 MB) because the
* judge's `/internal/inference/prompt` requests carry the full agent trajectory
* and exceed it on long multi-step examples (observed 413 on
* gemini-3.1-flash-lite, 2026-08-20). The inherited arg is filtered out and
* re-set here so the value is deterministic regardless of CLI arg ordering.
*
* Usage:
* node scripts/scout start-server --arch stateful --domain classic --serverConfigSet evals_security_persona_matrix
*/
const MAX_PAYLOAD_BYTES = 50 * 1024 * 1024; // 50 MB

export const servers: ScoutServerConfig = {
...evalsTracingConfig,
kbnTestServer: {
...evalsTracingConfig.kbnTestServer,
serverArgs: [
...evalsTracingConfig.kbnTestServer.serverArgs,
...evalsTracingConfig.kbnTestServer.serverArgs.filter(
(arg) => !arg.startsWith('--server.maxPayload=')
),
`--server.maxPayload=${MAX_PAYLOAD_BYTES}`,
'--uiSettings.overrides.agentBuilder:experimentalFeatures=true',
`--xpack.securitySolution.enableExperimental=${JSON.stringify([
'automaticTroubleshootingSkill',
Expand Down
Loading