Skip to content

evaluator: cross-session memory leakage #110

Description

@achuvyas-kv

Area

Agent Evaluators (evaluators/agent/)

Problem or motivation

Agents with persistent memory can leak information from one user session to another, creating privacy and security risks.

Proposed solution

Add evaluator under evaluators/agent/memory-rag/ that:

  • Tests if session A's data can be retrieved by session B
  • Includes multi-turn patterns for memory probing

Acceptance criteria

  • Evaluator YAML file created with pass/fail criteria
  • Patterns cover direct and indirect memory retrieval attempts
  • Test against customer-support agent (multi-session)

Alternatives considered

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions