Skip to content

feat: capture agent-turn input and spoken output - #7535

Closed
chenghao-mou wants to merge 1 commit into
chenghao/feat/AGT-3604-tool-result-namesfrom
chenghao/feat/AGT-3605-agent-turn-content
Closed

chenghao-mou wants to merge 1 commit into
chenghao/feat/AGT-3604-tool-result-namesfrom
chenghao/feat/AGT-3605-agent-turn-content

Conversation

@chenghao-mou

Copy link
Copy Markdown
Member

Show each turn’s caller input and delivered speech, including TTS-only greetings. Preserve output across tool follow-ups and use the transcript after interruption handling. Native realtime audio transcript correlation remains in AGT-3527.

Adapts @SanjuMLGeek’s content proposal from #7396; internal tool exchanges stay on child spans.

Stacked on #7534.

Addresses AGT-3605

Request summary and agent context

Model: GPT-6-Astra

Split the proposed telemetry improvements into focused PRs that are easy to review and revert. Use general problem summaries and omit customer details.

@chenghao-mou chenghao-mou added the review_effort:high Needs broad context and substantial validation label Sep 29, 2026
if user_input is not None and speech_handle._agent_turn_record_content:
gen_ai_telemetry.set_content_attributes(
turn_span,
input_messages=gen_ai_telemetry.to_input_messages(

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this feel unnatural here. the schema states that it should be inputs going into the LLM, but we are using it to state a single user turn.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i agree. this feels like a workaround to show nice UI for those spans on Datadog.

voice related convention is still WIP: http://github.com/open-telemetry/semantic-conventions-genai/pull/390 so I will close this one for now.

Co-authored-by: Sanjay Kukadiya <43816307+SanjuMLGeek@users.noreply.github.com>
@chenghao-mou
chenghao-mou force-pushed the chenghao/feat/AGT-3605-agent-turn-content branch from edcdb5b to d368517 Compare October 4, 2026 15:16
An error occurred while trying to automatically change base from chenghao/feat/AGT-3604-tool-result-names to main October 4, 2026 20:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

review_effort:high Needs broad context and substantial validation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants