Gemini Response Streaming

[TimPansino]

Overview

• Add response streaming support to Gemini through the google.genai package.
• Overhaul test suite to use the included ReplayApiClient from the package to offload development and maintenance of mock server to Google.
  • Re-recorded all responses as a result of this change.

Note for Reviewers: There is a new replays folder with 30,000+ lines of JSON. These are responses from the server that have been recorded by the SDK, not human generated (aside from editing the message contents to all match). I would advise against reading more than one invoke and one stream file for your own sake.

[github-actions]

✅MegaLinter analysis: Success

Descriptor	Linter	Files	Fixed	Errors	Warnings	Elapsed time
✅ ACTION	actionlint	8		0	0	0.99s
✅ MARKDOWN	markdownlint	7	0	0	0	1.48s
✅ PYTHON	ruff	1029	0	0	0	1.03s
✅ PYTHON	ruff-format	1029	0	0	0	0.42s
✅ YAML	prettier	19	0	0	0	1.65s
✅ YAML	v8r	19		0	0	5.35s
✅ YAML	yamllint	19		0	0	0.75s

See detailed reports in MegaLinter artifacts

Show us your support by starring ⭐ the repository

[codecov-commenter]

Codecov Report

❌ Patch coverage is 90.90909% with 10 lines in your changes missing coverage. Please review.
✅ Project coverage is 81.96%. Comparing base (b571894) to head (9aecee2).

Files with missing lines	Patch %	Lines
newrelic/hooks/mlmodel_gemini.py	91.00%	8 Missing and 1 partial ⚠️
newrelic/common/llm_utils.py	90.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1699      +/-   ##
==========================================
+ Coverage   81.90%   81.96%   +0.06%     
==========================================
  Files         214      214              
  Lines       25709    25803      +94     
  Branches     4076     4082       +6     
==========================================
+ Hits        21056    21150      +94     
+ Misses       3259     3257       -2     
- Partials     1394     1396       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.