Skip to content

feat(ai-sdk): add video generation examples for all 15 supported models#18

Open
TimPietruskyRunPod wants to merge 1 commit into
mainfrom
feat/video-generation-examples
Open

feat(ai-sdk): add video generation examples for all 15 supported models#18
TimPietruskyRunPod wants to merge 1 commit into
mainfrom
feat/video-generation-examples

Conversation

@TimPietruskyRunPod

Copy link
Copy Markdown
Member

Summary

  • Add 15 new video generation example scripts covering all supported models in @runpod/ai-sdk-provider
  • Update existing generate-video.js to use npm imports and latest API patterns
  • Bump @runpod/ai-sdk-provider to ^1.4.0 and ai to ^6.0.116

Models covered

Text-to-Video (4): pruna/p-video, vidu/q3-t2v, alibaba/wan-2.6-t2v, alibaba/wan-2.2-t2v-720-lora

Image-to-Video (11): vidu/q3-i2v, kwaivgi/kling-v2.6-std-motion-control, kwaivgi/kling-video-o1-r2v, kwaivgi/kling-v2.1-i2v-pro, alibaba/wan-2.6-i2v, alibaba/wan-2.5, alibaba/wan-2.2-i2v-720, alibaba/wan-2.1-i2v-720, bytedance/seedance-v1.5-pro-i2v, openai/sora-2-pro-i2v, openai/sora-2-i2v

Key details

  • Each i2v example uses a unique AI-generated demo image from image.runpod.ai/demo/
  • Motion control example (kling-v2.6-std) uses person image + video reference via providerOptions.runpod.video (AI SDK has no native video input for generateVideo)
  • kling-video-o1-r2v uses standard prompt.image — the provider maps it to images array (see runpod/ai-sdk-provider#64)
  • Sora i2v includes explicit duration: 4 (required by API)

Test plan

  • All 16 scripts tested end-to-end — every model generates a video successfully

- Add 15 new example scripts (4 t2v, 11 i2v) covering all video models
- Update generate-video.js to use npm imports and latest API patterns
- Each i2v example uses a unique demo image from image.runpod.ai/demo/
- Motion control example (kling-v2.6-std) uses person image + video reference
- Sora i2v example includes explicit duration: 4 (required by API)
- Bump @runpod/ai-sdk-provider to ^1.4.0 and ai to ^6.0.116
@justinwlin justinwlin self-requested a review March 11, 2026 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants