All issues

Search results

OpenAI-compatible server cannot build MTP spec-base engine for Qwen3.8-27B: --speculative-config {"method":"mtp"} fails in the Python builder (Myelin tactic assertion)

bugSomething isn't workingSomething isn't working

Status: Open.

#223 In NVIDIA/TensorRT-Edge-LLM;

· wlarsong opened on Sep 27, 2026

llm_build fails with Myelin codegen error for maxInputLen >= 229376 (and 131072 at default batch size) on Qwen3.8-27B / SM110

bugSomething isn't workingSomething isn't working

Status: Open.

#222 In NVIDIA/TensorRT-Edge-LLM;

· wlarsong opened on Sep 26, 2026

feat: Add image-text datasets

Status: Open.

#221 In NVIDIA/TensorRT-Edge-LLM;

· FABallemand opened on Sep 25, 2026

Decoding cannot be constrained: no per-step hook in the sampling path, and logit_bias cannot substitute for one

Status: Open.

#218 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 17, 2026

Direct export/build fails for Qwen3 VL FP8 fine-grained 2D block-FP8 checkpoints

bugSomething isn't workingSomething isn't working

Status: Open.

#217 In NVIDIA/TensorRT-Edge-LLM;

· Sunk011 opened on Sep 17, 2026

tensorrt-edgellm-build --dense nvfp4-qdq SIGSEGVs in a libnvinfer compiler worker thread on Jetson Thor (CC 11.0) for Cosmos-Reason2-2B; --dense fp16 builds fine from the same NVFP4 checkpoint

bugSomething isn't workingSomething isn't working

Status: Open.

#216 In NVIDIA/TensorRT-Edge-LLM;

· TeramotoRYEC opened on Sep 17, 2026

llm_inference ignores temperature/top_p/top_k from the input JSON its own help tells you to set them in

Status: Open.

#211 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 12, 2026

Int4GroupwiseGemmPluginV2 fails silently when ENABLE_CUTE_DSL omits int4_fp16_gemm: "Failed to enqueue status -1" with no diagnostic

Status: Open.

#210 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 11, 2026

ONNX-less direct builder cannot resolve decoder tensors for multimodal cosmos3_edge, and renaming them yields a numerically wrong engine

Status: Open.

#208 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 11, 2026

SM103 (B300 / Blackwell Ultra) is missing from five SM allowlists across the build and the attention path

Status: Open.

#206 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 11, 2026

XQA NVRTC JIT passes no CUDA include path: cuda_fp16.h cannot find vector_types.h on x86 CUDA 12.x

Status: Open.

#204 In NVIDIA/TensorRT-Edge-LLM;

· filipemartinsubrobotics opened on Sep 11, 2026

x86 CuteDSL cubins missing in the repo

bugSomething isn't workingSomething isn't working

Status: Open.

#203 In NVIDIA/TensorRT-Edge-LLM;

· victoroliv2 opened on Sep 10, 2026