primary use case

[published]static · preferred

Batching multiple inference requests together to improve GPU utilization and throughput

ConfidenceRankTemporalMethod
High (95%)preferredstaticai_generated

Sources

SourceDomainScoreAI
primary_use_case