inference
productllm
Try in Playground →RSS
Overview
LicenseApache-2.0
Open source✓ Open Source
Primary languagePython
Knowledge graph stats
Claims0
Avg confidence91%
Avg freshness50%
Last updatedUpdated 3h ago
Trust distribution
100% unverified
Governance
EU Riskgpai standard
GPAIStandard

inference

product

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Compare with...

data source

ValueTrustConfidenceFreshnessSources
GitHubUnverifiedHighStale0

license type

ValueTrustConfidenceFreshnessSources
Apache-2.0UnverifiedHighStale0

source code url

ValueTrustConfidenceFreshnessSources
https://github.com/xorbitsai/inferenceUnverifiedHighStale0

open source

ValueTrustConfidenceFreshnessSources
trueUnverifiedHighStale0

github open issues

ValueTrustConfidenceFreshnessSources
72UnverifiedHighStale0
70UnverifiedHighStale0

github topic

ValueTrustConfidenceFreshnessSources
wizardlmUnverifiedHighStale0
whisperUnverifiedHighStale0
vllmUnverifiedHighStale0
qwenUnverifiedHighStale0
pytorchUnverifiedHighStale0
openai-apiUnverifiedHighStale0
mistralUnverifiedHighStale0
machine-learningUnverifiedHighStale0
llmUnverifiedHighStale0
llamacppUnverifiedHighStale0
llama3UnverifiedHighStale0
llamaUnverifiedHighStale0
inferenceUnverifiedHighStale0
glm4UnverifiedHighStale0
ggmlUnverifiedHighStale0
gemmaUnverifiedHighStale0
flan-t5UnverifiedHighStale0
deploymentUnverifiedHighStale0
chatglmUnverifiedHighStale0
artificial-intelligenceUnverifiedHighStale0

last code update

ValueTrustConfidenceFreshnessSources
2026-04-10T07:22:18ZUnverifiedHighStale0

programming language

ValueTrustConfidenceFreshnessSources
PythonUnverifiedHighStale0

github watchers

ValueTrustConfidenceFreshnessSources
9212UnverifiedHighStale0

github forks

ValueTrustConfidenceFreshnessSources
814UnverifiedHighStale0

github stars

ValueTrustConfidenceFreshnessSources
9212UnverifiedHighStale0

Related entities

Claim count: 0Last updated: 4/10/2026Edit history