Skip to content
AI features

针对无法外发数据的私有 LLM 部署

Illustration for 针对无法外发数据的私有 LLM 部署

一个在您自己的环境中运行的开源模型,根据您的任务进行基准测试,并根据您的实际吞吐量进行调整。

€6,000–€11,500 guide price16-28Ask about this service

What you get

  • 根据您的任务与托管基线进行基准测试的模型选择
  • 具有自动扩缩和健康检查的 GPU 支持的推理部署
  • OpenAI 兼容的端点,因此现有代码只需少量更改
  • 在您预计负载下的吞吐量和每 token 成本数据
  • 涵盖升级、回滚和容量规划的操作手册

Usually built with

vLLM
Llama 3
Kubernetes
Terraform

A guide, not a requirement — sellers propose what suits your situation.

Nobody offers this yet

No seller has published this service yet. Ask anyway — the request goes to the marketplace and sellers who do this kind of work can answer it.

Or publish it yourself if this is your work.

Close to this

What will it cost?

Four questions, an instant range. No account, no waiting.

How big is it?
What exists today?
When do you need it?
After it ships?

Estimated range

€6,000 – €11,500

16-28

Based on the catalogue guide — nobody has published this service yet, so there is no market price to work from. An estimate, not a quote: a seller prices the real job once they have read it.

Request a quote

Nobody has published this service yet.

Saying one gets you a straighter answer. Leaving it blank is fine.

Free, and not binding. By sending you agree to the terms.