Hugging Face 推理镜像选择

原名：hf-cloud-serving-image-selection

根据模型、框架、硬件与任务选择匹配的推理容器镜像。

中文 Skills 技能说明

适合部署前避免框架、CUDA 或架构不匹配；镜像必须来自可信来源并固定版本或摘要，不能运行来源不明的远程镜像。开源工具可以本地使用；访问 Hugging Face Hub、Spaces、ZeroGPU、AWS 或托管服务时，用户需自行确认中国大陆网络、账户、区域、费用、模型与数据许可证及跨境要求。执行前应读取项目现状和官方文档，输出目标、依据、影响、验证结果与回退方式；没有真实证据时明确说明未知，不编造配置、数据或成功状态。代码、日志、令牌、连接串、模型、数据集和企业资料按敏感内容处理，只读取任务所需范围，上传或外发前完成授权、脱敏和最小化。

上游能力依据

上游原始适用说明：Pick the right serving container for a SageMaker model deployment and find its current image URI. Use this skill whenever about to deploy a model to a SageMaker endpoint and an image URI needs to be chosen — including when the user says "deploy this LLM", "host this HuggingFace model", "serve this fine-tuned model", "deploy this embedding model", "host a reranker", "serve a sentence-transformers model", or when about to hardcode any container URI in deployment code. HuggingFace-curated Deep Learning Containers are ALWAYS preferred: HuggingFace vLLM (LLMs and generative rerankers), HuggingFace vLLM-Omni (multimodal), TEI (embeddings/cross-encoder rerankers), HF Inference Toolkit (other transformers). Generic images (AWS vLLM, DJL-LMI, SGLang) are used only when no HuggingFace image is compatible — never merely because they carry a newer version. Never hardcode a container URI from memory and never default to TGI. Prevents stale-image failures and wrong-region URIs.

上游 SKILL.md 主要章节（保留原文标题）：

Rule zero: HuggingFace images always win
Where image URIs come from
Quick decision
Rerankers: TEI or vLLM?
Workflow
TEI: pick the right variant
vLLM AMI requirement
Configuring the vLLM DLCs (HuggingFace vLLM and AWS vLLM)
Required for every HuggingFace LLM deployment
Tuning (optional)

使用边界

先读取项目约定、依赖版本和现有测试，再提出最小改动。写文件、运行脚本、提交代码或发布前应检查差异并保留回退路径。

作者、翻译与许可证

原作者: Hugging Face 与 huggingface/skills contributors
中文翻译: CEOFans翻译
许可证: Apache-2.0
上游来源: https://github.com/huggingface/skills/tree/cead19e10754e773bad24fecef83cb64be24094e/skills/hf-cloud-serving-image-selection

适用范围

平台：linux、macos、windows；标签：AI 工程、Hugging Face 推理镜像选择

安全提示

基础静态扫描不等于绝对安全。技能可能调用命令、浏览器、云服务或本地文件，请在最小权限环境中使用，高风险操作必须人工确认。

如发现侵权、许可证或安全问题，可在本页前台提交投诉，管理员复核后可立即下架。