vllm-serving-setup
byaws-samples· 161 skills
Design, deploy, and tune vLLM v0.18.2 inference serving on EKS with PagedAttention v2, Multi-LoRA, FP8 KV Cache, Chunked Prefill, and Continuous Batching. Produces Helm values.yaml, PodMonitor, HPA, and kubectl validation steps for production agentic workloads.
How to install vllm-serving-setup?
aws-samples/sample-oh-my-aidlcops/vllm-serving-setup
$npx -y skills add aws-samples/sample-oh-my-aidlcops --skill vllm-serving-setupInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/aws-samples/sample-oh-my-aidlcops" --skill "aws-samples/sample-oh-my-aidlcops/vllm-serving-setup"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/aws-samples/sample-oh-my-aidlcops" that are relevant to the current task. Run `npx skills add "https://github.com/aws-samples/sample-oh-my-aidlcops"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-storageAzure Storage Services including Blob Storage, File Shares, Queue Storage, Table Storage, and Data Lake.Jul 2026
- azure-resource-lookupList, find, and show Azure resources across subscriptions or resource groups.Jul 2026
- azure-resource-visualizerAnalyze Azure resource groups and generate detailed Mermaid architecture diagrams showing the relationships between individual resources.Jul 2026
- azure-computeAzure VM/VMSS router. WHEN: create / provision / deploy / spin-up VM, recommend VM size, compare VM pricing, VMSS, scale set, autoscale, burstable, lightweight…Jul 2026
- azure-quotasCheck/manage Azure quotas and usage across providers. For deployment planning, capacity validation, region selection.Jul 2026
- azure-upgradeAssess and upgrade Azure workloads between plans, tiers, or SKUs, or modernize Azure SDK dependencies in source code.Jul 2026
