byaws-samples· 161 skills
Configure kgateway v2.0+ as L1 and Bifrost v1.x or LiteLLM v1.60+ as L2 for a 2-Tier Inference Gateway on EKS. Apply Cascade Routing (Haiku→Sonnet→Opus fallback), Semantic Router (intent-based model pick), and HTTPRoute with OTel trace propagation to Langfuse.
$npx -y skills add aws-samples/sample-oh-my-aidlcops --skill inference-gateway-routingInstalls into the current project.
Run `npx skills use "https://github.com/aws-samples/sample-oh-my-aidlcops" --skill "aws-samples/sample-oh-my-aidlcops/inference-gateway-routing"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/aws-samples/sample-oh-my-aidlcops" that are relevant to the current task. Run `npx skills add "https://github.com/aws-samples/sample-oh-my-aidlcops"` and select the relevant skills, then follow their instructions.