Deploying an NVIDIA NIM to EC2
In this demo we will see how to deploy an NVIDIA NIM to EC2 with Docker to do your own inference
See posts by tags
- CDK
- Lex
- AWS
- Typescript
- projen
- context
- cdk.json
- imdsv2
- launchTemplate
- Call Analytics
- Amazon Chime SDK
- bash
- script
- ECS
- Fargate
- RDS
- PostgreSQL
- Postgres
- VPC
- CloudFront
- WebSocket
- Application Load Balancer
- EC2
- cloud-init
- Pipelines
- ARM64
- Custom Resource
- Python
- S3
- Bedrock
- OpenSearch
- KnowledgeBase
- Cognito
- API Gateway
- Lambda
- Postman
- CodeBuild
- CodePipeline
- Minecraft
- cdk-nag
- NextJS
- Pipeline
- ACM
- Certificate
- NVIDIA
- NIM
- Docker
- Bucket Deployment
- github
- actions
- GitHub
- Athena
- Serverless
- SIPp
- Multi Region
- Asterisk
- X86_64
- AppRunner
- gRPC
- Transcribe
- KDS
- APIGateway
- CLI
- oh-my-zsh
- Cloudformation
- python
- ffmpeg
- KVS
- streaming
- aws4
- GPU
- Whisper
- Streaming
- SSR
- csv
See posts by categories
- CDK
- Lex
- AWS
- Typescript
- projen
- Call Analytics
- Amazon Chime SDK
- bash
- script
- ECS
- Fargate
- RDS
- PostgreSQL
- Postgres
- VPC
- CloudFront
- WebSocket
- Application Load Balancer
- EC2
- cloud-init
- Pipelines
- ARM64
- Custom Resource
- Python
- S3
- Bedrock
- OpenSearch
- KnowledgeBase
- Cognito
- API Gateway
- Lambda
- Postman
- CodeBuild
- CodePipeline
- Minecraft
- cdk-nag
- NextJS
- Pipeline
- Conditional
- Environment Variables
- StackProps
- Construct
- AMI
- ACM
- Certificate
- NVIDIA
- NIM
- Docker
- Bucket Deployment
- github
- actions
- GitHub
- Athena
- Serverless
- SIPp
- Multi Region
- Asterisk
- AppRunner
- gRPC
- Transcribe
- KDS
- APIGateway
- CLI
- oh-my-zsh
- Cloudformation
- python
- ffmpeg
- KVS
- streaming
- aws4
- GPU
- Whisper
- Streaming
- SSR
- csv
Showing posts from
Docker
