Monday, July 20, 2020

Batch


AWS Batch
-         
https://docs.aws.amazon.com/batch/latest/userguide/what-is-batch.html
-         enables you to run batch computing workloads on the AWS Cloud
-         removes the undifferentiated heavy lifting of configuring and managing the required infrastructure, similar to traditional batch computing software
-         regional service, simplifies running batch jobs across multiple Availability Zones
-         supports any job that can be run as a Docker container
-         can take on workloads of any scale
-         user can specify the memory and CPUs to be used
-         Jobs - A unit of work (such as a shell script, a Linux executable, or a Docker container image). It runs as a containerized application on an Amazon EC2 instance in your compute environment, using parameters that you specify in a job definition.
-         Job definitions - specifies how jobs to be run; can attach IAM Role with specific permissions, specify which Docker image to use, how many resources to allocate, what parameters are to be passed in
-         Jobs queue – a job is submitted into a queue; one or more compute environments can be associated with a queue
-         Scheduler – evaluates the queue contents
-         Compute Environment - EC2 insistence
-         CloudWatch is available for Batch. Can do:
          §  Build custom dashboards
          §  Monitor progress of jobs
          §  Build complex workflows with dependencies
          §  Triger off a CloudWatch target – Lambda, SQS, SNS, Kinesis Data Stream OR another Batch job
-         CloudTrail – all activity is logged

No comments:

Post a Comment