Monday, July 20, 2020

Athena

Athena
-        https://docs.aws.amazon.com/athena/latest/ug/what-is.html
-         interactive query service that makes it easy to analyze data directly in Amazon Simple Storage Service (Amazon S3) using standard SQL.
-         Athena is an overlay on top of S3. The data is loaded into and queried by Athena
-         Data - unstructured, semi-structured, and structured data stored in Amazon S3. Examples include CSV, JSON, or columnar data formats such as Apache Parquet and Apache ORC. You can use Athena to run ad-hoc queries using ANSI SQL, without the need to aggregate or load the data into Athena.
          §  Columnar data – fast to query. Data can be converted into columns by creating an EMR cluster and converting using Hive
-         Integrates with Amazon QuickSight for easy data visualization. You can use Athena to generate reports or to explore data with business intelligence tools or SQL clients connected with a JDBC or an ODBC driver.
-         You can access Athena using the AWS Management Console, through a JDBC or ODBC connection, using the Athena API, or using the Athena CLI
-         Encryption – query results are stored in S3, can be encrypted
-         Query results - .csv and .csv.metadata
-         Query history – kept for 45 days; to extend this - can write code to read the data and write into S3
-         Can use Athena to query log databases:
          §  CloudTrail logs
          §  CloudFront logs
          §  LoadBalancer logs
          §  VPC Flow logs
 
Service Catalog
-         https://docs.aws.amazon.com/servicecatalog/latest/adminguide/introduction.html
-         AWS Service Catalog enables organizations to create and manage catalogs of IT services that are approved for use on AWS. These IT services can include everything from virtual machine images, servers, software, and databases to complete multi-tier application architectures.
-         Catalog administrators (administrators) – Manage a catalog of products (applications and services), organizing them into portfolios and granting access to end users. Catalog administrators prepare (import) AWS CloudFormation templates, configure constraints, and manage IAM roles that are assigned to products to provide for advanced resource management.
-         End users – Receive AWS credentials from their IT department or manager and use the AWS Management Console to launch products to which they have been granted access
-         Portfolio - A portfolio is a collection of products, together with configuration information. 
-         Provisioned stack – a CloudFormation template (YAML/JSON) with a collection of resources
-         Provisioned product – a stack with resources
-         Versions - Service Catalog allows you to manage multiple versions of the products in your catalog. This allows you to add new versions of templates and associated resources based on software updates or configuration changes
-         When a new version of a product becomes available – it gets distributed to all users with access to the product, allowing the user to select the version they prefer running
-         Service Catalog does not automatically update products

No comments:

Post a Comment