Photo by Christopher Burns on Unsplash

Simplify integration of S3 storage with local resources

Access Portal

Article from ADMIN 50/2019

By Thomas Drilling

The AWS hybrid storage service, known as the Storage Gateway, provides local applications with a seamless connection to Amazon S3 storage. We explain the different gateway types and guide you through their setup.

At Amazon Web Services (AWS), the hybrid idea is by no means limited to allowing companies to extend the scope of their corporate network securely to the AWS Virtual Private Cloud with the help of various managed virtual private network (VPN) services or by way of AWS Direct Connect. The hybrid approach is hiding around almost every corner. The goal of AWS Storage Gateway is to provide local applications transparent access to the most important AWS storage service by far: Simple Storage Service (S3). AWS Storage Gateway extends existing enterprise environments with native integration into AWS services.

S3 Role

S3 is the oldest and most important cloud service. It existed long before the official launch of AWS in 2006. S3 is important to AWS as an object store, because the entire AWS service portfolio is multitiered, with higher level managed platform services built on the base of AWS infrastructure and foundation services, each of which needs to store data and states in some way.

Despite third-party solutions such as the S3 browser, S3 is primarily designed for direct queries, which means that AWS users can use S3 to perform advanced queries on stored data without extracting, transforming, or loading the data onto a separate analysis platform. Direct querying of data in S3 increases performance and keeps costs low for analysis applications that use S3 as a data pool. S3 has several direct query options, including the new S3 Select, Amazon Athena, or Amazon Redshift Spectrum.

With S3 Select and AWS Lambda, you can even create serverless apps that use direct processing of S3 Select. Amazon Athena, on the other hand, is an interactive query service designed to simplify analysis of the data in S3 with the use of standard SQL queries. Athena is also serverless, so customers do not need to set up and manage an infrastructure. Nevertheless, it is often inconvenient to allow on-premises

...

Use Express-Checkout link below to read the full article (PDF).