CloudMirror replication between StorageGRID WebScale and AWS

StorageGRID Webscale 11 now supports native integration into the AWS cloud. This includes cross-region replication to AWS S3 using CloudMirror, triggering of notifications to Simple Notification Service (via SNS), as well as metadata streaming into Elasticsearch for search capability. Introduction With Amazon’s Simple Storage Service (S3) being “the internet’s hard drive”, many younger companies already … Read more

Deploying Apache Spark on Kubernetes with S3 Support

Introduction In this post we will show how to deploy a “stateless” Apache Spark cluster on Kubernetes. Spark is a fast analytics engine designed for large-scale data processing. Furthermore, we will then run analytics queries against data sitting in S3, in our case StorageGRID Webscale. We use S3 as the data source/target because it is an elegant … Read more