Google Cloud: Interacting with Terraform Modules and Working with Terraform Registry
Overview As you manage your infrastructure with Terraform, increasingly complex configurations will be created. There is no intrinsic limit to the complexity of a single Terraform configuration file or directory, so it is possible to continue writing and updating your configuration files in a single directory. However, if you do, you may encounter one or […]
Google Cloud: Creating Dataproc Cluster Using Google Cloud and Running a Pyspark Job
Description This hands-on lab introduces how to use Google Cloud Storage as the primary input and output location for Dataproc cluster jobs. Leveraging GCS over the Hadoop Distributed File System (HDFS) allows us to treat clusters as ephemeral entities, so we can delete clusters that are no longer in use, while still preserving our data. […]
Google Cloud: Granting Access to Google Cloud Storage Objects with Signed URLs
Description Signed URLs are URLs with query string authentication parameters that grant access to buckets and objects stored in Google Cloud Storage. Signed URLs grants access to Cloud Storage for a given amount of time. Anyone with the signed URL can access the objects until the signed URL expires. This is particularly useful for granting […]
Google Cloud: Migrate a MySQL Database to Google Cloud SQL By Creating a Database Dump
Lab Topic: Create a Google Cloud SQL instance and create a database Import a MySQL database into Cloud SQL Reconfigure an application to use Cloud SQL instead of a local MySQL database Lab Scenario Your WordPress blog is running on a server that is no longer suitable. As the first part of a complete migration […]
Google Cloud: Understanding Service Accounts and Scopes on Google Compute Engine
Introduction In this hands-on lab, we are going to demonstrate working with legacy scopes using the default Compute Engine service account on Google Compute Engine. Solution Begin by logging in to the GCP Console in an incognito (or other private browser window). Right click on the Chrome Browser and choose New Incognito Window. Copy/paste the bucket ID we will […]
Google Cloud: GCS FUSE — Mounting Cloud Storage buckets as Filesystem on Linux
Introduction Cloud Storage FUSE is an open source FUSEadapter that allows you to mount Cloud Storage buckets as file systems on Linux or macOS systems. It also provides a way for applications to upload and download Cloud Storage objects using standard file system semantics. Cloud Storage FUSE can be run anywhere with connectivity to Cloud Storage, including Google Compute […]
Google Cloud: Python Integration — Working with Storage Bucket and Jupyter Notebook
Introduction In this article, we will be learning how to use the Python Library for Google Cloud. We will be using Python Library for Google Cloud Storage and few lines of python code to upload a sample image file in our storage bucket. Feel free to use any type of file for the upload. We will […]
Google Cloud: Cloud Storage Bucket — Giving Roles and Permissions to an object
What is Cloud Storage Bucket? Google Cloud Storage is an object-based service that allows you to store objects in any file format. An Object can be any individual file or folder whereas a bucket is referred to as a container or object-based drive or a root folder where you store your objects. Cloud Storage can […]
Google Cloud: Introduction To Cloud Filestore
Cloud Filestore is a managed file storage service for applications that require a filesystem interface and a shared filesystem for data. Filestore gives users a simple, native experience for standing up managed Network Attached Storage (NAS) with their Compute Engine and Google Kubernetes Engine instances. The ability to fine-tune Filestore’s performance and capacity independently leads […]
Google Cloud: Snapshots — Working with backups of Persistent Disk of VM
What is a Persistent Disk? Compute Engine provides several different types of storage options that you can choose while creating an Instance. Persistent disks are durable network storage devices available for your instances, and You can access it like a physical disk on a desktop. Persistent disks can be created independently from your Compute Engine (VM) instances […]