Google Cloud Console Generate Ssh Key Mac

14.12.2020
51 Comments

Putty is an SSH Key generator. You will use this application to generate a private/public key pair in order to encrypt the connection between your Google Cloud platform instance and FileZilla. FileZilla is the FTP Client that we will use to securely manage our Google Cloud website’s files straight from our desktop. Oct 07, 2018  When you boil it down, managing SSH keys in Active Directory can be quite the hassle. The good news is that there is a modern approach to SSH key management that is an alternative to Active Directory. Not only can this cloud directory service be a public SSH key store, but it also can be an identity provider for the cloud era.

Being new to training ML models using Google Cloud VM instances, I faced issues where my ssh connection to the cloud instance (using either the clound web-based ssh client or using cloud shell) would disconnect from time to time (for example when I power off my laptop or the network gets disconnected) which would terminate the model training process. Therefore I searched for a ssh client that can handle disconnection and can resume connection without disrupting the process running on the server and came across with Mosh mobile shell, a remote terminal app that supports roaming.

It took me a while to figure out how to set up a third party ssh terminal using the google cloud OAuth. Here's a step-by-step guide:

Update: a simpler alternative for persisting remote sessions

Since this writing, another Mosh user kindly advised me that using terminal multiplexer could achive my use case mentioned above but with much less effort, I tried and it works like a charm, thanks Jan! Here's how:

'For the use case you mentioned, it's probably more convenient to use tmux. Letitbit premium key generator online. It's a terminal multiplexer, so you can disconnect from the machine but keep your terminals open. To start it, run 'tmux'. You know you’re in tmux if you see a green status bar at the bottom. Start your ML training program like you normally would, then press ctrl+b, then d. You should see something like [detached (from session 0)]. Now you can disconnect from the machine, and your program will keep running. If you want to check back on its progress, log back in and type 'tmux attach'. Now you can detach again, close the terminal or run another command. It's very convenient.'

Prerequisite

You should have created a Google Cloud VM instance (Compute Engine) and be able to ssh into the instance using the cloud, using cloud console.

I'm using MacOS Hign Sierra, but OS version shouldn't matter much.

Enable OS login

This step allows compute GCP to generate SSH keys automatically based on Google OAuth, so we don't need to generate ssh keys manually. Alternatively we could manually setup public and private ssh keys to manage the connection (see doc), but it might break the web-based ssh connection or cloud shell access.

In my case, I've granted access for my user account marcwjj@gmail.com, which is part of the organization.

Install gcloud SDK and ssh into remote instance using gcloud command to generate public and private ssh keys

Then run the following command from mac terminal to access to cloud instance

When you connect for the first time, there will be a browser popup that asks which google account to use for authentication. Make sure to choose the same user account that was granted access in the previous OS login step. This allows the gcloud command line to generate public and private ssh keys that will be used to access the remote server.

Once connected, type exit to logoff the ssh session. You can now find the public and private ssh keys stored under ${HOME}/.ssh/

To test that the ssh keys are properly setup, run the following command from the mac terminal. Make sure to use your user account and cloud instance external IP address, in the format of youremail_gmail_com@external_ip

Install Mosh on client (your Mac) and on server (Google cloud VM instance)

Client

Download the mac package and install. After installation, test by running mosh-client in mac terminal.

Server

Remote access to server using gcloud command line

And install depending on your VM instance OS following the instructions, for Debian, run

Once installed, run mosh-server to test server installation.

Allow UDP connections on Google cloud VM instances

Mosh server-client will establish UDP connections using ports 60000 - 61000, so we need to allow these connections by configuring the firewall rules on cloud.

  • In the google cloud web console, go to VPC network -> Firewall rules settings page
  • Create a rule named allow-mosh-udp with the following settings

Connect to remote server from Mac terminal using Mosh

Finally, you should be able to connect to cloud server using Mosh roaming connections from your mac terminal, using a command such as the following: Generate ssh keys linux rsa.

Voila, now you can run your model trainings for hours on your cloud instances without worrying about any ssh disconnections, and when it's reconnected, you can get back to previous state before the disconnection, as if you are working in front of the remote server.

Generate Ssh Key Github

I hope this guide is useful for other people like me who are new to google cloud / ssh. If you have any questions or have a better way of making cloud ssh access robust and roamable, leave a comment here or shoot me an email at marcwjj@gmail.com.

Happy machine learning and Moshing!😄âx9D¤ï¸x8F

Get Plex + Sonarr + Radarr + SABnzbd automatically installed in either AWS or Google Cloud, with near-infinite (and affordable) storage.

Automated deployment using Terraform

Key

Prerequisites

  • Install Terraform from terraform.io
  • A Usenet account - NewsgroupNinja recommended
  • A Usenet indexer - NZBGeek recommended

AWS

  • Create an IAM key/secret pair, save as plexverse/auth/aws_creds.csv

Ssh Key Generator Mac

Google Cloud (BETA - SEE KNOWN ISSUES)

  • Create a Google Cloud Platform Account
  • Create a new project, taking note of the project ID
  • Get authentication JSON file:
    • Log into Google Developers Console, select your project
    • Select API Manager View, click 'Credentials' on left, then 'Create Credentials,' then finally 'Service Account Key'
    • Select 'Compute Engine default service account' in the 'Service Account' dropdown, select 'JSON' as key type

Usage

  1. git clone this repo.
  2. Enter plexverse/providers/[PROVIDER] depending on which cloud platform you'd like to deploy to.
  3. Change/populate variables in variables.tf as desired.
  4. Run terraform init then terraform plan to confirm everything is set properly.
  5. Run terraform apply to create the Plexverse stack, taking note of the <machine_ip> displayed at the end of creation.

Post-Installation

Please perform these configurations in the order listed.

Plex

  1. You need to create an SSH tunnel to access Plex for the initial set up. To do this, run ssh -i ~/.ssh/id_rsa root@<machine_ip> -L 8888:localhost:32400. You'll then need to use it by going to localhost:8888/web and manually enable remote management for Plex (v. important!).
  2. Add a Movies library in Plex and point it to /plexmedia/Movies
  3. Add a TV Shows libarary in Plex and point it to /plexmedia/TV Shows

SABnzbd

  1. Go to http://<machine_ip>/sabnzbd and complete the intial set up (including adding your Usenet server credentials), taking note to create a username and password for security purposes.
  2. Go to SABnzbd config and take note of the 'API Key.' You'll need to enter this in both Sonarr and Radarr in the next steps.

Sonarr

Generate Ssh Key Putty

  1. Go to http://<machine_ip>/sonarr then to 'Settings.'
  2. On the 'Media Management' tab, change 'Rename Episodes' to 'Yes.'
  3. On the 'Indexers' tab, add your preferred Usenet indexer settings and API key.
  4. On the 'Download Client' tab, add 'SABnzbd' with the username/password and API key you received from the 'SABnzbd' step of configuration above.
  5. On the 'General' tab, change 'Authentication' to 'Basic (Browser popup)' and enter a username and password. Click 'Save.'
  6. Go to the 'System' icon and restart Sonarr using the restart icon in the upper right corner of the frame.
  7. Add your first TV series to Sonar. Under 'Path,' click 'Add a different path' and browse to select /plexmedia/TV Shows. This will now be the default for future shows you add.
  8. Click the plus sign to add the show, then visit the page for the show you just added in Sonarr, and click the magnifying glass, either for the whole series or a specific show/season, to trigger searching, downloading, and processing.

Radarr

Generate Ssh Key Aix

  1. Go to http://<machine_ip>/radarr then to 'Settings.'
  2. Everything else is the same as with Sonarr (above), except make sure to add the path for downloaded movies as /plexmedia/Movies!

Update Cloud Key Ssh

Todo

  • Automate post-installation steps
  • Include domain name support with automatic SSL certificate creation from Let's Encrypt
Google

Known Issues

  • Some kind of race condition exists in whereby apt-get update sometimes doesn't finish before apt-get install aptdcon is triggered, causing the installation to fail entirely.
  • Google Cloud support is very close but still experiencing errors during initial setup. However, once these errors occur, exiting out of the terraform shell with ctrl+c and re-running terraform apply seems to make this depoyment successful.
  • Any help with these would be greatly appreciated!

Google Cloud Console Generate Ssh Key Mac Pro

Services

Mac Generate Ssh Key

  • Plex (Media) - if remote management enabled, access at http://<machine_ip>:32400/web

  • Sonarr (TV) - http://<machine_ip>/sonarr

  • Radarr (Movies) - http://<machine_ip>/radarr

  • SABnzbd (Downloader) - http://<machine_ip>/sabnzbd