How to Create a Jupyter Notebook Instance Using Vertex AI Workbench

How to Create a Jupyter Notebook Instance Using vertex ai wordbench
Google Cloud

Share Post Now :

HOW TO GET HIGH PAYING JOBS IN AWS CLOUD

Even as a beginner with NO Experience Coding Language

Explore Free course Now

Table of Contents

Loading

Vertex AI Workbench is a powerful integrated environment on Google Cloud that provides tools for data scientists and machine learning engineers to build, train, and deploy machine learning models at scale. One of the most popular features of Vertex AI is the ability to create and manage Jupyter notebooks, which are widely used for exploratory data analysis, model development, and testing in machine learning workflows. This blog walks you through the process of creating a Jupyter Notebook instance using Vertex AI Workbench.

Table of Contents

  1. What is Vertex AI?
  2. What is Workbench in Vertex AI
  3. Prerequisites
  4. Creating a Vertex AI Workbench Notebook
  5. Cleanup Resources
  6. Conclusion
  7. Frequently asked question

What is Vertex AI?

Vertex AI is Google Cloud’s unified machine learning platform that enables users to build, train, and deploy ML models at scale. It integrates a variety of tools and services, including:

  • Data preprocessing and transformation
  • Model training (custom and AutoML)
  • Model evaluation
  • Model deployment

This streamlined platform helps data scientists and ML engineers to work efficiently while maintaining MLOps best practices.

What is Workbench in Vertex AI

Vertex AI Workbench is a managed Jupyter Notebook environment designed to simplify data science workflows by providing:

  • Pre-installed ML libraries (e.g., TensorFlow, PyTorch, sci-kit-learn).
  • Seamless integration with GCP services like BigQuery, Cloud Storage, and Vertex AI Pipelines.
  • Access to scalable infrastructure for training large models.
  • Built-in MLOps tools to monitor and manage your ML lifecycle.

Prerequisites

Before you begin, make sure you have the following:

  1. Google Cloud Account
  2. Billing Account

Creating a Vertex AI Workbench Notebook

  1. Navigate to Compute Engine and select Enable if it isn’t already enabled. You’ll need this to create your notebook instance
    Compute engine API
  2. Enable Vertex AI API:
    In the Cloud Console, navigate to API & Services > Library.
    Search for Vertex AI API and enable it.
    Vertex AI API
  3. In the GCP console, search for Vertex AI in the search box and click on Vertex AI
    In the GCP console, search for Vertex AI in the search box and click on Vertex AI
  4. From the Vertex AI section of your Cloud Console, click on Workbench:
    From the Vertex AI section of your Cloud Console, click on Workbench:
  5. Enable Notebook API
    Enable Notebook API
  6. From there, within Instances, click Create New:
    From there, within Instances, click Create New:
  7. Change the name of the instance and the machine type:Name: gcp_aimlMachine type: e2-standard-2 (2 vCPU, 1 core, 8 GB memory)
  8. Note: Under Machine type, we can even select the ideal time of shutdown of our instance notebook. We are selecting 3 hours. The instance will be automatically shutdown if not being used for 3 hours
  9. Then leave everything else as default & click Create.
  10. Once the instance has been created, select Open JupyterLab:
  11. Once you open the notebook you will see the interface below:

    From the displayed options you can select any of them as per your needs and requirements.Congratulations! We have successfully created a Jupyter Notebook instance using Vertex AI Workbench.

Cleanup Resources

Stop/Delete the Jupyter Notebook

  1. We will need this Notebook for our next labs, If you want to keep the jupyter notebook instance, then please Stop it:
  2. If you  don’t want to keep the jupyter notebook instance for the next labs & create a new one at the time you do the labs, then please Delete it:

Conclusion

Vertex AI Workbench simplifies the process of creating and managing Jupyter Notebooks in the cloud, allowing data scientists and machine learning engineers to focus more on model development and experimentation rather than managing infrastructure. By following the steps outlined in this blog, you should be able to set up a fully functional Jupyter notebook instance on Vertex AI and start leveraging the power of Google Cloud for your ML projects.

Frequently asked questions

What is the cost of using Vertex AI Workbench?

The cost depends on the machine type and the duration of usage. For example, an e2-standard-2 instance costs approximately $0.102 per hour. Refer to the Vertex AI Pricing Guide for detailed information.

Can I use custom libraries in Vertex AI Workbench?

Yes, you can install custom libraries in your Jupyter Notebook using pip install or conda install

How do I access data from BigQuery in my notebook?

You can use the google-cloud-bigquery library to access and query data from BigQuery directly within your Jupyter Notebook.

Related References

Next Task For You

Don’t miss our Exclusive Free Training on Mastering Google AI/ML and Generative AI. Gain expertise in advanced AI and Machine Learning technologies using Google’s powerful tools. Join a thriving community of learners and take the next step in advancing your career. Click the image below to reserve your spot!

GCP AIML Content Upgrade

Picture of mike

mike

I started my IT career in 2000 as an Oracle DBA/Apps DBA. The first few years were tough (<$100/month), with very little growth. In 2004, I moved to the UK. After working really hard, I landed a job that paid me £2700 per month. In February 2005, I saw a job that was £450 per day, which was nearly 4 times of my then salary.