Autumn is finally here, and with it comes a palette of warm colors, comfort, solace and new arrivals at Saagie! 🍂
It’s been 3 months since our last release, and Saagie has come a long way! Dive into the latest platform news with our October 2023.04 update 🍁🌟
1. Product updates (2023.04)
TLDR : To Long Didn't Read
- You can generate a job description with ChatGPT.
- You can configure your Jupyter Notebook app for use with generative AI.
- You can also configure your VS Code app for use with AI Pair Programmers.
- A new add-on named Saagie Hugging Face Model Server has been released. It helps you deploy and predict Hugging Face deep learning models for text classification.
- Another add-on named Saagie Code Search has been released too. It helps you search and retrieve Python code snippets from existing codebase.
- Display a global view of your cluster consumption with Saagie Resources Monitoring.
- The function for moving a job from one project to another has been improved.
- You can now see and follow the details of your job execution time.
- You can delete pipeline and job instances and versions.
- You can integrate your Saagie projects into a CI/CD pipeline.
- Saagie now supports Kubernetes 1.25.x.
Generating a Job Description With ChatGPT
You can use ChatGTP to generate your job description. Click Generate with ChatGPT above the description field to send your request to ChatGPT.
To enable the option, you must upgrade Saagie to the latest version. When configuring saagiectl
, you will have to answer new prompts about the use of OpenAI. This will be asked when configuring your cluster settings.
This feature is only available for Spark with a Python context, Bash, R, Sqoop, and Python job technologies.
Using Jupyter Notebook With a Generative AI
You can now use the Jupyter Notebook app with generative AI, such as ChatGPT, SageMaker, or Bedrock. A new app called JupyterLab+GenAI 4.0 Python 3.10
has been added to the Saagie official technology repository for use with a generative AI.
Using VS Code With an AI Pair Programmer
You can now use the VS Code app with AI Pair Programmers, such as GitHub Copilot and Genie. Use the VS Code Python 4.15.0
app context to have this feature.
Saagie Hugging Face Model Server Add-On
The Saagie Hugging Face Model Server add-on is an app designed to facilitate the deployment and prediction of Hugging Face deep learning models for text classification.
Saagie Code Search Add-On
The Saagie Code Search add-on is an app designed to help you search and retrieve Python code snippets from a default codebase or code repositories hosted on GitHub.
Viewing Your Cluster Resources With Saagie Resources Monitoring
Saagie Resources Monitoring (SRM) is a set of graphs providing an overview of your cluster’s resource consumption. SRM gives you a global view of RAM and CPU consumption for nodes, jobs and apps of your cluster through several graphs. It is based on Grafana. With its custom dashboard, you can quickly visualize and analyze RAM and CPU consumption in visual form.
Moving a Job to Another Project
Moving jobs from one project to another was already possible, but only between projects on the same platform. You can now move jobs from one project to another on a different platform.
From the job library or its Overview page, click the kebab menu Move to… and enter the required information. The moved job keeps its versions, instances, logs, packages, alerts, and resource settings.
This avoids you to start from scratch and improves your productivity.
Monitoring Job Execution Time
Job execution time tracking
From the Instances and Versions pages of your pipeline, you can now delete instances and versions. This allows you to streamline your list, improve your user experience, and maintain control over storage. You can either delete a single instance or version, a selection of versions or instances with or without filters.
Deleting Job Instances and Logs Based On Date Criteria
Deleting Job Instances and Logs Based On Date Criteria
The feature to delete job instances has been improved. You can now delete job instances with their logs using a date picker. From your job’s Instances page, select the All instances older than filter to delete all instances prior to the selected date.
This will streamline the list and improves your user experience.
Deleting Job Versions Based On Tag Criteria
The job version deletion feature has been improved. You can now delete versions of a job based on tag criteria. From the Versions page of your job, select the desired filter to delete versions accordingly.
This will streamline the list and improves your user experience.
Integrating Your Projects Into a CI/CD Pipeline
You can now integrate your Saagie projects into a CI/CD pipeline using our Saagie Python API. By including the source code of your jobs and pipelines in a leading Git tool like GitHub, you can enable CI/CD across all Saagie platforms, from development to production. These development best practices, such as pull changes, review, compare, or commit, can help you better control changes and thus ensure the integrity and consistency of your production environment.
Kubernetes 1.25.x Support
This new version of Saagie is compatible with Kubernetes 1.25.x !
2. User Experience Improvements
Restructuring Monitoring Modules
The Monitoring and Operations modules have been restructured.
The Monitoring module have been deleted. As a reminder, this module was composed of the Platform Overview page. This page provided you with an overview of node consumption and reservations for the selected platform.
The Operations module have been renamed Monitoring. It stays the same as before, except for the name.
3. Saagie Technology Repository Updates
The following technologies have been added to the Saagie official technology repository:
Embedded and External Job Technologies
- R: context 4.3 has been added.
Apps
- CloudBeaver: context 23.1.1 has been added.
- Jupyter Notebook:the JupyterLab+GenAI 4.0 Python 3.10 context has been added.
- RStudio: context 4.3 has been added.
- Saagie HF ModelServer TextCLF: the Saagie HF ModelServer TextCLF context has been added.
- VS Code: VS Code 4.15.0 and VS Code Python 4.15.0 contexts have been added.
Find all the latest information and platform updates in our doc!