AI tools for DevOps workflows

Snyk

Purpose:

Snyk is a security tool that helps developers find and fix security issues in their code and its dependencies, especially in open-source libraries, containers, and cloud infrastructure. It scans your code for vulnerabilities and helps you fix them before they become serious security threats.

How It Works:

  • Vulnerability Scanning for Open-Source Libraries: Snyk checks your project’s dependencies (like open-source libraries) for known security risks and warns you if any vulnerabilities are found.
  • Container Security: It scans Docker containers and Kubernetes configurations to ensure your containerized applications are secure.
  • Cloud Security Checks: Snyk also scans your cloud setup (like AWS, GCP, or Azure) for security issues and misconfigurations, helping to prevent breaches.
  • Automatic Fixes: Snyk not only finds security issues but also suggests and automates fixes, such as upgrading libraries or applying patches, so you can secure your code quickly.

Where Snyk Can Be Used:

  • Docker: Snyk can scan Docker images to make sure your containers are secure and free from vulnerabilities.

Resources:

AWS CodeGuru

Purpose:

AWS CodeGuru is a smart tool that automatically reviews your code to find problems like bugs, security issues, and areas for improvement. It helps developers write better, faster, and safer code by suggesting fixes and optimizations.

How It Works:

  • Finds Bugs: It scans your code to spot potential bugs or errors, helping you catch issues before they cause problems.
  • Identifies Security Risks: It checks your code for security vulnerabilities and gives advice on how to fix them, keeping your software safe.
  • Improves Performance: CodeGuru looks at your code’s performance and suggests ways to make it run faster and use fewer resources.
  • Checks Test Coverage: It checks if your code has enough tests to make sure it works as expected and suggests adding more tests if needed.

Where AWS CodeGuru Can Be Used:

  • GitHub/Bitbucket/CodeCommit: Connect CodeGuru with GitHub or Bitbucket to review code whenever a pull request is made.

Resources:

CloudHealth by VMware

Objective:

CloudHealth is a cloud management platform that leverages AI to optimize cloud costs, manage cloud resources effectively, and ensure compliance with security standards. It helps organizations monitor their cloud usage, identify opportunities for cost savings, and automate scaling decisions to maintain efficient cloud resource utilization.

How It Works:

  • Cost Optimization: CloudHealth analyzes cloud resource usage and provides recommendations to optimize costs, such as resizing instances, choosing reserved instances, or eliminating underutilized resources.
  • Resource Management: CloudHealth provides insights into resource allocation across cloud environments, helping organizations ensure that resources are utilized efficiently and scaled appropriately.
  • Security Compliance: CloudHealth monitors cloud infrastructure for security misconfigurations and compliance issues (e.g., in AWS, Azure, GCP), ensuring that your cloud environment adheres to industry standards and best practices.
  • Rightsizing and Reserved Instance Recommendations: It provides suggestions on which cloud resources (e.g., EC2 instances, databases) can be optimized for cost efficiency, and when to switch to reserved instances for predictable workloads.

Where CloudHealth Can Be Used:

  • AWS, Azure, GCP: CloudHealth integrates with these major cloud providers to provide a unified view of your cloud infrastructure, optimizing costs and ensuring compliance across multiple clouds.

Resources:

DataDog

Objective:

Integrating Datadog with Kubernetes offers comprehensive monitoring and observability, providing real-time insights into containerized applications and infrastructure. This integration enables teams to detect performance issues early, optimize resources, and ensure the reliability of applications in dynamic environments.

How It Works:

  1. Data Collection: Datadog collects metrics, logs, and traces from Kubernetes clusters, including data on node performance, pod health, and container resource usage.
  2. Data Aggregation: All metrics are aggregated in a single dashboard, allowing teams to track application health and infrastructure metrics in one place.
  3. Analysis and Alerts: Datadog analyzes collected data to provide insights into performance trends and detects anomalies. Configurable alerts notify teams of issues before they affect users.
  4. Visualization and Reporting: Datadog’s customizable dashboards and reports visualize key metrics, allowing teams to understand and act on data patterns over time.

Where DataDog Can Be Used:

  • Cloud-Native Applications: Ideal for monitoring distributed, containerized applications running on Kubernetes.
  • Production Environments: Supports high-stakes environments where early detection of issues is critical to maintaining uptime and performance.
  • Resource Optimization: Useful in environments requiring optimized resource usage to reduce costs and increase efficiency, such as multi-cloud or hybrid cloud setups.
  • Compliance and Security Monitoring: In industries like finance or healthcare, where maintaining security and compliance is essential, Datadog helps monitor and manage infrastructure against policy violations or anomalies.

Resources:

PagerDuty

Objective:

PagerDuty is an incident management platform that provides real-time notifications, automated escalation, and intelligent alerting for DevOps teams. It helps teams respond quickly to incidents, track issues, and reduce downtime by ensuring that the right people are notified at the right time.

How It Works:

  • Incident Management: PagerDuty creates, tracks, and resolves incidents in real-time, sending alerts to the appropriate team members when something goes wrong in your application or infrastructure.
  • AIOps and Automated Alerting: Using artificial intelligence, PagerDuty can automatically prioritize and group alerts, reducing noise and enabling teams to focus on the most critical issues first.
  • Escalation Policies: PagerDuty allows you to define escalation policies to ensure that if an incident is not resolved by the first responder, it is automatically escalated to the next tier of support.
  • On-Call Management: PagerDuty helps manage on-call schedules and provides automated rotation, ensuring that team members are not overloaded and can address incidents promptly.

Where PagerDuty Can Be Used:

  • Prometheus, Grafana: PagerDuty integrates with monitoring tools to automatically create incidents based on infrastructure alerts or application performance issues.

Resources:

KEDA (Kubernetes Event-Driven Autoscaling)

Purpose:

KEDA is a tool that helps Kubernetes automatically scale applications based on incoming events, such as messages in a queue or changes in a database. It allows your applications to scale up when there’s high demand and scale down when demand decreases, making your system more efficient and cost-effective.

How It Works:

  • Event-Driven Autoscaling: KEDA monitors external events (like messages in a message queue or metrics from an external system) and automatically scales Kubernetes workloads up or down based on those events. For example, if a message queue grows, KEDA can scale up your application to process those messages.
  • Support for Multiple Event Sources: KEDA integrates with various event sources, such as Azure Event Hubs, RabbitMQ, Kafka, AWS SQS, and more. It allows Kubernetes clusters to scale based on the activity of these systems.
  • Custom Metrics Support: KEDA can scale based on custom metrics, giving you flexibility to define scaling criteria beyond just CPU or memory usage. For instance, you can scale based on the number of requests, database size, or any custom metric.
  • Resource Efficiency: KEDA helps optimize resource usage by ensuring that your applications only run at the required scale, avoiding unnecessary resource consumption during low-demand periods.

Where KEDA Can Be Used:

  • Kubernetes: KEDA is designed to work with Kubernetes and is installed as a Kubernetes operator. It enables Kubernetes to scale workloads based on event-driven triggers.
  • Azure: KEDA is closely integrated with Azure services, such as Azure Event Hubs, Azure Storage Queues, and Azure Service Bus, making it ideal for scaling applications in Azure Kubernetes Service (AKS).
  • AWS: KEDA can be used with AWS services like Amazon SQS, AWS Lambda, and DynamoDB to trigger scaling actions based on events in AWS cloud environments.
  • Google Cloud: KEDA works with Google Cloud’s Pub/Sub, Cloud Storage, and other GCP services to provide event-driven scaling for workloads running on Google Kubernetes Engine (GKE).

Resources:

1. AI Tools for DevOps Engineers

Warp Terminal: A Next-Gen Tool for DevOps Engineers

Purpose:

At its core, Warp is a modern terminal designed to be faster, more intuitive, and more collaborative than traditional terminals like the classic command-line interface (CLI) or tools like iTerm and Hyper. Warp aims to make the command-line experience less daunting, especially for DevOps engineers who spend a lot of time using it for tasks like automating infrastructure, managing servers, and debugging issues.

Warp isn’t just another terminal—it’s built from the ground up to give users a more productive environment. With features like autocompletion, command history search, and visual feedback, Warp makes the command line feel more like a powerful IDE (Integrated Development Environment) than a standard terminal.

Why Warp Terminal is Essential for DevOps Engineers

  • Enhanced Efficiency
  • Simplified Troubleshooting
  • Streamlined Collaboration
  • Reduced Onboarding Time for New Team Members
  • Improved Organization and Workflow

Download

Resources:

2. Pieces for Developers: Your Essential DevOps Toolbox

Purpose:

Pieces for Developers is a powerful tool that simplifies how DevOps teams and developers store, manage, and share their work. It lets you keep code snippets, troubleshooting steps, onboarding guides, and configuration details all in one place, making it easy to find what you need when you need it.

Why Pieces for Developers is Essential for DevOps Engineers

  1. Centralized Knowledge Hub: Keeps all your critical DevOps resources (like scripts and setup instructions) organized in one app, so you spend less time searching.
  2. Automates Routine Tasks: Store frequently used commands and workflows, reducing repetitive work.
  3. Easy Collaboration: Makes it simple for your whole team to access and share essential resources, keeping everyone up-to-date.

Resources

3. Run Powerful AI Models Locally with Ollama & OpenWebUI

Purpose:

Ollama and OpenWebUI allow DevOps engineers to run AI models like Llama 3.2 directly on their local machines, providing an alternative to relying on cloud-based services. This setup ensures that all your data stays private and secure while still providing access to a powerful AI language model—perfect for handling tasks like documentation, troubleshooting, script generation, and infrastructure management.

Benefits for DevOps Engineers:

  • Full Control Over Your Data:

    By running Llama models locally, you ensure that no data is sent to third-party companies, keeping your information secure. Ideal for handling sensitive infrastructure and system data.

  • Free Access to Paid Versions:

    Using Docker containers, you can access Llama 3.2—a premium AI model—completely free of charge, eliminating the need for cloud services or subscriptions.

  • Boost Your Productivity:

    Automate documentation, troubleshoot faster, and generate scripts or infrastructure-as-code (IaC) templates for Terraform, Kubernetes, and more with ease.

  • Privacy-First AI:

    Perfect for DevOps engineers concerned with privacy. Run AI-powered tools on your own machine without the risk of sharing private data with cloud providers.

Use Cases for DevOps Engineers:

  • Automate Infrastructure Tasks: Generate Terraform scripts or Kubernetes manifests easily.
  • Quick Troubleshooting: Resolve system performance or application issues faster with AI-assisted guidance.
  • Automate Code Reviews: Ensure your scripts follow best practices and internal guidelines with AI-powered code review suggestions.

Run these tools locally and unlock the full potential of Llama 3.2 in your DevOps workflow—all without sharing private data with any external services.

Resources

Integrating Ollama with the Continue Extension in VSCode or VSCodium: A Simple Guide for Developers

Introduction

When you’re coding, having the right tools can make all the difference. Integrated Development Environments (IDEs) like Visual Studio Code (VSCode) or VSCodium are designed to streamline the coding process. These tools help developers by combining things like code editors, debuggers, and compilers into one place. But what if you could make these tools even smarter?

That’s where Large Language Models (LLMs), like Ollama and the Continue extension, come in. They bring AI-powered features to your IDE, helping you generate code, find errors, and even suggest improvements, all in real-time.

In this blog post, we’ll walk you through how to set up Ollama (a tool that lets you run LLMs locally) with the Continue extension in VSCode or VSCodium. Let’s get started!

What is VSCode?

Visual Studio Code (VSCode) is one of the most popular code editors in the world. Developed by Microsoft, it’s an open-source tool that helps developers write and debug their code efficiently. VSCode is packed with powerful features like:

  • IntelliSense: This helps with auto-completion and quick suggestions as you type.
  • Debugging: You can find and fix bugs in your code without leaving the editor.
  • Extensions: VSCode supports a wide range of extensions that add even more functionality.

VSCode is widely used because it’s free and supports almost every programming language.

What is VSCodium?

If you’re concerned about privacy, you might prefer VSCodium. It’s a version of VSCode that’s completely free of telemetry (tracking your usage). The codebase of VSCodium is exactly the same as VSCode, but it doesn’t collect any data about your usage. If you care about privacy but want to use VSCode’s features, VSCodium is a great choice.

What is Ollama?

Ollama is a tool that allows you to run Large Language Models (LLMs) on your local computer. These LLMs, like Mistral and Llama 2, are powerful AI models that can understand and generate human-like text. With Ollama, you can easily integrate these models into your development tools.

Imagine having a personal assistant that can help you with code generation, answer your coding questions, and even help you debug. Ollama makes this possible by running models like Mistral on your own computer, so everything stays private and secure.

What is the Continue Extension?

Continue is an extension for VSCode (and also works with JetBrains IDEs) that brings AI-powered help right into your editor. It allows developers to interact with Large Language Models (LLMs) directly in the IDE. With Continue, you can:

  • Ask questions about your code.
  • Get suggestions for improving your code.
  • Generate entire files from scratch.
  • Refactor code with just a few commands.

The best part? You can run it on your local machine using Ollama and still get all the benefits of AI without sending any of your data to the cloud.

How to Set Up Ollama with Continue in VSCode or VSCodium

Now that you know what all these tools do, let’s walk through the steps to get everything working together. Here’s how you can set up Ollama with Continue in VSCode or VSCodium.

Step 1: Install VSCode or VSCodium

  1. VSCode: Download VSCode and install it on your machine. It’s free and works on all major operating systems like Windows, macOS, and Linux.
  2. VSCodium: If you prefer a privacy-friendly version, you can download VSCodium, which is exactly like VSCode but without telemetry.

Step 2: Install the Continue Extension

  1. Open VSCode or VSCodium.
  2. Go to the Extensions marketplace by clicking on the Extensions icon on the sidebar (it looks like a square with four smaller squares inside).
  3. In the search bar, type “Continue” and look for the extension by the author Continue.
  4. Click Install to add the extension to your editor.

Step 3: Install and Set Up Ollama

To use Ollama locally, you’ll need to install it and run it on your machine. Ollama helps you run LLMs like Mistral on your local system, ensuring everything stays private.

  1. Download Ollama: Visit Ollama’s website and download the application for your operating system.
  2. Run Ollama Locally: Once installed, launch Ollama on your machine. This will allow your IDE to interact with local LLMs.

Step 4: Connect Continue to Ollama

  1. Open VSCode or VSCodium and click on the Continue extension icon in the sidebar.

  2. Click on the Settings icon (bottom-right corner) to configure Continue.

  3. Add the Ollama configuration in the settings. Here’s an example of what the configuration might look like:

"models": [
	  {
	    "title": "Mistral",
	    "provider": "ollama",
	    "model": "mistral:latest",
	    "apiBase": ""
	  }
	]
  1. Save the settings.

Step 5: Test Everything

To test that everything is set up correctly:

  1. Open a sample file, like the continue_tutorial.py file that comes with the Continue extension.
  2. Highlight some code and ask Continue to explain it or even refactor it for you.
  3. You should now see Mistral (the LLM) helping you with code suggestions and explanations!

Wrapping Up

Now you’ve successfully set up Ollama with Continue in VSCode or VSCodium! This integration brings the power of AI to your development environment, allowing you to:

  • Get AI-powered suggestions for your code.
  • Refactor code easily using the Continue extension.
  • Keep everything private, with Ollama running everything locally on your machine.

By using these tools, you’ll make your coding workflow faster, more efficient, and smarter. And the best part is, you don’t have to worry about privacy because everything stays on your computer!

Final Thoughts

Integrating AI into your development tools can feel like a game-changer. Whether you’re just starting out or have been coding for years, tools like VSCode, VSCodium, Ollama, and Continue can help you work smarter, not harder. Give it a try and let us know how it boosts your productivity!

I hope this helps you get started with Ollama and Continue. If you have any questions or need more tips, feel free to reach out!

✦ iemafzalhassan

© 2025 All Rights Reserved.

Made with 🖤

LinkedIn 𝕏 GitHub