Blog¶

How to Run Your Own Local AI with Ollama on Windows

Running AI models locally gives you full control over your data and eliminates dependency on cloud services. Ollama is a great service to serve and inference AI models locally, providing super fast speeds. In this guide, we'll set up Ollama with Open WebUI using Docker on Windows with WSL2.

Prerequisites

Before we begin, you'll need:

• Windows 10/11 with WSL2 support
• NVIDIA GPU (recommended for better performance)
• Basic familiarity with command line

Hardware Requirements

When choosing which model to run, consider your hardware:

How to Enable SSH Commands in Windows

After the 1809 update, Windows has been offering its users native SSH tools such as a pre-installed SSH client and an optional SSH server. This mean that in Windows 11, you do not need any third-party software to access your computer or server remotely.

Step 1: Enable SSH client:

1. Open "Settings" > "Apps" > "Optional Features" and check if the OpenSSH client is installed - if needed, install it via "Add optional feature"

2. Open command prompt as administrator with Windows search > "cmd.exe" > "Run as administrator"

3. Enter CMD command: ssh

4. Connect to the desired server with ssh name@server

Setting up SSH-Agent in Windows for Passwordless Git Authentication

SSH-Agent and OpenSSH are tools in Windows that can be used to authenticate to remote Git repositories, such as GitLab and GitHub. Once set up as a service that stores your various SSH keys, this can facilitate authentication without entering a password each time, removing the irritation of entering a password every time you wish to push/pull/etc. from a Git repository.

How to Install the SSH-Agent Service in Windows

Using an elevated PowerShell window (run as admin), execute the following command to install the SSH-Agent service and configure it to start automatically when you log into your machine:

Get-Service ssh-agent | Set-Service -StartupType Automatic -PassThru | Start-Service

To avoid needing to restart your system to get the service running for the first time, execute this command:

start-ssh-agent.cmd

Setting up an SSH Key Pair to Access a Git Remote Provider

Using a command line tool such as Windows PowerShell you should able to generate the SSH key pair.

ssh-keygen -t ed25519 -C "denizraifdurmaz@gmail.com"

NuGet Package Signing

To generate a certificate for NuGet package signing using OpenSSL, you need to create a code-signing certificate. This certificate will be used to sign your NuGet packages, ensuring their authenticity and integrity.

Below is a step-by-step guide to generate a self-signed certificate using OpenSSL. If you need a certificate from a trusted Certificate Authority (CA), you can use the same process to generate a Certificate Signing Request (CSR) and submit it to a CA.

Step 1: Install OpenSSL

Ensure OpenSSL is installed on your system. You can download it from OpenSSL's official website or install it via a package manager:

choco install openssl

sudo apt-get install openssl

brew install openssl

Step 2: Generate a Private Key

Use OpenSSL to generate a private key. This key will be used to sign your certificate.

```bash
openssl genpkey -algorithm RSA -out private.key -aes256
```

Step-by-Step Guide to Publishing GitLab Pages at a IONOS Domain Provider

Adding a custom domain to GitLab Pages involves two main steps:

1. Adding the Custom Domain in GitLab.

2. Verifying the Domain Ownership.

Let me walk you through the process in detail.

Step 1: Adding a Custom Domain to GitLab Pages

1. Go to Your Project in GitLab:

   • Navigate to your project where GitLab Pages is set up.

2. Access Pages Settings:

   • Go to Settings > Pages in the left-hand menu.

3. Add a New Domain:

   • Under the Domains section, click New Domain.
   • Enter your custom domain (e.g., gridlab.io or docs.gridlab.io).
   • Click Create New Domain.

Using the MkDocs Blog Plugin

Step 1: Install the MkDocs Blog Plugin

1. Install the plugin using pip:

   pip install mkdocs-blog-plugin
   

2. Add the plugin to your mkdocs.yml configuration file:

   - blog
   

Step 2: Configure the Blog Plugin

Update your mkdocs.yml to configure the blog plugin. Here’s an example configuration:

  - blog:
      # Optional: Specify the directory for blog posts (default is "blog")
      blog_dir: blog
      # Optional: Enable pagination
      pagination: true
      # Optional: Number of posts per page
      posts_per_page: 5
      # Optional: Enable tags
      tags: true
      # Optional: Enable categories
      categories: true