Skip to content

Linux

Instructions for installing Jan on Linux.

System requirements:

  • Debian
  • Ubuntu and derivatives:
    • Ubuntu Desktop LTS (official)/Ubuntu Server LTS (only for server)
    • Edubuntu
    • Kubuntu
    • Lubuntu
    • Ubuntu Budgie
    • Ubuntu Cinnamon
    • Ubuntu Kylin
    • Ubuntu MATE
    • Linux Mint
    • Pop!_OS
  • RHEL-based (Server only)
  • Fedora
  • Arch Linux
  • SteamOS
  • openSUSE

Installation steps:

Available releases:

Stable release:

Installation commands:

Terminal window
sudo dpkg -i jan-linux-amd64-{version}.deb
Terminal window
sudo apt-get install ./jan-linux-amd64-{version}.deb

Default locations:

Terminal window
# Custom installation directory
$XDG_CONFIG_HOME = /home/username/custom_config
# or
# Default installation directory
~/.config/Jan/data

See Jan Data Folder for details.

Configuration for GPU support:

    Step 1: Verify Hardware & Install Dependencies

    Section titled “Step 1: Verify Hardware & Install Dependencies”

    1.1. Check GPU Detection

    Terminal window
    lspci | grep -i nvidia

    1.2. Install Required components

    NVIDIA Driver:

    1. Install the NVIDIA Driver, ideally via your package manager.
    2. Verify:
    Terminal window
    nvidia-smi

    CUDA Toolkit:

    1. Install the CUDA toolkit, ideally from your package manager (11.7+)
    2. Verify:
    Terminal window
    nvcc --version

    Additional Requirements:

    Terminal window
    sudo apt update
    sudo apt install gcc-11 g++-11 cpp-11
    export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/lib64

    Documentation

    1. Navigate to Settings > Local Engine > Llama.cpp
    2. Select appropriate backend in llama-cpp Backend. Details in our guide.

Removal commands:

Terminal window
sudo apt-get remove jan
rm -rf Jan
rm -rf ~/.config/Jan/data
rm -rf ~/.config/Jan/cache