Questions tagged [k3s]
The k3s tag has no usage guidance.
55
questions
7
votes
3
answers
17k
views
Can I run a single-node K3S cluster?
I am aware of the consequences and issues with running a single-node cluster. However, I'm still curious if it's possible. I plan on setting everything up myself.
In other words, can I run the control ...
3
votes
1
answer
1k
views
Forward real requestor IP in K3S NGINX ingress
I've set up a K3S Kubernetes Environment in my private Home-Lab on Raspberry PIs in order to teach myself some Kubernetes (Noob-Alert), using NGINX as Ingress Controller and I'm kind of stuck at ...
- 31
3
votes
0
answers
874
views
k3s without HA: how to switch master node?
Rancher documentation on k3s is quite nice and its HA support (both with external DB or embedded etcd) look nice, but I don't want/need an HA setup.
In case my master node fails, I don't mind having ...
- 123
2
votes
3
answers
2k
views
How to delete all namespaces except the kube-system in K3s cluster
I have a K3s cluster with system pods (i.e. kube-system namespace) and my application pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-...
- 265
2
votes
1
answer
7k
views
In k3s, how can I promote a worker node to a master node?
I currently have a Raspberry Pi-based Kubernetes cluster based on k3s which, while originally a single-master cluster, has now grown to the point at which it is practical to have multiple (odd-number) ...
- 174
2
votes
1
answer
14k
views
How can I restart or reset the K3s cluster pods
I have a k3s (v1.21.1+k3s1) cluster with following pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-xxxxxx
kube-system pod/metrics-...
- 265
2
votes
2
answers
6k
views
How can I delete manually calicoctl and iptables created by calico from my k3s setup
I have a K3s setup with calico pods [calico-node- & calico-kube-controllers-] running. On uninstalling K3s, calico pods get deleted but I see that calicoctl and iptables -S commands still running ...
- 265
2
votes
1
answer
757
views
Schedule pod on a node and access pv on another node
I'm running a k3s cluster on RPi4, with heterogenous config (a node has a high capacity but slow hdd, another has a ssd drive, a third only has a sd card).
I have persistent volumes & claims of ...
- 123
2
votes
1
answer
62
views
k3s - select ingress nodes with default traefik
I have a k3s cluster with
1 master + 2 nodes
default traefik as ingress
Traefik is running on the master node.
Is there a way to label nodes / change manifest so that traefik runs on the nodes ...
- 521
1
vote
1
answer
9k
views
Getting 401 Unauthorized while trying to pull images from local docker registry (harbor) from k3s
Due to work I need to self-host a local docker proxy cache using Harbor. So i wen to their doc and I installed the server and configured it properly, accesing it via FQDN and using a self-signed ...
- 121
1
vote
1
answer
3k
views
Kubernetes pods can ping external IPs but not any domain
I have a Kubernetes cluster using the Antrea CNI.
The problem is that I can't curl any domain names.
I can do nslookup inside the pod and get the IP of any domain, but I can't directly curl the domain....
- 495
1
vote
1
answer
4k
views
Kubernetes failing to start: failed to build map of initial containers
Starting today, k3s is failing to start with the following error: "Failed to start ContainerManager" err="failed to build map of initial containers from runtime: no PodsandBox found ...
- 31
1
vote
1
answer
450
views
Ansible shell module fails to find kubectl
Running the command from the CLI on the server works perfect, but from playbook using Ansible shell module fails with:
fatal: [localhost]: FAILED! => {"changed": true, "msg": &...
- 139
1
vote
1
answer
3k
views
k3s fail to start as daemoan but works when running manually from command line
I am trying to install k3s on a redhat operating system, on an EC2 instance (t3.xlarge)
OS version:
$ cat /etc/*release
NAME="Red Hat Enterprise Linux"
VERSION="8.6 (Ootpa)"
I ...
- 413
1
vote
2
answers
731
views
which K3S ports should (not) be exposed on a public interface
The K3S documentation explains which ports are required for this kubernetes distribution to work.
What it does NOT explain is, which of these ports are OK to be open on a public interface.
K3S seem to ...
- 413
1
vote
1
answer
4k
views
Free up space on K3s cluster
I have a K3s single-node cluster running with Containerd and where I'm reaching the space disk limit.
It seems I have some old unused docker images on the machine.
How can I cleanup those in order to ...
- 121
1
vote
0
answers
25
views
truenas NFS on kubernetes
I am using the following link to setup my k3s setup with Truenas. I am only interested in NFS. I will not be doing ISCSI. After I applied the "helm upgrade --install --create-namespace --values ...
- 159
1
vote
1
answer
1k
views
Pgadmin4 cannot start in Kubernetes
I have set up Postgres in Kubernetes (k3s administered with Rancher) which seems to be working fine but in order to take a look at the databases I tried to add a pgadmin4 pod.
I first tried adding the ...
- 111
1
vote
1
answer
2k
views
K3S can't pull public docker hub images
K3S cluster is failling to pull public docker hub images. in this instance i will user linuxserver/webtop which presents the error
Failed to pull image "linuxserver/webtop": rpc error: code =...
- 11
1
vote
1
answer
7k
views
K3s - dial tcp 10.43.0.1:443: connect: connection refused
I created a K3s multi-master embedded cluster like this:
hostname: k3s01
curl -sfL https://get.k3s.io | K3S_TOKEN=xxx INSTALL_K3S_EXEC="server --disable servicelb --disable traefik --bind-address=...
- 240
0
votes
1
answer
2k
views
How can I restart or reset the custom namespace pods
I have a k3s cluster with kube-system pods and my application's (xyz-system namespace) pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-...
- 265
0
votes
1
answer
1k
views
Aggregate multiple log files in a directory
I have k3s single node cluster running on a machine.
I do not have any logging infrastructure set up yet and I'd leave this as a future learning experience for now.
On that k3s I run some cron jobs ...
- 166
0
votes
1
answer
1k
views
How to bring K3s server & pods up again after k3s-killall.sh
I am having K3s cluster with system pods (kube-system namespace) & my application pods (xyz-system namespace) running.
I want to stop all of the K3s pods & reset the containerd state, so I ...
- 71
0
votes
1
answer
1k
views
How do I configure Wireguard for a K8s multi-site?
I tried to configure Wireguard for a K3s multi-site cluster, my issue is with routing.
There are at least 4 nodes, 2 in one location + 1 in other location and + 1 in other location.
Assumptions:
10....
0
votes
2
answers
1k
views
Calicoctl rejecting certificate on fresh k3s install
I have a fresh install of Ubuntu, a fresh install of k3s, and a fresh download of calicoctl. I have installed it the following way.
curl -sfL https://get.k3s.io | K3S_KUBECONFIG_MODE="644"\
...
0
votes
0
answers
6
views
Can't connect to UDP service running in k3s and exposed via nodePort
I am trying to expose a UDP service (tftp) through a k3s nodePort but can't seem to connect. The TCP service work fine, but the UDP service doesn't seem to be exposed.
The deployment lists the ports:
....
- 664
0
votes
0
answers
136
views
Why are my DNS query responses from Technitium failing to make it back to my kubernetes container?
I've explored every nook and cranny I can imagine, and I can't figure out what's going wrong.
I've got a k3s setup on my server where I'm hosting technitium in hostNetwork mode. Technitium is ...
- 1
0
votes
1
answer
69
views
k3s fails to parse registries.yaml
I have set up a k3s Kubernetes standalone server with a insecure private registry but k3s fails to pull images from it.
The registries.yaml file is set as documentation says. It is below.
mirrors:
&...
- 101
0
votes
0
answers
95
views
OpenVPN Server on K3s Kubernetes Cluster: No Internet Access
I've set up an OpenVPN server on a K3s Kubernetes cluster. While I can successfully deploy the OpenVPN server pod and connect from a client machine, the client doesn't have internet access through the ...
0
votes
0
answers
66
views
Can't access Rancher UI after deploying it on K3S via helm
I deployed Rancher on K3S cluster using steps documented in below guide: https://ranchermanager.docs.rancher.com/getting-started/quick-start-guides/deploy-rancher-manager/helm-cli
The pod is working ...
- 1
0
votes
0
answers
39
views
K3s - Two pods in the same CIDR subnet doing SNAT in a cluster
We have a multi master k3s cluster with etcd. We have launched 2 pods in deployment and both get the IPs from the same CIDR i.e., 10.244.0.xx. cni0 interface ip is 10.244.1.1 on node 1 and 10.244.0.1 ...
- 1
0
votes
0
answers
27
views
How to run K3s control plane node on AWS and worker nodes on Edge prenmises
I would like to know if there is any documentation on how to set up the following k3 cluster architecture
Control plane in the AWS
Worker nodes on edges premises
Moreover, there is another scenario ...
- 101
0
votes
0
answers
15
views
How can I add ssl certificate to the server using rancher?
I am not asking how to add ssl cert to rancher domain, but to the server that's using k3s. How do I do it?
- 124
0
votes
0
answers
11
views
How to use single signon of nodejs app using kubernetes deployment?
I have tried setting up single signon on a sample node.js app with express and Microsoft authentication.
This is the steps and source code link
When I run locally, it is working.
When I kept in ...
- 1
0
votes
0
answers
127
views
metallb ip address is not accessible when trying to connect from host machine, how to fix that?
I have installed k3s on ubuntu 23 machine, which is installed on virtualbox and with bridged network set.
My windows 10 host machine ip address
Wireless LAN adapter Wi-Fi:
Connection-specific DNS ...
- 1
0
votes
1
answer
160
views
How to access k3s cluster created in an azure vm with public and private ip?
I tried below steps to setup k3s cluster.
Here are the steps to create a K3s cluster on an Azure VM with both private and public IP addresses, and access it from your laptop using kubectl:
Create an ...
- 1
0
votes
0
answers
110
views
RabbitMQ CPU Usage Spikes
I've installed RabbitMQ on kubernetes(k3s) on ARM (Oracle OCI Ampere A1) using the community docker image.
I'm seeing very regular periodic CPU usage spikes (two series of spikes, both with a period ...
0
votes
0
answers
63
views
K3S master does not start due to v1.Event to any object conversion error
I'm running k3s 1.26.4 on a small 4 nodes home lab cluster (1 master/worker + 3 workers).
Today, the master node crashed, and a forced reboot was the only solution.
Since then, the master node refuses ...
0
votes
0
answers
38
views
Problems accessing to a RDS through a Bastion Host from a local K3s
I'm trying to build a local Kubernetes with K3s and I'm having problems to access to my RDD that is situated in the private Area of the VPN.
For now, I'm trying to deploy a Passbolt (https://...
- 1
0
votes
0
answers
167
views
Kube-vip on k3s cluster networking - VIPs from different network
I am trying to setup simple kubernetes cluster on our own infrastructure. We've decided to use k3s and it seems that kube-vip could fit our needs as control plane and services balancer. I am starting ...
- 600
0
votes
0
answers
34
views
dynamic app instance on demand : docker ? rancher ? k3s?
I would like to launch dynamic Wordpress instance i.e. "on demand" when a user want to test Wordpress (Wordpress for example). I have a bare metal server.
Example scenario :
A user will ...
- 1
0
votes
0
answers
412
views
k3s kubectl logs times out after 50 seconds
TLDR: Depending on my k3s version, kubectl logs -f drops back to the console (timeouts?) exactly after 50 seconds without new log entries, instead of remaining attached until a Ctrl-C is issued. I can'...
- 191
0
votes
1
answer
4k
views
Kubernetes k3s master node fails to ready with FailedCreatePodSandBox errors
I'm trying to setup a small 4 worker node cluster atm and I just installed k3s on my raspberry pi 4s (8gb) and I'm getting a NotReady status. I'm new to kubernettes/k3s, but I believe with a totally ...
- 101
0
votes
1
answer
2k
views
how do you check load balancer method "algorithm" for a nginx ingress controller?
I do have an ingress controller load balancer in my Kubernetes Cluster, how do I know if my load balancer run which algorithm? and what happens if my load balancer is not working or the algorithm is ...
0
votes
1
answer
508
views
Deploying k3os through a single image across all nodes with a shared token
I'm trying to get a k3os cluster running on a set of Raspberry Pi nodes using https://github.com/sgielen/picl-k3os-image-generator. I'm successfully generating images and I am able to boot from them. ...
- 1,253
0
votes
0
answers
976
views
I Could not ping or curl master node flannel interface
I have 3 nodes in the cluster, one is the master node and two are the worker nodes. I use CNI flannel for the Kubernetes cluster. I run an Nginx ingress in my cluster for the load balancer and the ...
0
votes
1
answer
49
views
What all dependency in the get.k3s.io script need to be edited to download k3s locally
Currently I am using command curl -sfL https://get.k3s.io to download k3s. The script get.k3s.io is using below third party internet calls to URLs :
GITHUB_URL=https://github.com/k3s-io/k3s/releases
...
- 101
0
votes
0
answers
816
views
access my website (Nginx) Through another machine from local network
I work on K3S kuberentes cluster on ubuntu.
Local IP address 192.168.111.2
public IP address : 192.168.20.90
ip loadbalancer : 192.168.111.100
I build an Nginx with the k3sdomain.com domain on my K3S ...
0
votes
0
answers
393
views
k3s pods not deployed on correct node
I have a k3s cluster with several nodes, let's say 3 nodes. On each node, I have several pods to deploy. It's a "static deployment", meaning that I want to deploy each pod on a specific node....
- 121
0
votes
0
answers
2k
views
Unable to install K3s on Proxmox VM
I'm trying to create an HA k3s cluster using Proxmox and a small fleet of Raspberriy PIs 4B.
For the PIs everything works fine, but when trying to install a master on a Proxmox VM it will not start.
...
- 1