If the Caps Lock turns on and off by itself on Windows 11/10, it could be a software or a hardware fault. Before jumping to a conclusion, see this post.

If your Caps Lock indicator is not working, it could probably be an issue with the LED, keyboard driver, etc. Here are the working fixes!