Edit: the steps below seem to be only a temporary solution: UK layout still gets periodically restored...
For me on Windows 11 in 2024 year the issue was solved after removing English UK keyboard code (d0010409) from register, as documented here in Option 3:
https://www.elevenforum.com/t/add-or-remove-keyboard-layout-for-input-language-in-windows-11.4068/#Three
These values are in following 2 register folders:
HKEY_CURRENT_USER\Keyboard Layout\Substitutes​
For me it was an item with Name d0010409 and value 00000809
HKEY_CURRENT_USER\Keyboard Layout\Preload​
Here I had to remove an item with name 1 and value d0010409. Most likely the name might differ for different OS installations.
To decipher these input/layout/language codes, you may try to use Get-WinUserLanguageList commandlet in powershell.
Then press ctrl+alt+del to logout and log in back.