UPD: see the answer for solution, don't bother with my sad story.
When I try to enter characters like ~ or ^ I don't see them right away, they are hidden. Instead, if I continue to type, I'm getting all those ã and ô characters. This disrupts typing and is annoying.
The keyboard layout in Windows reads as "ENG - English (United States), United States international" in the taskbar. There is no entry for it, however, in the Time & Language settings. If I install the "ENG - English (United States), United States" language pack, then, WHEN I switch to it, all my ~ and ^ are typed normally. But I still can't get rid of the "International" layout.
I cannot install this "international" layout and then remove it, and it doesn't even shows up when executing powershell command Get-WinUserLanguageList, I only see a single entry:
LanguageTag : en-US
Autonym : English (United States)
EnglishName : English
LocalizedName : English (United States)
ScriptName : Latin
InputMethodTips : {0409:00000409}
Spellchecking : True
Handwriting : False
So how can I get rid of it?
The most annoying part is that it wasn't like this right away, no, the layout I don't need was added at some moment without any actions from my side.