My taskbar even with a width to handle two rows, is getting a bit full.
I have put a black circle around what i'd like to quickly close.
I don't want to have to go to each one, right click then move to "close all windows" and left click. I want like maybe ctrl-alt-click to just close all windows of that which I clicked.

Edited for clarification
Moving through the taskbar manually with arrow keys is very inefficient and only useful when one has no mouse.
I want to move the mouse manually to point to which icon's windows I want to close, then one Click/some combo, and close all of them. I guess the best i have so far is right click, up, enter.