The case described in the question is of having several projects opened in the same window. As described in Managing multiple projects - PyCharm documentation.
The UI currently does not offer the functionality to simultaneously change the interpreter for several projects opened in the same project window. So the only option left (besides picking the interpreter individually for each project in the Settings > Project Interpreter UI dialogue) would be to edit the IDE project configuration files.
The interpreter for each individual project is hard coded in each project's .idea folder inside the .iml file, for example (some irrelevant lines truncated for legibility):
project_folder\.idea\your_project_name.iml
<module type="PYTHON_MODULE" version="4">
<component name="NewModuleRootManager">
<orderEntry type="jdk" jdkName="Python 3.8 (venv38)" jdkType="Python SDK" />
</component>
</module>
Notice in the element <orderEntry> the attributes type="jdk", " jdkName="Python 3.8 (venv38)", etc, define the interpreter that project is set to use. By changing this line in the individual .iml files you are setting that project's interpreter.
The list of Python Interpreters in Settings > Project Interpreter, if you press the cog and Show All..., is populated (in Windows) from the file C:\Users\your_user\AppData\Roaming\JetBrains\PyCharm2020.version\options\jdk.table.xml there you'll find the XML elements corresponding to each interpreter you've added in the past, for example (some irrelevant lines truncated for legibility):
<application>
<component name="ProjectJdkTable">
<jdk version="2">
<name value="Python 3.8 (venv38)" />
<type value="Python SDK" />
<version value="Python 3.8.0" />
<homePath value="C:\path_to_venv38\Scripts\python.exe" />
</jdk>
</component>
</application>

Finally, in order to change the interpreter simultaneously for all projects opened in a Project View from within the IDE, you could define a custom scope and use it in Edit > Find > Replace in Files ( or Ctrl + Shift + R) restricting the change to the .idea\your_project_name.iml files of your opened projects.
Making the change becomes especially easy if you already set the same interpreter for all projects once. In the above example, replacing the line <orderEntry type="jdk" jdkName="Python 3.8 (venv38)" jdkType="Python SDK" /> to that of the new interpreter within the defined custom scope would effect the change in one click.