The techniques described in magicandre1981's answer to Office 2016 Advanced Setup can be applied to accomplish a rollback, too. You just need to know the specific version number you want. Fortunately, previous version files appear to be stored in %programfiles(x86)%\Microsoft Office\Updates\Download\PackageFiles (or presumably %programfiles% equivalent if you installed the 64-bit version).
Additional information from Customize Microsoft Office Click-to-Run (C2R) Setup to Install Selected Programs Only helped iron out the details, specifically which Product ID to use - there's quite a list, but they're mostly understandable:
- ProPlusRetail
- ProfessionalRetail
- HomeStudentRetail
- HomeBusinessRetail
- O365ProPlusRetail
- O365HomePremRetail
- O365BusinessRetail
- O365SmallBusPremRetail
- VisioProRetail
- ProjectProRetail
- SPDRetail
First, you need to have the Office Deployment Tool for the version of Microsoft Office in question - Office 2013 or Office 2016. Running the tool gives you a setup.exe file and configuration.xml file.
You can use Configuration XML Editor that ramhound pointed me at to create a properly formatted configuration.xml file to replace the sample included in the Deployment Tool. It has a limited selection of products in it's dropdown, so you may have to manually edit the file to correct the Product ID.
Assuming you already have the files downloaded (because you're reverting to a previous version), you can use setup.exe /configure configuration.xml from a Command Prompt to "reinstall" the specified version - it will walk through the installer like it did the first time, but the end result is the desired version. (If you need to redownload the desired version, substitute download for configure, let it do it's thing, then do it again with configure.)
If you're in the position that prompted this whole question, and want to keep that particular version, make sure you go into one of the Office applications, go to File | Account, and disable updates.