This seems like a GRUB problem – when you installed Ubuntu, GRUB didn't find your Windows partition. If you like to stay just with Windows, use the below instructions from the Microsoft Knowledge Base to fix Windows boot.
To run the Bootrec.exe tool, first start the Windows RE (Recovery Environment):
- Put the Windows Vista or Windows 7 media in the DVD drive, and then start the computer.
- Press a key when you are prompted.
- Select a language, a time, a currency, a keyboard, or an input method, and then click Next.
- Click Repair your computer.
- Select the operating system that you want to repair, and then click Next.
- In the System Recovery Options dialog box, click Command Prompt.
- Type
Bootrec.exe, and then press Enter.
Note To start the computer from the Windows Vista or Windows 7 DVD,
the computer must be configured to start from the DVD drive.
For information about how to do this,
see the documentation that was included with the computer,
or contact the computer manufacturer.
Edit: bootrec doesn't work in Windows 10.
Check How to fix Windows 10 boot loader from Windows
if bootrec doesn't work.