We have a paid subscription for Dropbox Family, and for any folder (inside or outside the Family Room), do not see an option for either a file or folder to make Online Only. Running Windows 10. Screenshot of my right click on a folder:

I've also gone online as well, and don't have that option.
FYI, it's not a payment issue - I can see the option for mobile, just not the desktop version.