I have the same problem, my internet speeds are fine. I can download games from Steam with no trouble. But Viveport is sloooooow. It took almost a day to download Invasion!
Yesterday I had a problem with it connecting at all when launching. It would error and ask me to check my internet connection. It was fine and fast. I tried again and got the same error. I waited an hour or so and tried again and it finally worked but I was unable to download anything.
I'm going to drop my subscription until it's fixed. No sence paying for a service that doesn't work.