Google's John Mueller actually gave a legit number, which he normally doesn't do, around site speed. He said on Twitter that he'd recommend you keep your HTTP load speed less than 2 - 3 seconds. In fact, he even recommended the webpagetest.org tool for measuring this.
Here are the set of tweets:
@vivek_seo There's no limit per page. Make sure they load fast, for your users. I often check https://t.co/s55K8Lrdmo and aim for <2-3 secs
— John ☆.o(≧▽≦)o.☆ (@JohnMu) November 26, 2016
So I guess you all have a benchmark now in terms of your load time.
What if you are 5 seconds? I doubt it will hurt your rankings.
Forum discussion at Twitter.
