Tips and trick OR hard work?

SEO videos are full of tips on how to have better ranking. It seems we just have to apply all those magic secret and we will be on top of Google.
Is SEO mostly base on small tweaks or do we have to worker harder on the product itself? The goal of Google is to provide good search results, which mean, it try to understand what the user want.