I once answered a similar question on the Toaster.
First of all check the speed of your website Pagespeed on Gtmetrix & Pingdom
Look at a similar question. There I spoke in detail about optimization
Why Google swears at himself in Google PageSpeed Insights regarding fonts?
P. S. the fastest cache plugin & premium fastest cache clean code