If you use a plugin like https://wordpress.org/plugins/accelerated-mobile-pages/ or something similar, you have to exclude AMP-URL's from the cache.
Add the following entry in Advanced Settings > Cache Exceptions > Don't cache the following pages.
^(.*)/amp(/)?$
Regular expressions: Borlabs Cache automatically replaces / into \/ for you.