Hey Jason, thank you for the fast reply. I saw it in this thread that apparently codegen is required to host on cloudflare: Deploying Next.js app with page routing.
I tried it out with both codegen and headless loader, but somehow I was always running into an issue. Cloudflare apparently needs an adapter (workers) to work with next js. I switched to AWS amplify now and it literally worked within 5 minutes 