Google Crawlers Send More Than Just GET and POST Requests
Google's crawlers send HTTP requests beyond just GET and POST, according to Gary Illyes from Google. In a recent LinkedIn post, Illyes clarified that his team's crawlers also send HEAD, OPTIONS, PUT, PATCH, and DELETE requests, but these make up less than 1.5% of the total number of requests.
The reason for sending these types of requests is due to JavaScript on websites. Illyes explained that some JavaScript code initiates these requests, which are then handled by Google's crawlers during rendering.