The following search query works in any internet browser, like IE, Chrome or Firefox.
http://search.mobile.walmart.com/search?query=bread&store=5461&size=20&offset=0
But, if I use curl POST method with parameters:
curl -d "query=bread&store=5461&size=20&offset=0" -X POST http://search.mobile.walmart.com/search
I got error message:
"StatusCode:404, "error":"Not Found"
On
you're doing 2 mistakes here, first off, that url does not support POST requests, by the looks of it, it only supports GET requests, so don't do -X POST, second, the website does not support having the search parameters in the request body, and -d put the data in the request body, in your example, with the application/x-www-urlencoded format. this site only supports having the parameters in the request URL by the looks of it. so do
curl 'http://search.mobile.walmart.com/search?query=bread&store=5461&size=20&offset=0'
this will issue a GET request, with the parameters in the url, just like the website wants. protip, when debugging curl, add the -v parameter, it prints lots of useful debugging info :)
If it works in a browser then it's a
GETmethod not aPOSTmethod. But if you run it withGETlike this:curl -d "query=bread&store=5461&size=20&offset=0" -X GET http://search.mobile.walmart.com/search. You'll get the following:Which basically means Walmart does not want you to access its website using anything other then a web browser. But you still can try changing the headers to mimic a browser. Also change the
UserAgentstring. Look in this answer on how to do it. This might help.EDIT Actually I've checked it right now and using just
curl -X GET "http://search.mobile.walmart.com/search?query=bread&store=5461&size=20&offset=0"works fine. You dont need to use-dwithGET. Just add the query string to the URL.