Login to Account Create an Account
Posted 21 March 2010 - 02:35 AM
What's the proper HTTP headers to be sending besides the obvious GET to download the file, in terms of what most sites will accept?
Posted 21 March 2010 - 03:04 AM
telnet 22.214.171.124 80
GET /board/ HTTP/1.1
(followed by enter twice)
Works fine (you can see the markup fly by). Some sites require a few extras (e.g. "User-Agent: cloned-user-agent-string-here") but most of the time this is all you need. Obviously, some sites require authentication to download files.
Posted 21 March 2010 - 03:37 AM
Usually it's pretty straightforward. For msfn it surely is.
Thanks. It does seem so. The problem usually is to figure out what to expect. My problem that prompted this turned out to be that I was expecting a content length and that isn't valid for HTML. But still a good question, since I want what I'm working on to not be too "strange".
Posted 23 March 2010 - 10:24 PM
Thanks. It does seem so. The problem usually is to figure out what to expect.
Moreso again. I keep hitting this downloader code I have (I got it to resume now), and found a site that sends HTML *as* the HTTP headers. So I'm still wondering if there's some kind of universal standard (there has to be I would think or the browsers won't work right).
Any ideas on this one?
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users