• Announcements

    • xper

      MSFN Sponsorship and AdBlockers!   07/10/2016

      Dear members, MSFN is made available via subscriptions, donations and advertising revenue. The use of ad-blocking software hurts the site. Please disable ad-blocking software or set an exception for MSFN. Alternatively, become a site sponsor and ads will be disabled automatically and by subscribing you get other sponsor benefits.
Sign in to follow this  
Followers 0
Glenn9999

HTTP Requests

4 posts in this topic

(I'm not sure where the best place would be to ask this, and this seems best) Are there any generally accepted rules for HTTP requests that are consistent with most sites? I ask because I've been trying to work (code-wise) on downloading a file pointed to by a valid fully qualified URL. Where I have it now is trying to handle "strange" URLs where valid files aren't necessarily specified. But I get stopped connection-wise if I try a main site link (like http://www.msfn.org/). So this got me wondering, and I'm not finding any good pages on it.

What's the proper HTTP headers to be sending besides the obvious GET to download the file, in terms of what most sites will accept?

0

Share this post


Link to post
Share on other sites

Usually it's pretty straightforward. For msfn it surely is. You can even try using plain old telnet:

telnet 67.19.16.68 80

GET /board/ HTTP/1.1

Host: www.msfn.org

(followed by enter twice)

Works fine (you can see the markup fly by). Some sites require a few extras (e.g. "User-Agent: cloned-user-agent-string-here") but most of the time this is all you need. Obviously, some sites require authentication to download files.

0

Share this post


Link to post
Share on other sites

Usually it's pretty straightforward. For msfn it surely is.

Thanks. It does seem so. The problem usually is to figure out what to expect. My problem that prompted this turned out to be that I was expecting a content length and that isn't valid for HTML. But still a good question, since I want what I'm working on to not be too "strange".

0

Share this post


Link to post
Share on other sites

Thanks. It does seem so. The problem usually is to figure out what to expect.

Moreso again. I keep hitting this downloader code I have (I got it to resume now), and found a site that sends HTML *as* the HTTP headers. So I'm still wondering if there's some kind of universal standard (there has to be I would think or the browsers won't work right).

Any ideas on this one?

0

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0

  • Recently Browsing   0 members

    No registered users viewing this page.