Home  >  Article  >  Web Front-end  >  How to get the content of this web page_html/css_WEB-ITnose

How to get the content of this web page_html/css_WEB-ITnose

WBOY
WBOYOriginal
2016-06-24 11:45:29933browse

http://www.live888cn.com/ft/ftGqViewAction!showFtGq.shtml
Open it in the browser and you can see the content, but using the post or get method returns empty (these two methods should not problem, other web pages can return results).
You can’t see the content even with webbrowser.


Reply to discussion (solution)

Remote Address:27.98.207.137:80
Request URL: http://www.live888cn.com /ft/ftGqViewAction!showFtGq.shtml
Request Method:GET
Status Code:200 OK
Response Headers
view source
Connection:close
Content-Encoding:gzip
Content-Language:zh-CN
Content-Type:text/html;charset=UTF-8
Date:Sun, 26 Apr 2015 08:25:17 GMT
Server:Apache-Coyote/1.1
Transfer-Encoding:chunked
Vary:Accept-Encoding
Request Headers
view source
Accept: text/html,application/xhtml xml,application/xml;q=0.9,image/webp ,*/*;q=0.8
Accept-Encoding:gzip, deflate, lzma, sdch
Accept-Language:zh-CN,zh;q=0.8
Cache-Control:max-age=0
Connection:keep-alive
Cookie:JSESSIONID=59B241080263B6D3BE85F9856C77ED31
Host:www.live888cn.com
User-Agent:Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36 OPR/28.0.1750.51

This is the data obtained by capturing the packet. Direct use of WebRequest will not work, but I can use GetHtml to obtain data from other web pages

public static string GetHtml(string URL)
{
WebRequest wrt;
wrt = WebRequest.Create(URL);
wrt.Credentials = Credential Cache.DefaultCredentials;
WebResponse wrp;

wrp = wrt.GetResponse();
string html = new StreamReader(wrp.GetResponseStream(), Encoding.UTF8).ReadToEnd();
return html;           }

        public static string GetHtml(string URL)        {            WebRequest wrt;            wrt = WebRequest.Create(URL);            wrt.Headers.Add("Cookie:JSESSIONID=B9543CFB75688E73A34D4C1E8A9F7BD0##########");            wrt.Credentials = CredentialCache.DefaultCredentials;            WebResponse wrp;            wrp = wrt.GetResponse();            string html = new StreamReader(wrp.GetResponseStream(), Encoding.UTF8).ReadToEnd();            return html;        }

Copy the header information sent when the browser is opened


Simulate sending these header information when making an http request

Statement:
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn