Home > Article > Web Front-end > How to get the content of this web page_html/css_WEB-ITnose
http://www.live888cn.com/ft/ftGqViewAction!showFtGq.shtml
Open it in the browser and you can see the content, but using the post or get method returns empty (these two methods should not problem, other web pages can return results).
You can’t see the content even with webbrowser.
Remote Address:27.98.207.137:80
Request URL: http://www.live888cn.com /ft/ftGqViewAction!showFtGq.shtml
Request Method:GET
Status Code:200 OK
Response Headers
view source
Connection:close
Content-Encoding:gzip
Content-Language:zh-CN
Content-Type:text/html;charset=UTF-8
Date:Sun, 26 Apr 2015 08:25:17 GMT
Server:Apache-Coyote/1.1
Transfer-Encoding:chunked
Vary:Accept-Encoding
Request Headers
view source
Accept: text/html,application/xhtml xml,application/xml;q=0.9,image/webp ,*/*;q=0.8
Accept-Encoding:gzip, deflate, lzma, sdch
Accept-Language:zh-CN,zh;q=0.8
Cache-Control:max-age=0
Connection:keep-alive
Cookie:JSESSIONID=59B241080263B6D3BE85F9856C77ED31
Host:www.live888cn.com
User-Agent:Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36 OPR/28.0.1750.51
This is the data obtained by capturing the packet. Direct use of WebRequest will not work, but I can use GetHtml to obtain data from other web pages
public static string GetHtml(string URL)
{
WebRequest wrt;
wrt = WebRequest.Create(URL);
wrt.Credentials = Credential Cache.DefaultCredentials;
WebResponse wrp;
wrp = wrt.GetResponse();
string html = new StreamReader(wrp.GetResponseStream(), Encoding.UTF8).ReadToEnd();
return html; }
public static string GetHtml(string URL) { WebRequest wrt; wrt = WebRequest.Create(URL); wrt.Headers.Add("Cookie:JSESSIONID=B9543CFB75688E73A34D4C1E8A9F7BD0##########"); wrt.Credentials = CredentialCache.DefaultCredentials; WebResponse wrp; wrp = wrt.GetResponse(); string html = new StreamReader(wrp.GetResponseStream(), Encoding.UTF8).ReadToEnd(); return html; }Copy the header information sent when the browser is opened
Simulate sending these header information when making an http request