文章采集

「已注销」 2010-09-04 04:35:37

思路是怎么样的！？

...全文

505 16 打赏收藏转发到动态举报

写回复

用AI写文章

16 条回复

切换为时间正序

请发表友善的回复…

发表回复

wuyq11 2010-09-04

打赏
举报

string pattern = @"(?is)<div\s+class=\"title\">(.*?)</div>";

whb147 2010-09-04

打赏
举报

看一下小偷程序即可

「已注销」 2010-09-04

打赏
举报

[Quote=引用 13 楼 adengliuqing 的回复:]
(?is)<div class="title"><h1>.+?</h1></div>
[/Quote]
可以给点完整的代码吗？

米娜Rose 2010-09-04

打赏
举报

(?is)<div class="title"><h1>.+?</h1></div>

米娜Rose 2010-09-04

打赏
举报



/// <summary>

    /// 返回超连接的数组

    /// </summary>

    /// <param name="userInput"></param>

    /// <param name="WebText"></param>

    /// <returns></returns>

    public string[] Get_url_Array(string userInput, string WebText)

    {

        MatchCollection mc = Regex.Matches(userInput, WebText);

        ArrayList Url_List = new ArrayList();

        foreach (Match m in mc)

        {

            Url_List.Add(m.Value.ToString().Replace("  ", " "));

        }

        return (string[])Url_List.ToArray(typeof(string));

    }

「已注销」 2010-09-04

打赏
举报

怎么取得<div class="title"><h1></h1></div>之内的内容，正则表达式怎么写？

「已注销」 2010-09-04

打赏
举报

Get_url_Array方法怎么没有啊？

米娜Rose 2010-09-04

打赏
举报



            /// <summary>

    /// 获取网页源代码

    /// </summary>

    /// <param name="url"></param>

    /// <returns></returns>

    public string GetHtmlEx(string url)

    {

        HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);

        request.Timeout = 60000;

        request.UserAgent = userAgent;

        request.ContentType = contentType;

        request.CookieContainer = cookie;

        request.Accept = accept;

        request.Method = "get";

        HttpWebResponse response = (HttpWebResponse)request.GetResponse();

        if (response.ContentType.Length == 9)

        {

            _encode = "gbk";

        }

        else

        {

            _encode = getEncoding(response);

        }

        Stream responseStream = response.GetResponseStream();

        StreamReader reader = new StreamReader(responseStream, Encoding.GetEncoding(_encode));

        String html = reader.ReadToEnd();

        response.Close();

        return html;

    }



            string Htmlstring = GetHtmlEx(url);

            Htmlstring = Regex.Replace(Htmlstring, "\"", "", RegexOptions.IgnoreCase);

            Htmlstring = Regex.Replace(Htmlstring, "'", "", RegexOptions.IgnoreCase);

            string[] arr0 = Get_url_Array(Htmlstring, rulesObj.RRegex_0);//标题

「已注销」 2010-09-04

打赏
举报

[Quote=引用 5 楼 wuyq11 的回复:]
抓取页面，定时
string param = "";
byte[] bs = Encoding.ASCII.GetBytes(param);
HttpWebRequest req = (HttpWebRequest) HttpWebRequest.Create( "" );
req.Method = "POST";
req.ContentType = "applicatio……
[/Quote]
我现在是能过滤指定标签，不知道是怎么取指定标签内的内容，给点实例！

wuyq11 2010-09-04

打赏
举报

如Regex reg = new Regex(@"(?is)<a[^>]*?href=(['""]?)(?<url>[^'""\s>]+)\1[^>]*>(?<text>(?:(?!</?a\b).)*)</a>");
MatchCollection mc = reg.Matches("");
foreach (Match m in mc)
{
Console.Write(m.Groups["url"].Value);
}

wuyq11 2010-09-04

打赏
举报

正则获取特定数据

wuyq11 2010-09-04

打赏
举报

抓取页面，定时
string param = "";
byte[] bs = Encoding.ASCII.GetBytes(param);
HttpWebRequest req = (HttpWebRequest) HttpWebRequest.Create( "" );
req.Method = "POST";
req.ContentType = "application/x-www-form-urlencoded";
req.ContentLength = bs.Length;
webclient等

米娜Rose 2010-09-04