htmlagilitypack - remove script and style?

Question

Im using the following method to extract text form html:

    public string getAllText(string _html)
    {
        string _allText = "";
        try
        {
            HtmlAgilityPack.HtmlDocument document = new HtmlAgilityPack.HtmlDocument();
            document.LoadHtml(_html);


            var root = document.DocumentNode;
            var sb = new StringBuilder();
            foreach (var node in root.DescendantNodesAndSelf())
            {
                if (!node.HasChildNodes)
                {
                    string text = node.InnerText;
                    if (!string.IsNullOrEmpty(text))
                        sb.AppendLine(text.Trim());
                }
            }

            _allText = sb.ToString();

        }
        catch (Exception)
        {
        }

        _allText = System.Web.HttpUtility.HtmlDecode(_allText);

        return _allText;
    }

Problem is that i also get script and style tags.

How could i exclude them?

What about an inline style i.e.
? I see it in OuterHtml but would like to strip out all inline styles too. — Jeremy, Jun 03 '16 at 17:51
`if (childNode.Attributes.Contains("style")) { childNode.Attributes.Remove("style"); } if (childNode.Attributes.Contains("class")) { childNode.Attributes.Remove("class"); }` — Jeremy, Jun 03 '16 at 18:48

score 58 · Accepted Answer · answered Nov 18 '12 at 15:31

58

HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument();
doc.LoadHtml(html);

doc.DocumentNode.Descendants()
                .Where(n => n.Name == "script" || n.Name == "style")
                .ToList()
                .ForEach(n => n.Remove());

answered Nov 18 '12 at 15:31

L.B

114,136
19
178
224

How do i foreach through that? – Jacqueline Nov 18 '12 at 16:40
@Jacqueline When you run above code. All `script` and `style` tags will be removed from `doc` – L.B Nov 18 '12 at 16:41
ahh i see, can it be extenede to support comments such as also? – Jacqueline Nov 18 '12 at 16:44
7

@Jacqueline `.Where(n => n.Name == "script" || n.Name == "style" || n.Name=="#comment")` – L.B Nov 18 '12 at 16:49
2

Does the `Name` property need to be compared case insensitive? I'm thinking the attacker could have used ` – The Muffin Man Nov 14 '14 at 17:39

johnw86 · Answer 2 · 2018-01-29T14:17:02.770

7

You can do so using HtmlDocument class:

HtmlDocument doc = new HtmlDocument();

doc.LoadHtml(input);

doc.DocumentNode.SelectNodes("//style|//script").ToList().ForEach(n => n.Remove());

edited Jan 29 '18 at 14:17

answered Jan 15 '16 at 16:02

johnw86

121
1
6

Shouldn't it be `doc.DocumentNode.SelectNodes("//style|//script").ToList().ForEach(n => n.Remove());`? – MonkeyDreamzzz Nov 22 '17 at 11:04
@Rubanov Yeah it should be, I had an extension method so I didn't require the .ToList in my code. Answer updated, thanks. – johnw86 Jan 29 '18 at 14:18

Rusty Nail · Answer 3 · 2016-12-29T21:14:18.117

Some excellent answers, System.Linq is handy!

For a non Linq based approach:

private HtmlAgilityPack.HtmlDocument RemoveScripts(HtmlAgilityPack.HtmlDocument webDocument)
{

// Get all Nodes: script
HtmlAgilityPack.HtmlNodeCollection Nodes = webDocument.DocumentNode.SelectNodes("//script");

// Make sure not Null:
if (Nodes == null)
    return webDocument;

// Remove all Nodes:
foreach (HtmlNode node in Nodes)
    node.Remove();

return webDocument;

}

score 0 · Answer 4 · answered Jan 29 '21 at 00:23

public static string StripStyles(this string html)
{
    var document = new HtmlDocument();

    document.LoadHtml(html);

    foreach (var node in document.DocumentNode.DescendantsAndSelf())
    {
        var toRemove = node.Attributes.Where(x => x.Name == "style" || x.Name == "script")
            .ToList();
        foreach (var attribute in toRemove)
        {
            attribute.Remove();
        }
    }

    return document.DocumentNode.OuterHtml;
}

htmlagilitypack - remove script and style?

4 Answers4

Linked

Related