Repository navigation
HTMLParser does not support escapable raw text mode (<textarea> and <title>) #118350
Description
Bug report
Bug description:
An example where parsing stops after the <style color="red">:
from html.parser import HTMLParser
from io import StringIO
class HTML2text(HTMLParser):
def __init__(self):
super().__init__()
self.data = StringIO()
def handle_data(self, html):
self.data.write(html)
def get_data(self):
return self.data.getvalue().strip()
html_test = '''
<!DOCTYPE html>
<head><title>Glued</title></head><body><some><style color="red">title</bar>
<h1>Spacious </h1><a href="https://heading.net">heading.net</a>
<span>not<a href="https://www.arpa.home">my.home.arpa</a><p> URL</p>
</body></html>
'''
parser = HTML2text()
parser.feed(html_test)
print(parser.get_data())Changing a single character in the word "style" restores the normal functionality.
CPython versions tested on:
3.11
Operating systems tested on:
Linux
Linked PRs
- gh-118350: Add escapable-raw-text mode to html parser #121770
- gh-118350: Fix support of elements "textarea" and "title" in HTMLParser #135310
- [3.14] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #136984
- [3.13] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #136985
- [3.12] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #136986
- [3.11] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #137782
- [3.10] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #137783
- [3.9] gh-118350: Fix support of elements "textarea" and "title" in HTMLParser (GH-135310) #137784
Metadata
Metadata
Assignees
Labels
Projects
- Status
Activity
JelleZijlstra commentedon Apr 27, 2024
Isn't this because you didn't close your
<style>tag? If I remember correctly style tags go on until</style>is seen regardless of any other tag-like text within the tag, because they may contain text in other languages.savchenko commentedon Apr 28, 2024
@JelleZijlstra , indeed! Closing
<style>allows the snippet to be parsed. However, isn't it inconsistent with the the behaviour observed when parsing other tags?For example, this broken HTML is parsed correctly:
vadmium commentedon Apr 28, 2024
The difference is that <style> is a “raw text element”. It cannot contain HTML markup. Most other tags can be followed by other markup. See https://html.spec.whatwg.org/multipage/syntax.html#raw-text-elements
However I believe your HTML with
<title>Rebelious<h1> . . .does trigger a bug. The <title> element is supposed to be an “escapable raw text element”, so<h1>should be counted as part of the raw title text. However it gets parsed as a tag:Encountered a start tag: title
Encountered some data : Rebelious
Encountered a start tag: h1
serhiy-storchaka commentedon May 7, 2025
The original issue (about unclosed
<style>) looks like a duplicate of #86155.[-]HTMLParser stops parsing upon encountering `<style>` tag[/-][+]HTMLParser does not support escapable raw text mode (<textarea> and <title>)[/+]11 remaining items
pythongh-118350: Fix support of elements "textarea" and "title" in HT…
[3.11] pythongh-118350: Fix support of elements "textarea" and "title…
[3.10] pythongh-118350: Fix support of elements "textarea" and "title…
[3.9] pythongh-118350: Fix support of elements "textarea" and "title"…
pythongh-118350: Fix support of elements "textarea" and "title" in HT…
[3.14] pythongh-118350: Fix support of elements "textarea" and "title…
[3.9] gh-118350: Fix support of elements "textarea" and "title" in HT…
[3.11] gh-118350: Fix support of elements "textarea" and "title" in H…
[3.10] gh-118350: Fix support of elements "textarea" and "title" in H…
[html.parser] Fix stubtest for later patch releases
Fix raw markup inside <title> on Python 3.11.14
ui_test: fix HTML structure in testFolderWorkflowActionWithoutConfirm…