Archives
/
readability
2
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Issue 232 - Stack Exchange pages seem to show only the question or one answer in Reader View

Browse Source
pull/356/head
Evan Tseng 7 years ago
parent 3e07e06b1c
commit f3a645e5ef
4 changed files with 4015 additions and 1 deletions
Show Stats Download Patch File Download Diff File

2
Readability.js
Unescape Escape View File

@ -887,7 +887,7 @@ Readability.prototype = {
// and whose scores are quite closed with current `topCandidate` node.
var alternativeCandidateAncestors = [];
for (var i = 1; i < topCandidates.length; i++) {
if (topCandidates[i].readability.contentScore / topCandidate.readability.contentScore >= 0.75) {
if (topCandidates[i].readability.contentScore / topCandidate.readability.contentScore >= 0.4) {
alternativeCandidateAncestors.push(this._getNodeAncestors(topCandidates[i]));
}
}

7
test/test-pages/stack-exchange/expected-metadata.json
Unescape Escape View File

@ -0,0 +1,7 @@
{
"title": "single word requests - A hypernym for 'insects', 'worms' and the like",
"byline": null,
"dir": null,
"excerpt": "From Oxford:\n\ninsect:\n any small creature with six legs and a body divided into three parts. Insects usually also have wings. Ants, bees and flies are all insects\n \n Insect is often used to ref...",
"readerable": true
}

609
test/test-pages/stack-exchange/expected.html
Unescape Escape View File

@ -0,0 +1,609 @@
<div id="readability-page-1" class="page">
<div id="mainbar">
<div class="question" data-questionid="250245" id="question">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="postcell">
<div>
<div class="post-text" itemprop="text">
<p>From Oxford:</p>
<p><strong><a href="http://www.oxforddictionaries.com/definition/learner/insect">insect</a></strong>:</p>
<blockquote>
<p>any small creature with six legs and a body divided into three parts. Insects usually also have wings. Ants, bees and flies are all insects</p>
<p>Insect is often used to refer to other small creatures, for example spiders, although this is not correct scientific language.</p>
</blockquote>
<p><strong><a href="http://www.oxforddictionaries.com/definition/learner/worm">worm</a></strong>:</p>
<blockquote>
<ol>
<li>
<p>a long thin creature with no bones or legs, that lives in soil</p>
</li>
<li>
<p>long thin creatures that live inside the bodies of humans or animals and can cause illness</p>
</li>
<li>
<p>the young form of an insect when it looks like a short worm</p>
</li>
</ol>
</blockquote>
<p>I find both these definitions oddly restrictive. Insects have 6 legs and worms (in the primary sense) have none. The other senses of worm are also specific. There are many small creatures who do not fall into these categories. Centipedes definity have legs, and a lot more than six. Is there a common (not too scientific) word to refer to all small creatures?</p>
<hr/>
<p>A <strong><a href="http://www.oxforddictionaries.com/definition/english/bug">bug</a></strong> doesn't work, as is defined as</p>
<blockquote>
<p><em>chiefly North American</em> A small <strong>insect</strong>:</p>
<p><em>a thick green scum which crawls with bugs, centipedes, and worse</em></p>
</blockquote>
<p>Insect, not creature, not worm. Also note the exclusion of centipedes from the umbrella of bugs. In fact, Oxford defines <a href="http://www.oxforddictionaries.com/definition/english/centipede">centipedes</a> exclusively in scientific terms.</p>
<blockquote>
<p>A <strong>predatory myriapod invertebrate</strong> with a flattened elongated body composed of many segments. Most segments bear a single pair of legs, the front pair being modified as poison fangs.</p>
</blockquote>
<p>Although Oxford <a href="http://www.oxforddictionaries.com/definition/english/insect">here</a> lists an informal sense of insect:</p>
<blockquote>
<p><em>informal</em> Any small invertebrate animal such as a spider or tick.</p>
</blockquote>
<p>It curiously drops this definition in the advanced learners' version. Moreover, it's reluctant to use the term in its own definition of <a href="http://www.oxforddictionaries.com/definition/english/spider">spider</a>:</p>
<blockquote>
<p>An eight-legged <strong>predatory arachnid</strong> with an unsegmented body consisting of a fused head and thorax and a rounded abdomen. Spiders have fangs which inject poison into their prey, and most kinds spin webs in which to capture insects.</p>
</blockquote>
<hr/>
<p><strong>Questions:</strong></p>
<ul>
<li>
<p>Is there any word, preferably not too informal, which would include all small creatures like insects, worms, spiders and centipedes; without having to resort to biological jargon? </p>
</li>
<li>
<p>Also, how right/wrong is it to use <code>insect</code> or <code>bug</code> for this purpose?</p>
</li>
</ul>
</div>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<div id="answers">
<a name="tab-top"></a>
<a name="250251"></a>
<div id="answer-250251" class="answer accepted-answer" data-answerid="250251" itemscope="" itemtype="http://schema.org/Answer" itemprop="acceptedAnswer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p>Small children are easily interested in small creatures and, unsurprisingly, primary schools in Britain find the study of such animals a good starting point for much of the curriculum. However, it is was thought that calling them "creepy-crawlies" would risk alienating pupils and trigger the fear and distaste which was common in their grandparents' day.</p>
<p>So the term for these small creatures most often used in British Primary Education is <strong><a href="http://en.wiktionary.org/wiki/minibeast#English">minibeasts</a></strong> For a general view of UK minibeast history <a href="http://en.wikipedia.org/wiki/Minibeast">see this wikipedia article</a>.</p>
<blockquote>
<p>"Minibeast" or "Minibeasts" is a term for <strong>a variety of arthropods and other invertebrates</strong>, including spiders, ants, butterflies, bees, wasps, flies, woodlice <a href="http://en.wiktionary.org/wiki/minibeast#English">1</a>, and many others.</p>
</blockquote>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250247"></a>
<div id="answer-250247" class="answer" data-answerid="250247" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p><a href="http://www.oxforddictionaries.com/definition/english/creepy-crawly"><em>Creepy-crawlies</em></a>.</p>
<blockquote>
<p>informal<br/> A spider, worm, or other small flightless creature, especially when considered unpleasant or frightening:</p>
</blockquote>
<p>^ Covers all three cases.</p>
<hr/>
<p>Also, despite your dictionary defining "bug" as an insect specifically, i wouldn't balk at using it to describe worms or spiders as well.</p>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250404"></a>
<div id="answer-250404" class="answer" data-answerid="250404" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p><strong>Bug</strong> is certainly what I would use, and what I would expect those around me to use. And I am American, so I think Oxford is simply wrong about how we use the word. Merriam-Webster, for instance, gives <a href="http://www.merriam-webster.com/dictionary/bug">the principal definition of bug</a> as</p>
<blockquote>
<p>1 a : an insect or other creeping or crawling invertebrate (as a spider or centipede)</p>
</blockquote>
<p>This matches your desired usage perfectly. Note the near-reference to Scimonster’s suggestion of <em>creepy-crawlies</em> – Merriam-Webster here makes it pretty clear that <em>bug</em> is used as a more-formal <em>creepy-crawly</em>.</p>
<p>That said, if we are being truly formal (read: technical), the third definition is the “formal” one:</p>
<blockquote>
<p>1 c : any of an order (<em>Hemiptera</em> and especially its suborder <em>Heteroptera</em>) of insects that have sucking mouthparts, forewings thickened at the base, and incomplete metamorphosis and are often economic pests —called also <em>true bug</em></p>
</blockquote>
<p>This fact is, however, outside entomology, not widely known, and would be regarded by most as trivia. By comparison, the specifics of <em>insect</em> are much more widely known, though I’d guess the majority of speakers are unlikely to care very much in practice – just because someone knows, or at least at one point learned, that insects have three body parts, six legs, etc., doesn’t mean they care to use the word so exactly. But many more know/care about <em>insect</em>’s specific definition than do about <em>bug</em>, as indicated by the fact that some entomologists have resorted to the phrase <em>true bug</em> for <em>Heteroptera</em>. Thus bug is very much my recommendation.</p>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250250"></a>
<div id="answer-250250" class="answer" data-answerid="250250" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p>If you're looking for a negative sense, you might use "vermin" -- small, swarming, repulsive, potentially-disease-bearing creatures.</p>
<p>It's a very unscientific term, including rats, frogs, toads, centipedes, and millipedes, as well as insects and most types of worms (except earthworms and redworms, which are good for the soil). Depending on your sensibilities, it might also include mice, spiders, ants, and termites; it might even encompass scorpions and lizards, and maybe even lobsters.</p>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250285"></a>
<div id="answer-250285" class="answer" data-answerid="250285" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<blockquote>
<p>preferably not too informal</p>
</blockquote>
<p>This is the most formal one: they are all <a href="https://en.wikipedia.org/wiki/Invertebrate" rel="nofollow">invertebrates</a>. </p>
<blockquote>
<p>Invertebrates are animals that neither possess nor develop a vertebral column, derived from the notochord. This includes all animals apart from the subphylum Vertebrata. Familiar examples of invertebrates include <strong>insects</strong>, crabs, lobsters and their kin, snails, clams, octopuses and their kin, starfish, sea-urchins and their kin, and <strong>worms</strong>.</p>
</blockquote>
<p>But the usage depends on the context.</p>
<p>If your text is somehow related to science, don't call spider an "insect". Spiders &amp; insects are <a href="https://en.wikipedia.org/wiki/Arthropod" rel="nofollow">"arthropods"</a> (not "arthropod<strong>e</strong>s"), together with worms they are "invertebrates".</p>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250265"></a>
<div id="answer-250265" class="answer" data-answerid="250265" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p>"Vermin" or "pests" can be any small creature, usually with a negative connotation, but including things as large as rats or even opossums. "Creepy-crawlies" is good but very informal. But as for "bug" -- scientifically, only a small subset of insects are bugs. But the word has expanded, and can now also mean an infection, or a computer glitch. I would argue that as long as the context doesn't imply you mean only insects, "bug" isn't actually wrong in informal English.</p>
<p>(Scientifically, both worms and insects are invertebrates -- creatures without an internal spine -- which then includes spiders and even coral.)</p>
</div>
<table class="fw">
<tbody>
<tr>
<td class="vt">
</td>
<td class="post-signature" align="right">
<div class="user-info ">
<p class="user-action-time">
answered <span title="2015-06-03 20:58:44Z" class="relativetime">Jun 3 '15 at 20:58</span>
</p>
<div class="user-gravatar32">
<a href="http://fakehost/users/113411/vynce">
<div class="gravatar-wrapper-32"><img src="https://www.gravatar.com/avatar/6cb16a7a9af0cfbe5ad85848024b4cfa?s=32&amp;d=identicon&amp;r=PG" alt="" height="32" width="32" /></div>
</a>
</div>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250281"></a>
<div id="answer-250281" class="answer" data-answerid="250281" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p><strong><a href="http://en.wikipedia.org/wiki/Minibeast" rel="nofollow">Minibeast</a></strong> - this term is commonly used (at least in the UK) by charities and other groups which involve children in outdoor activities learning about nature. See also Cbeebies <a href="http://www.bbc.co.uk/cbeebies/shows/mini-beast-adventure-with-jess" rel="nofollow"><em>Minibeasts with Jess</em></a></p>
<p>The UK organisation <a href="https://www.buglife.org.uk/bugs-and-habitats/all-about-bugs" rel="nofollow">Buglife</a> works to protect ALL invertebrates regardless of size or number of legs, and uses the term <em>bug</em> to encompass all of these.</p>
<blockquote>
<p>Invertebrates are animals without backbones and make up the great majority of animal life, with 40,000 species in Britain alone and many millions on Earth.</p>
</blockquote>
</div>
<table class="fw">
<tbody>
<tr>
<td class="vt">
</td>
<td class="post-signature" align="right">
<div class="user-info ">
<p class="user-action-time">
answered <span title="2015-06-03 23:19:53Z" class="relativetime">Jun 3 '15 at 23:19</span>
</p>
<div class="user-gravatar32">
<a href="http://fakehost/users/33153/mynamite">
<div class="gravatar-wrapper-32"><img src="https://i.stack.imgur.com/6uP5m.jpg?s=32&amp;g=1" alt="" height="32" width="32" /></div>
</a>
</div>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250602"></a>
<div id="answer-250602" class="answer" data-answerid="250602" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p>I would say that in the Swedish language the word "kryp" have this meaning. Small creatures that is not built like us mammals, birds and fish. Non vegetable things that move around, but do not have a skeleton. (Or we just can't tell.)</p>
<p>A direct translation to English would be "crawl". But "crawlers" would perhaps correspond more closely to how it is perceived. Yes, it comes from the verb crawl, even if many of them can jump, fly and swim. But it is usually when they crawl on our bodies we notice them.</p>
<p>The word often have a negative association to it, but not necessary.</p>
</div>
<table class="fw">
<tbody>
<tr>
<td class="vt">
</td>
<td class="post-signature" align="right">
<div class="user-info ">
<p class="user-action-time">
answered <span title="2015-06-05 13:06:44Z" class="relativetime">Jun 5 '15 at 13:06</span>
</p>
<div class="user-gravatar32">
<a href="http://fakehost/users/124155/henriko">
<div class="gravatar-wrapper-32"><img src="https://www.gravatar.com/avatar/004664ea648043a0be46ae6830aabbbf?s=32&amp;d=identicon&amp;r=PG" alt="" height="32" width="32" /></div>
</a>
</div>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250344"></a>
<div id="answer-250344" class="answer" data-answerid="250344" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p>In french, it is common to see products to kill calling them <em>"<strong>indésirables</strong>"</em> or <em>"<strong>nuisibles</strong>"</em>.</p>
<p>You can translate to get :</p>
<blockquote>
<p><strong>undesirable</strong>, unwanted, unwelcome, <strong>pest</strong></p>
</blockquote>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="250846"></a>
<div id="answer-250846" class="answer" data-answerid="250846" itemscope="" itemtype="http://schema.org/Answer">
<table>
<tbody>
<tr>
<td class="votecell">
</td>
<td class="answercell">
<div class="post-text" itemprop="text">
<p><strong>Wug</strong> is a portmanteau of <em>worm</em> and <em>bug</em>. It's not very common though, and might need to be explained.</p>
<p>A Google search for <a href="https://www.google.co.il/webhp?sourceid=chrome-instant&amp;ion=1&amp;espv=2&amp;es_th=1&amp;ie=UTF-8#q=wug%20worm%20bug" rel="nofollow"><code>wug worm bug</code></a> reveals hundreds of results, many from books on taxonomy. I couldn't just search for <code>wug</code> because it has other meanings as well.</p>
<p>This is either very informal or very formal -- i can't quite tell. :P</p>
</div>
</td>
</tr>
<tr>
<td class="votecell"></td>
<td>
</td>
</tr>
</tbody>
</table>
</div>
<a name="new-answer"></a>
<h2 class="bottom-notice" data-loc="1">
Not the answer you're looking for? Browse other questions tagged <a href="http://fakehost/questions/tagged/single-word-requests" class="post-tag" title="show questions tagged 'single-word-requests'" rel="tag">single-word-requests</a> <a href="http://fakehost/questions/tagged/hypernyms" class="post-tag" title="show questions tagged 'hypernyms'" rel="tag">hypernyms</a> <a href="http://fakehost/questions/tagged/nuance" class="post-tag" title="show questions tagged 'nuance'" rel="tag">nuance</a> or <a href="http://fakehost/questions/ask">ask your own question</a>. </h2>
</div>
</div>
</div>

3398
test/test-pages/stack-exchange/source.html
View File

File diff suppressed because it is too large Load Diff
Write Preview
Loading…
Cancel
Save