Bug in incorrect full references with whitespace between them

[sambauers]

Subject of the issue

Remark appears to be mishandling text inside square braces, possibly attempting to create a link reference, even though the text in braces is over two lines.

This is hard to describe. I think the reduction below will explain it better.

Your environment

• OS: MacOSX and also reproduced on REPL.it - https://repl.it/repls/RegalHandmadeWifi
• Packages: Latest Remark and Remark-HTML
• Env: Node v12

Steps to reproduce

Run this reduction:

const remark = require('remark');
const html = require('remark-html');

const md = new remark().use(html);

const markdown = `
[one]
[two]
[three]
[four]
[five]
`;

md.process(markdown, (error, result) => {
  if (!error) {
    console.log(String(result));
  }
});

Expected behaviour

Same as what happens on Commonmark Dingus:

https://spec.commonmark.org/dingus/?text=%5Bone%5D%0A%5Btwo%5D%0A%5Bthree%5D%0A%5Bfour%5D%0A%5Bfive%5D

<p>[one]
[two]
[three]
[four]
[five]</p>

Actual behaviour

Only every second newline is retained:

<p>[one][two]
[three][four]
[five]</p>

Inside a paragraph this is not a huge deal (although white space is lost there), but inside pre or textarea tags (where this also occurs) this is not desirable.

[wooorm]

Thanks for raising that! We’re working on #439 currently, which includes fixes for papercuts like this

[wooorm]

Heya, just wanted to give an update about micromark, it’s sort-of a new motor that we’ll soon use in remark to parse markdown. It’s not yet 100% ready but will be relatively soon. The good news is, it fixes this issue! (P.S. see this twitter thread for some more info!)