Lines with only spaces are removed, even in code blocks

[u8sand]

Describe the bug

Spaces are removed from lines with only spaces. Though this might make some kind of sense for normal markdown, in code blocks it could be a problem in some esoteric programming languages such as whitespace but, perhaps more importantly, in real-time editing situations which is how it effects my use case.

To Reproduce

• Marked Demo (Issue)
  

• CommonMark Demo (Works as anticipated)

This caught me off guard because when I tried to fix it by extending the marked tokenizer, I found that the spaces were removed even there!

[
  {type:"code", raw:"```\nThis\n\nTest\n  .\n```", lang:"", text:"This\n\nTest\n  ."}
  //                           ^^^
]

The problem is the first line of the lexer blockTokens function:

marked/src/Lexer.js

Line 123 in c8783a3

src = src.replace(/^ +$/gm, '');

In my project I was forced to override the whole blockTokens function removing the first line. What would be the repercussions of removing it in general? Alternatively this could be an option..

Thanks for the great library!

[UziTech]

It looks like whitespace from blank lines was removed in the original markdown spec. Common Mark leaves them so I think we should only remove them when the pedantic option is used.

#1889 should fix this

[github-actions]

🎉 This issue has been resolved in version 1.2.8 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀