pandoc 3.5 #10262

jgm · 2024-10-05T21:13:59Z

jgm
Oct 5, 2024
Maintainer

Click to expand changelog

Add command-line options --list-of-figures/--lof and --list-of-tables/--lot (implement lof and lot for docx #10029, Akash Patel). Only docx, latex, and context are affected by these options currently. Setting the lof and lot variables will also work for the formats that are currently supported.
Defaults files: interpolation of environment variables now works for to and from fields ([bug]: defaults in default YAML does not interpolate ${.} #8024). This is needed because these files can contain paths of custom readers/writers.
Docx reader:
- Reset lists after headers in same list numId (Convert DOCX to Markdown: Ordered List in Markdown keeps increasing across headings #10258). To accomplish this, we add a Heading constructor to BodyPart and include on it all the information list items have.
DocBook reader:
- Parse id, class, and tabstyle on tables (Add parsing of id, class, and tabstyle for table to DocBook reader #10181, Erik Rask). Add parsing of id (xml:id), class, and tabstyle XML attributes for table and informaltable in the DocBook reader. The tabstyle value is put in the ‘custom-style’ attribute.
Dokuwiki reader:
- Be more forgiving about misaligned lists, like dokuwiki itself (dokuwiki->mediawiki: List parsing #8863).
- Improve blockquote parsing in dokuwiki. Allow for quoted code blocks.
- Enable smart extension.
- Properly parse -- and --- as dashes.
- Fix block quote behavior (DokuWiki blockquote with linebreaks #6461). Blockquotes are not really block containers in DokuWiki; the lines are interpreted literally (so, e.g., you can’t start a list), and line breaks are added at the ends.
EPUB reader:
- Fix links to other files in the EPUB, making them internal links to a fragment derived from the filename (Broken internal links when converting epub #10207). There was already code to handle links like #foo, but not to handle links like ch0001.html#foo.
LaTeX reader:
- Add em, ex, px, mu to list of units for dimension args (Parsing error on argument to LaTeX \vskip #10212).
ANSI writer:
- Fix subscripts (Evan Silberman).
DokuWiki writer:
- Don’t emit <HTML> tags (Dokuwiki output: List elements with double line breaks fall back to HTML #7413). The use of these tags is now strongly discouraged for security reasons, and will be removed. We previously used them as a fallback for lists that could not be represented using DokuWiki syntax, e.g. ordered lists with fancy numbers or lists with multiple blocks in their items. We also used them for block quotes with multiple blocks as their contents. We now use the <WRAP> syntax (from the optional WRAP plugin) to handle lists with multiple blocks as their contents. A new method of handling block quotes with complex contents has the side benefit of also handling nested block quotes, which weren’t supported before. <HTML> and <html> tags are only for raw HTML blocks and inlines, and only if the raw_html extension is enabled. (It is now a valid extension for dokuwiki, though off by default.)
Docx writer:
- Support --list-of-figures and --list-of-tables (or lof and lot variables) (Akash Patel).
HTML writer:
- Don’t emit missing title/lang warnings if templates does not contain the pagetitle or lang variables respectively (pandoc does not set <title> despite emitting Defaulting to '<basename>' as the title. #9370).
LaTeX writer:
- Better fix for lists in definition lists (Fix for "spacing issue with list in definition list" is confused if the list item starts with a Div #10241). In commit a26ec96 we added an empty \item[] to the beginning of a list that occurs first in a definition list, to avoid having one item on the line with the label. This gave bad results in some cases (Fix for "spacing issue with list in definition list" is confused if the list item starts with a Div #10241) and there is a more idiomatic solution anyway: using \hfill.
- Avoid error on refs div with empty citations (Document without citation doesn't get compiled #10185). If there are no citations, don’t emit an empty CSLReferences environment.
RST writer:
- Change bullet list hang from 3 to 2. This accords with the style in the RST reference docs.
- Handle cases where indented context starts with block quote (rst writer: indentation problem with BlockQuote at beginning of list item #10236). In these cases we emit an empty comment to fix the point from which indentation is measured; otherwise the block quote is not parsed as a block quote. This affects list items and admonitions.
- Don’t enclose the list table in a .. table::; this leads to doubled captions (rst writer with --list-tables=true: table with caption as input is getting two captions in the rst output #10226).
- Fix alignment of list table items corresponding to cells (rst writer with --list-tables=true: fix not aligned indentation of table elements #10227).
JATS template:
- Support floats-group (Albert Krewinkel, see generate JATS xml with "floating" figures and tables #10196). The content of the floats-group variable is now rendered in a <floats-group> element when using the publishing or archiving tag sets.
LaTeX and Beamer templates:
- Split old default.latex into two templates, default.latex and default.beamer, factoring common parts into partials: fonts.latex, common.latex, passoptions.latex, hypersetup.latex, after-header-includes.latex.
- Make default.beamer the default template for beamer.
- Add shorttitle, shortsubtitle, shortauthor, shortinstitute, shortdate variables to beamer template (Short title and short author for beamer slides #10248, Thomas Hodgson).
- Make --number-sections work with beamer (#12045, Thomas Hodgson).
- Support a list of images for titlegraphic in beamer template (Support a list of images for titlegraphic #10246, Thomas Hodgson). Title graphic options will be applied to each title graphic. Images will be separated by \enspace.
- Beamer theme options (Beamer theme options #10243)
- Add theme options to beamer template: colorthemeoptions, fontthemeoptions, innerthemeoptions, outerthemeoptions (Beamer theme options #10243, Thomas Hodgson).
- Don’t load amsmath, amssym in beamer template. These are loaded by beamer automatically.
Text.Pandoc.SelfContained:
- Improve handling of links to remote CSS (When generating html from md with --embed-resources --standalone, CSS styles from --css are not included correctly when loading from remote url, works fine with local file #10261).
Text.Pandoc.Class:
- Allow extracting data: URIs even in PandocPure (--sandbox) (Pandoc Sandbox and Embedded Data URIs for Images #10249).
- Export extractURIData [API change].
Text.Pandoc.PDF:
- Read .toc and .log files from output directory (Markdown to PDF: the output-directory option of pdf-engine breaks the pandoc re-run it #10186). When this is different from the input directory, this is where .toc and .log files are written.
Text.Pandoc.Shared:
- Modify addPandocAttributes for changes in commonmark-pandoc. The new commonmark-pandoc version automatically adds the attribute wrapper="1" on all Divs and Spans that are introduced just as containers for attributes that belong properly to their contents. So we don’t need to add the attribute here. This gives much better results in some cases. Previously the wrapper attribute was being added even for explicit Divs and Spans in djot, but it is not needed in these cases.
Text.Pandoc.Options:
- Add writerListOfFigures and writerListOfTables fields to WriterOptions (Add a lof and lot options to docx output #8245, Akash Patel). [API change]
Text.Pandoc.App:
- Add optListOfFigures and optListOfTables to Opt (Add a lof and lot options to docx output #8245) [API change].
Lua subsystem (Albert Krewinkel):
- Update List module (Lua: let List constructor split string argument on whitespace #9835). The module now comes with a method :at(index[, def]) that allows to access indices, accepts negative indices to count from the end, and will return the def value as a default if the list has no item at the given position. Furthermore, the list constructor pandoc.List now accepts iterators. E.g., pandoc.List(text:gmatch '%S+') returns the list of words in text.
- Support character styling via pandoc.layout. The Doc values produced and handled by the pandoc.layout module can now be styled using bold, italic, underlined, or strikeout. The style is ignored in normal rendering, but becomes visible when rendering to ANSI output. The pandoc.layout.render function now takes a third parameter that defines the output style, either plain or ansi.
- It is now possible to return a single filter from a filter file, e.g.
```
-- Switch single- and double quotes
return {
  Quoted = function (q)
    elem.quotetype = elem.quotetype == 'SingleQuote'
      and 'DoubleQuote' or 'SingleQuote'
    return elem
  end
}
```
  The filter must not contain numerical indexes, or it might be treated as a list of filters.
- Add list_of_figures and list_of_tables to writer options (Akash Patel).
Use latest releases of commonmark, commonmark-pandoc, texmath, djot.
Stop depending on package SHA (Albert Krewinkel). Use crypton instead.
linux/make_artifacts.sh: add riscv64 support (Olivier Benz).
Fix invalid XML in test/docx/normalize.docx (test/docx/normalize.docx contains invalid xml #10242).
doc/lua-filters.md: list functions in pandoc.utils alphabetically (Albert Krewinkel).
MANUAL.txt:
- Clarify use of beamerarticle variable (Make beamerarticle easier to use #10250).
- Add clarification to address user issues like Using custom highlight style (.theme file) not working #6704 (Yehuda Katz).

This discussion was created from the release pandoc 3.5.

jgm · 2024-10-05T21:14:27Z

jgm
Oct 5, 2024
Maintainer Author

I'm pleased to announce the release of pandoc 3.5,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.5

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.5

Some changes of particular note (inspect changelog for the full list):

* The default LaTeX template has been refactored using partials. There
  is now a separate template for beamer (previously, the same
  conditional-ridden template was used for both).  This should make
  customizing the templates more straightforward.  Note: old custom
  templates should still work, but if you are relying on a
  version of `default.latex` in `$DATADIR/templates` in creating
  beamer files, you will need to create a symlink or duplicate in
  the same directory called `default.beamer`.
* The new Beamer template supports a number of new variables,
  allowing further customization.
* New command-line options `--list-of-figures/--lof` and
  `--list-of-tables/--lot`, affecting docx, latex, context.
* Defaults files:  interpolation of environment variables now
  works for `to` and `from` fields of defaults files, which is
  useful when these contain paths of custom readers and writers.
* In Lua filters, you can now use an 'at' method to access indices,
  and you can construct a list using an iterator,
  e.g., "pandoc.List(text:gmatch '%S+')".

API changes:

* Text.Pandoc.Class: export extractURIData.
* Text.Pandoc.Options: add writerListOfFigures and writerListOfTables fields
  to WriterOptions.
* Text.Pandoc.App: add optListOfFigures and optListOfTables to Opt.

Thanks to all who contributed, and a special welcome to new contributors
Akash Patel, Martin Michlmayr, and Yehuda Katz.

0 replies

benz0li · 2024-11-10T06:59:11Z

benz0li
Nov 10, 2024
Sponsor

Unofficial and untested Linux/RISC-V 64-bit (linux/riscv64) release assets are available at https://gitlab.b-data.ch/jgm/pandoc/-/releases/3.5.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

pandoc 3.5 #10262

{{title}}

Replies: 2 comments

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

pandoc 3.5 #10262

jgm Oct 5, 2024 Maintainer

Replies: 2 comments

jgm Oct 5, 2024 Maintainer Author

benz0li Nov 10, 2024 Sponsor

jgm
Oct 5, 2024
Maintainer

jgm
Oct 5, 2024
Maintainer Author

benz0li
Nov 10, 2024
Sponsor