Skip to main content

A customized pandoc filters set that can be used to generate a useful pandoc python filter.

Project description

PyPI - Python Version PyPI - Version DOI GitHub License

GitHub Actions Workflow Status GitHub Actions Workflow Status GitHub Actions Workflow Status codecov

pandoc-filter

This project supports some useful and highly customized pandoc python filters that based on panflute. They can meet some special requests when using pandoc to

  • convert files from markdown to gfm
  • convert files from markdown to html
  • convert other formats (In the future)

Please see Main Features for the concrete features.

Please see Samples for the recommend usage.

Backgrounds

I'm used to taking notes with markdown and clean markdown syntax. Then, I usually post these notes on my site as web pages. So, I need to convert markdown to html. There were many tools to achieve the converting and I chose pandoc at last due to its powerful features.

But sometimes, I need many more features when converting from markdown to html, where pandoc filters are needed. I have written some pandoc python filters with some advanced features by panflute and many other tools. And now, I think it's time to gather these filters into a combined toolset as this project.

Installation

pip install -i https://pypi.org/simple/ -U pandoc-filter

Main Features

There are 2 supported ways:

  • command-line-mode: use non-parametric filters in command-lines with pandoc.
  • python-mode: use run_filters_pyio function in python.

For an example, md2md_enhance_equation_filter in enhance_equation.py is a filter function as panflute-user-guide . And its registered command-line script is md2md-enhance-equation-filter.

  • So, after the installation, one can use it in command-line-mode:

    pandoc ./input.md -o ./output.md -f markdown -t gfm -s --filter md2md-enhance-equation-filter
    
  • Or, use in python mode

    import pandoc_filter
    file_path = pathlib.Path("./input.md")
    output_path = pathlib.Path("./output.md")
    pandoc_filter.run_filters_pyio(file_path,output_path,'markdown','gfm',[pandoc_filter.md2md_enhance_equation_filter])
    

Runtime status can be recorded. In python mode, any filter function will return a proposed panflute Doc. Some filter functions will add an instance attribute dict runtime_dict to the returned Doc, as a record for runtime status, which may be very useful for advanced users. For an example, md2md_enhance_equation_filter, will add an instance attribute dict runtime_dict to the returned Doc, which may contain a mapping {'math':True} if there is any math element in the Doc.

All filters with corresponding registered command-line scripts, the specific features, and the recorded runtime status are recorded in the following table:

[!NOTE]

Since some filters need additional arguments, not all filter functions support command-line-mode, even though they all support python-mode indeed.

All filters support cascaded invoking.

Filter Functions Command Line Additional Arguments Features Runtime status (doc.runtime_dict)
md2md_convert_github_style_alert_to_hexo_style_alert_filter md2md-convert-github-style-alert-to-hexo-style-alert-filter - Convert the github-style alert to hexo-style alert. -
md2md_enhance_equation_filter md2md-enhance-equation-filter - Enhance math equations. Specifically, this filter will: Adapt AMS rule for math formula. Auto numbering markdown formulations within \begin{equation} \end{equation}, as in Typora. Allow multiple tags, but only take the first one. Allow multiple labels, but only take the first one. {'math':< bool >,'equations_count':<some_number>}
md2md_norm_footnote_filter md2md-norm-footnote-filter - Normalize the footnotes. Remove unnecessary \n in the footnote content. -
md2md_norm_internal_link_filter md2md-norm-internal-link-filter - Normalize internal links' URLs. Decode the URL if it is URL-encoded. -
md2md_upload_figure_to_aliyun_filter - doc_path Auto upload local pictures to Aliyun OSS. Replace the original src with the new one. The following environment variables should be given in advance: $Env:OSS_ENDPOINT_NAME, $Env:OSS_BUCKET_NAME, $Env:OSS_ACCESS_KEY_ID , and $Env:OSS_ACCESS_KEY_SECRET. The doc_path should be given in advance. {'doc_path':<doc_path>,'oss_helper':<Oss_Helper>}
md2html_centralize_figure_filter md2html-centralize-figure-filter - ==Deprecated== -
md2html_enhance_link_like_filter md2html-enhance-link-like-filter - Enhance the link-like string to a link element. -
md2html_hash_anchor_and_internal_link_filter md2html-hash-anchor-and-internal-link-filter - Hash both the anchor's id and the internal-link's url simultaneously. {'anchor_count':<anchor_count_dict>,'internal_link_record':<internal_link_record_list>}
md2html_increase_header_level_filter md2html-increase-header-level-filter - Increase the header level by 1. -

Samples

Here are 2 basic types of examples

Convert markdown to markdown (Normalization)

Convert markdown to html

Contribution

Contributions are welcome. But recently, the introduction and documentation are not complete. So, please wait for a while.

A simple way to contribute is to open an issue to report bugs or request new features.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pandoc_filter-0.2.14.tar.gz (32.7 kB view hashes)

Uploaded Source

Built Distribution

pandoc_filter-0.2.14-py3-none-any.whl (36.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page