Nendo Plugin Caption LP-MusicCaps

An audio captioning plugin based on LP-MusicCaps.

Features

• Generate captions for all types of audio
• Caption your audio library and make it searchable by using the other nendo search plugins

Requirements

This plugin requires the manual installation of the LP-MusicCaps repository from git, run:

git clone https://github.com/seungheondoh/lp-music-caps.git
cd lp-music-caps
pip install -e .

For more information, please refer to the LP-MusicCaps repository.

Installation

1. Install Nendo
2. pip install nendo-plugin-caption-lpmusiccaps

Usage

Take a look at a basic usage example below. For more detailed information, please refer to the documentation.

>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_caption_lpmusiccaps"])
>>> track = nd.library.add_track(file_path="path/to/file.mp3")

>>> nd.plugins.caption_lpmusiccaps(track=track)
>>> track.get_plugin_value("caption")

Contributing

Visit our docs to learn all about how to contribute to Nendo: Contributing

License

Nendo: MIT License

LP-MusicCaps: CC-BY-NC 4.0 license.

Pretrained models: The weights are released under the CC-BY-NC 4.0 license