A plugin to create joint text and audio embeddings using CLAP.
Project description
Nendo Plugin Embed CLAP
A plugin to create joint embeddings from text and audio using CLAP by LAION.
Features
- Create joint embeddings from text and audio
- Use the embeddings in combination with nendo's vector search functionality
Requirements
Please make sure you have the correct version of Pytorch installed. Go to pytorch.org and select your OS, package manager and CUDA version to get the correct installation command.
Installation
- Install Nendo
pip install nendo-plugin-embed-clap
Usage
Take a look at a basic usage example below. For more detailed information, please refer to the documentation.
>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_embed_clap"])
>>> track = nd.library.add_track(file_path="path/to/file.mp3")
>>> embedding = nd.plugins.embed_clap(track=track)
Contributing
Visit our docs to learn all about how to contribute to Nendo: Contributing
License
Nendo: MIT License
Pretrained models: The weights are released by LAION under the Apache 2.0 license.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for nendo_plugin_embed_clap-0.1.0.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1a76fa8c1ec5ed635bac9d53daba5068055b162c6427fa51893a8cc500b66db9 |
|
| MD5 | 4013dc4e503da7d3021bdf4612d940cf |
|
| BLAKE2b-256 | a04a94a476b3de1465982a7a993b794bdd38e7aef352788490a13d1c836194c2 |
Close
Hashes for nendo_plugin_embed_clap-0.1.0-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4c3c38901b9083ebd620380a184740f852392383beef7fce746f1fb3706801b7 |
|
| MD5 | 054931b3cdeca3d17a11a1cc3c0aeac1 |
|
| BLAKE2b-256 | 353a99310bfa81394f12802981e62f9b179165e0aec8b8d85f1778704ddd3b62 |
