Text preprocessing package
Project description
Preprocess YourText
Preprocess YourText is a Python package for text preprocessing tasks, designed to simplify and streamline the process of cleaning and preparing text data for natural language processing (NLP) tasks.
Features
- HTML Tag Removal: Easily remove HTML tags from text data.
- URL Removal: Remove URLs from text data.
- Email Removal: Remove email addresses from text data.
- Special Character Removal: Remove special characters from text data.
- Accent Removal: Remove accents from characters in text data.
- Contractions Expansion: Expand contractions in text data (e.g., "don't" to "do not").
- Lemmatization: Lemmatize words in text data to their base form.
- Spelling Correction: Correct spelling mistakes in text data.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Installation
You can install the package via pip:
pip install mngdataclean
## Usage
import mngdataclean as mdc
# Example usage:
text = "This is an example text with HTML tags <b>and URLs</b>."
clean_text = mdc.get_clean(text)
print(clean_text)
#output is
This is an example text with HTML tags and URLs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mngdataclean-0.4.2.tar.gz
(3.3 kB
view hashes)
Built Distribution
Close
Hashes for mngdataclean-0.4.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9d9b694c4e4bf8b851a4e589fd7ce1918ead7f3bc2562f5de26b785729aff000 |
|
MD5 | 9aa4d1c01739061e3cc31b11411151fd |
|
BLAKE2b-256 | fdaab9f62a3066d2fca6398412c82753f6ae4b65fe3900f77b598ab51b109608 |