Skip to main content

datapan filters (big) files.

Project description

datapan

Build Lifecycle PyPI Crates.io


This is still a test bed. It is not useful

datapan sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.


Installation

## create/activate venv
# sudo apt-get install python3-venv
# python3 -m venv datapan_env
# source datapan_env/bin/activate
# python -m pip install --upgrade pip

## install datapan
pip install datapan

Usage

import datapan

some_dir = ""

test = datapan.hello_rust(some_dir)

print(test)

Developer Version

  • Rust (nightly)
curl https://sh.rustup.rs -sSf | sh
# rustup default nightly
rustup update nightly
  • Poetry
pip install poetry
make install
make test

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

datapan-0.1.1-cp38-none-win_amd64.whl (149.7 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

datapan-0.1.1-cp37-none-win_amd64.whl (149.7 kB view hashes)

Uploaded CPython 3.7 Windows x86-64

datapan-0.1.1-cp37-cp37m-macosx_10_7_x86_64.whl (146.9 kB view hashes)

Uploaded CPython 3.7m macOS 10.7+ x86-64

datapan-0.1.1-cp36-none-win_amd64.whl (149.9 kB view hashes)

Uploaded CPython 3.6 Windows x86-64

datapan-0.1.1-cp36-cp36m-manylinux1_x86_64.whl (176.6 kB view hashes)

Uploaded CPython 3.6m

datapan-0.1.1-cp36-cp36m-macosx_10_7_x86_64.whl (147.0 kB view hashes)

Uploaded CPython 3.6m macOS 10.7+ x86-64

datapan-0.1.1-cp35-none-win_amd64.whl (150.0 kB view hashes)

Uploaded CPython 3.5 Windows x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page