HDX Data Freshness Database Clean
Project description
Utility to clean Freshness Database
DEPRECATED - code moved to https://github.com/OCHA-DAP/hdx-data-freshness
This script cleans the freshness database.
Usage
python -m hdx.freshness.dbactions [-db/--db_uri=] [-dp/--db_params=] [action]
Either db_uri or db_params must be provided or the environment variable DB_URI
must be set. db_uri or DB_URI are of form:
postgresql+psycopg://user:password@host:port/database
db_params is of form:
database=XXX,host=X.X.X.X,username=XXX,password=XXX,port=1234, ssh_host=X.X.X.X,ssh_port=1234,ssh_username=XXX, ssh_private_key=/home/XXX/.ssh/keyfile
action:
-
"clone" which creates a shallow clone of the database which only has all the runs and one dataset and its resources per run for testing purposes.
-
"clean" (the default) cleans the database by removing runs according to these rules:
- Keep a handful of runs around the end of each quarter all the way back to the first run in 2017
- Keep daily runs going back 2 years
- Keep weekly runs from 2 to 4 years back
- Keep monthly runs for 4 years back and earlier
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hdx-data-freshness-dbclean-1.0.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cacbd61897f2ec7dc30491339ffb26ae66c3c43a1691900f0809afa6088ff9f6 |
|
| MD5 | dfdfaae7179e84a317f6b9f73a60071e |
|
| BLAKE2b-256 | 07828ec84882ec36153451c06c98bc33aaf54b4b93e3d2de410683e0cf5299cf |
Hashes for hdx_data_freshness_dbclean-1.0.2-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8532ce3ba26ac5ba3d463acd4979b597eef199ec2918154da94fd0d1c5580d48 |
|
| MD5 | 1eadb4a0eaeff4496c5ff47fe784926a |
|
| BLAKE2b-256 | dbdf9acb94f034d07eec97225a4eace02c5c9bcab566f10a081d176df75fb2e5 |
