Is bp-tokenizer safe to use?

bp-tokenizer has no known vulnerabilities on the latest version (1.0.2). DepScope rates its health at 43/100 (high risk).

What is the latest version of bp-tokenizer?

The latest version of bp-tokenizer is 1.0.2, released 2025-12-05.

Does bp-tokenizer have known vulnerabilities?

No known vulnerabilities on the latest version of bp-tokenizer.

Is bp-tokenizer deprecated?

No, bp-tokenizer is actively maintained. Latest release: 1.0.2 (2025-12-05).

What are alternatives to bp-tokenizer?

Popular alternatives to bp-tokenizer in PyPI include: certifi, requests, charset_normalizer, aiobotocore, pyyaml.

What license does bp-tokenizer use?

bp-tokenizer is licensed under MIT.

bp-tokenizer

pypiv1.0.2

A high-performance Python tokenizer using Byte-Pair Encoding (BPE) with 100k vocabulary, supporting text encoding, decoding, and normalization for NLP applications.

License MITpermissive3 versions0 deps

mdmohsin212/bpe_tokenizer

/ 100

Health

safe to use

[email protected] is safe to use (health: 43/100)

Health breakdown0 – 100

15/25

maintenance

0/20

popularity

25/25

security

3/15

maturity

0/15

community

Vulnerabilities

none known

Health History

Dependency Tree

License Audit

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/pypi/bp-tokenizer