Is tokenizers safe to use?

tokenizers has no known vulnerabilities on the latest version (0.23.2). DepScope rates its health at 93/100 (low risk).

What is the latest version of tokenizers?

The latest version of tokenizers is 0.23.2, released 2026-09-03.

Does tokenizers have known vulnerabilities?

No known vulnerabilities on the latest version of tokenizers.

Is tokenizers deprecated?

No, tokenizers is actively maintained. Latest release: 0.23.2 (2026-09-03).

What are alternatives to tokenizers?

Popular alternatives to tokenizers in PyPI include: typing_extensions, six, annotated_types, typing_inspection, mdurl.

What license does tokenizers use?

tokenizers is licensed under Apache-2.0.

tokenizers

pypiv0.23.2

License Apache-2.0permissive103 versions12 deps37,578,951 weekly dl

huggingface/tokenizers

/ 100

Health

safe to use

[email protected] is safe to use (health: 93/100)

Health breakdown0 – 100

25/25

maintenance

20/20

popularity

25/25

security

15/15

maturity

8/15

community

0/15

popularity_floor

Vulnerabilities

none known

Health History

Dependency Tree

License Audit

Dependencies (12)

huggingface-hub tokenizers[testing];sphinx;sphinx-rtd-theme;setuptools-rust;pytest;pytest-asyncio;requests;numpy;datasets;ruff;ty;

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/pypi/tokenizers

tokenizers

pypiv0.23.2

License Apache-2.0permissive103 versions12 deps37,578,951 weekly dl

huggingface/tokenizers

/ 100

Health

safe to use

[email protected] is safe to use (health: 93/100)

Health breakdown0 – 100

25/25

maintenance

20/20

popularity

25/25

security

15/15

maturity

8/15

community

0/15

popularity_floor

Vulnerabilities

none known

Health History

Dependency Tree

License Audit

Dependencies (12)

huggingface-hub tokenizers[testing];sphinx;sphinx-rtd-theme;setuptools-rust;pytest;pytest-asyncio;requests;numpy;datasets;ruff;ty;

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/pypi/tokenizers