Reminder / 提示
Problem Description / 问题描述
Fasttext is deprecated which could not be built on latest system due to higher gcc version.
System Info (dataflow env) / 系统信息(dataflow env)
platform: linux
python: 3.13.9-trixie
Reproduction Steps & Logs / 重现步骤及日志
# e.g.
$ docker run -it --rm python:3.13.9-trixie /bin/bash
$ pip install uv
$ apt update && apt install build-essential
$ mkdir data-pipeline && data-pipeline
$ uv add open-dataflow
Resolved 238 packages in 3ms
Downloading hf-xet (3.2MiB)
Downloading networkx (2.0MiB)
Downloading aiohttp (1.7MiB)
Downloading sympy (6.0MiB)
Downloading tokenizers (3.1MiB)
Downloading nltk (1.4MiB)
Downloading pymupdf (23.0MiB)
Downloading whylogs (1.9MiB)
Downloading thinc (3.7MiB)
Downloading pydantic-core (2.0MiB)
Downloading rapidfuzz (3.0MiB)
Downloading nvidia-cusparselt-cu12 (273.9MiB)
Downloading symspellpy (2.5MiB)
Downloading open-dataflow (2.6MiB)
Downloading numba (3.6MiB)
Downloading nvidia-cublas-cu12 (566.8MiB)
Downloading scipy (34.0MiB)
Downloading nvidia-cuda-cupti-cu12 (9.8MiB)
Downloading babel (9.7MiB)
Downloading torchaudio (2.0MiB)
Downloading cryptography (4.0MiB)
Downloading google-api-python-client (14.0MiB)
Downloading pandas (11.7MiB)
Downloading scikit-learn (8.5MiB)
Downloading pillow (6.7MiB)
Downloading pyfiglet (1.7MiB)
Downloading pyarrow (40.3MiB)
Downloading nvidia-cufft-cu12 (184.2MiB)
Downloading nvidia-nvshmem-cu12 (118.9MiB)
Downloading phonenumbers (2.5MiB)
Downloading nvidia-cusparse-cu12 (274.9MiB)
Downloading transformers (11.4MiB)
Downloading shapely (2.9MiB)
Downloading blis (10.8MiB)
Downloading google-cloud-aiplatform (7.8MiB)
Downloading torchvision (7.7MiB)
Downloading lxml (5.0MiB)
Downloading llvmlite (53.7MiB)
Downloading nvidia-cusolver-cu12 (255.1MiB)
Downloading gradio (21.9MiB)
Downloading nvidia-cudnn-cu12 (674.0MiB)
Downloading nvidia-cuda-nvrtc-cu12 (84.0MiB)
Downloading grpcio (6.3MiB)
Downloading torch (858.1MiB)
Downloading nvidia-curand-cu12 (60.7MiB)
Downloading triton (162.6MiB)
Downloading nvidia-nccl-cu12 (307.4MiB)
Downloading modelscope (5.8MiB)
Downloading nvidia-nvjitlink-cu12 (37.4MiB)
Downloading spacy (31.3MiB)
Downloaded nltk
Downloading brotli (1.4MiB)
Downloaded brotli
Downloading sentencepiece (1.3MiB)
Downloaded sentencepiece
Downloading soundfile (1.3MiB)
Downloaded soundfile
Downloading pygments (1.2MiB)
Downloaded pygments
Downloading langkit (1.2MiB)
Downloaded langkit
Downloading nvidia-cufile-cu12 (1.1MiB)
Downloaded nvidia-cufile-cu12
Downloading srsly (1.1MiB)
Downloaded srsly
Downloading tiktoken (1.1MiB)
Downloaded tiktoken
Downloading openai (1.0MiB)
Downloaded openai
Downloaded aiohttp
Downloaded pyfiglet
Downloaded whylogs
Downloaded networkx
Downloaded pydantic-core
Building func-timeout==4.3.5
Downloaded torchaudio
Built func-timeout==4.3.5
Building vendi-score==0.0.3
Building word2number==1.1
Downloading setuptools (1.1MiB)
Building fasttext-wheel==0.9.2
Built word2number==1.1
Built vendi-score==0.0.3
Building whylogs-sketching==3.4.1.dev3
Downloaded setuptools
Downloaded symspellpy
Downloaded phonenumbers
Downloaded open-dataflow
× Failed to build `fasttext-wheel==0.9.2`
├─▶ The build backend returned an error
╰─▶ Call to `setuptools.build_meta:__legacy__.build_wheel` failed (exit status: 1)
[stdout]
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-313/fasttext
copying python/fasttext_module/fasttext/__init__.py -> build/lib.linux-x86_64-cpython-313/fasttext
copying python/fasttext_module/fasttext/FastText.py -> build/lib.linux-x86_64-cpython-313/fasttext
creating build/lib.linux-x86_64-cpython-313/fasttext/util
copying python/fasttext_module/fasttext/util/util.py -> build/lib.linux-x86_64-cpython-313/fasttext/util
copying python/fasttext_module/fasttext/util/__init__.py -> build/lib.linux-x86_64-cpython-313/fasttext/util
creating build/lib.linux-x86_64-cpython-313/fasttext/tests
copying python/fasttext_module/fasttext/tests/__init__.py -> build/lib.linux-x86_64-cpython-313/fasttext/tests
copying python/fasttext_module/fasttext/tests/test_configurations.py -> build/lib.linux-x86_64-cpython-313/fasttext/tests
copying python/fasttext_module/fasttext/tests/test_script.py -> build/lib.linux-x86_64-cpython-313/fasttext/tests
running build_ext
creating tmp
g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/root/.cache/uv/builds-v0/.tmpAhnDzg/include -I/usr/local/include/python3.13 -c
/tmp/tmpuuyo9wuq.cpp -o tmp/tmpuuyo9wuq.o -std=c++14
g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/root/.cache/uv/builds-v0/.tmpAhnDzg/include -I/usr/local/include/python3.13 -c
/tmp/tmpj2rb6lcj.cpp -o tmp/tmpj2rb6lcj.o -fvisibility=hidden
building 'fasttext_pybind' extension
creating build/temp.linux-x86_64-cpython-313/python/fasttext_module/fasttext/pybind
creating build/temp.linux-x86_64-cpython-313/src
g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/pybind11/include
-I/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/pybind11/include -Isrc -I/root/.cache/uv/builds-v0/.tmpAhnDzg/include
-I/usr/local/include/python3.13 -c python/fasttext_module/fasttext/pybind/fasttext_pybind.cc -o
build/temp.linux-x86_64-cpython-313/python/fasttext_module/fasttext/pybind/fasttext_pybind.o -DVERSION_INFO=\"0.9.2\" -std=c++14 -fvisibility=hidden
g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/pybind11/include
-I/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/pybind11/include -Isrc -I/root/.cache/uv/builds-v0/.tmpAhnDzg/include
-I/usr/local/include/python3.13 -c src/args.cc -o build/temp.linux-x86_64-cpython-313/src/args.o -DVERSION_INFO=\"0.9.2\" -std=c++14 -fvisibility=hidden
[stderr]
/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/setuptools/dist.py:599: SetuptoolsDeprecationWarning: Invalid dash-separated key 'description-file'
in 'metadata' (setup.cfg), please use the underscore name 'description_file' instead.
!!
********************************************************************************
Usage of dash-separated 'description-file' will not be supported in future
versions. Please use the underscore name 'description_file' instead.
(Affected: fasttext-wheel).
By 2026-Mar-03, you need to update your project and remove deprecated calls
or your builds will no longer be supported.
See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
********************************************************************************
!!
opt = self._enforce_underscore(opt, section)
/root/.cache/uv/builds-v0/.tmpAhnDzg/lib/python3.13/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: MIT License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
python/fasttext_module/fasttext/pybind/fasttext_pybind.cc: In lambda function:
python/fasttext_module/fasttext/pybind/fasttext_pybind.cc:345:35: warning: comparison of integer expressions of different signedness: ‘int32_t’ {aka ‘int’} and
‘std::vector<long int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
345 | for (int32_t i = 0; i < vocab_freq.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~
python/fasttext_module/fasttext/pybind/fasttext_pybind.cc: In lambda function:
python/fasttext_module/fasttext/pybind/fasttext_pybind.cc:359:35: warning: comparison of integer expressions of different signedness: ‘int32_t’ {aka ‘int’} and
‘std::vector<long int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
359 | for (int32_t i = 0; i < labels_freq.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~
src/args.cc: In member function ‘void fasttext::Args::parseArgs(const std::vector<std::__cxx11::basic_string<char> >&)’:
src/args.cc:120:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::__cxx11::basic_string<char> >::size_type’ {aka
‘long unsigned int’} [-Wsign-compare]
120 | for (int ai = 2; ai < args.size(); ai += 2) {
| ~~~^~~~~~~~~~~~~
src/args.cc:221:19: warning: catching polymorphic type ‘class std::out_of_range’ by value [-Wcatch-value=]
221 | } catch (std::out_of_range) {
| ^~~~~~~~~~~~
src/args.cc: In member function ‘int64_t fasttext::Args::getAutotuneModelSize() const’:
src/args.cc:468:3: error: ‘uint64_t’ was not declared in this scope
468 | uint64_t multiplier = 1;
| ^~~~~~~~
src/args.cc:17:1: note: ‘uint64_t’ is defined in header ‘<cstdint>’; this is probably fixable by adding ‘#include <cstdint>’
16 | #include <unordered_map>
+++ |+#include <cstdint>
17 |
src/args.cc:471:5: error: ‘multiplier’ was not declared in this scope
471 | multiplier = units[lastCharacter];
| ^~~~~~~~~~
src/args.cc:474:11: error: expected ‘;’ before ‘size’
474 | uint64_t size = 0;
| ^~~~~
| ;
src/args.cc:478:5: error: ‘size’ was not declared in this scope
478 | size = std::stol(modelSize, &nonNumericCharacter);
| ^~~~
src/args.cc:490:10: error: ‘size’ was not declared in this scope
490 | return size * multiplier;
| ^~~~
src/args.cc:490:17: error: ‘multiplier’ was not declared in this scope
490 | return size * multiplier;
| ^~~~~~~~~~
error: command '/usr/bin/g++' failed with exit code 1
hint: This usually indicates a problem with the package or the build environment.
help: `fasttext-wheel` (v0.9.2) was included because `data-pipeline` (v0.1.0) depends on `open-dataflow` (v1.0.8) which depends on `fasttext-wheel`
Additional Information / 其他补充
facebookresearch/fastText#1334
No response
Reminder / 提示
Problem Description / 问题描述
Fasttext is deprecated which could not be built on latest system due to higher gcc version.
System Info (
dataflow env) / 系统信息(dataflow env)platform: linux
python: 3.13.9-trixie
Reproduction Steps & Logs / 重现步骤及日志
Additional Information / 其他补充
facebookresearch/fastText#1334
No response