Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compilation error (fasttext) #39

Open
cgr71ii opened this issue Sep 13, 2023 · 5 comments
Open

Compilation error (fasttext) #39

cgr71ii opened this issue Sep 13, 2023 · 5 comments

Comments

@cgr71ii
Copy link
Contributor

cgr71ii commented Sep 13, 2023

Hi,

I was trying to install Bitextor in a conda environment, but it seems that warc2text can't be compiled due to fasttext:

/home/cgarcia/Documentos/bitextor/third_party/warc2text/fasttext/src/args.cc: In member function 'int64_t fasttext::Args::getAutotuneModelSize() const':                                                     
/home/cgarcia/Documentos/bitextor/third_party/warc2text/fasttext/src/args.cc:468:3: error: 'uint64_t' was not declared in this scope                                                                         
  468 |   uint64_t multiplier = 1;                                                                                                                                                                           

I took a look at the fasttext repo and it's a known bug: facebookresearch/fastText#1281

@kpu , could we add the fix suggested in NiuBlibing/fastText@fec1a6c in the fork used in this repo (https://github.com/kpuatfb/fastText)?

I tried the fix and it worked for me.

@versae
Copy link

versae commented Oct 20, 2023

Is this error resolved? I still cannot compile warc2text in a fresh Ubuntu 22 LTS or 24. I tried the next with several combinations, like using NiuBlibing/fastText@fec1a6c, or @kpu's fork, or setting GCC to version 12. Nothing worked.

This is a short script I'm using after docker run -it --rm ubuntu:latest:

apt update
apt install -y build-essential g++ cmake libprotobuf-dev protobuf-compiler uchardet libuchardet-dev libzip-dev git libboost-all-dev

git clone --recurse-submodules https://github.com/bitextor/warc2text.git
cd warc2text/
mkdir build
cd build/
cmake ..
make -j

Any help will be welcome!

@versae
Copy link

versae commented Dec 4, 2023

Any update on this? Can it be compiled differently?

@kpu
Copy link
Member

kpu commented Dec 4, 2023

The #include <cstdint> is already in master fastText. Update your submodules. Also, use https://github.com/kpu/fasterText for faster inference.

@jelmervdl
Copy link
Member

I would love to but kpu/fasterText#1

@kpu
Copy link
Member

kpu commented Dec 5, 2023

Fixed kpu/fasterText#1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants