Hi! Thank you for this project.

I was curious whether you had any plans to implement support for compressed models?

• They are described in detail in this blog post: https://towardsdatascience.com/compressing-unsupervised-fasttext-models-eb212e9919ca
• Here are several of the models mentioned in the blog post: https://github.com/avidale/compress-fasttext/releases/tag/gensim-4-draft
• This is the Python library that provides support for loading compressed models: https://github.com/avidale/compress-fasttext

Failed to compile fasttext on Apple M1.

The error message is:

   Compiling fasttext v0.6.0
error: failed to add native library xxx/target/debug/build/cfasttext-sys-b23c8188e065dcaa/out/build/libcfasttext_static.a: file too small to be an archive

My toolchain versions

$ rustc -V
rustc 1.56.0-nightly (ad981d58e 2021-08-08)

$ rustup show
Default host: aarch64-apple-darwin
rustup home:  /Users/xxx/.rustup

nightly-aarch64-apple-darwin (default)
rustc 1.56.0-nightly (ad981d58e 2021-08-08)

$ cmake --version
cmake version 3.21.0

CMake suite maintained and supported by Kitware (kitware.com/cmake).

Any suggestion?

Thanks a lot!

When using prediction functions with strings containing a null byte, the library crashes due to an unwrap() on a CString creation. However, encountering null bytes happens in the nature and while the presence of null bytes could be checked upstream, I don't think that having the program crash is intended behaviour.

This could be fixed by removing unwrap, change return types if applicable and map the error to a String.

I'd be glad to implement such a fix :)

I have the following error when I try to compile for armeabi-v7a:

[2022-09-23T19:42:47Z INFO  cargo_ndk::cli] Building armeabi-v7a (armv7-linux-androideabi)
   Compiling cfasttext-sys v0.7.0
error: failed to run custom build command for `cfasttext-sys v0.7.0`

Caused by:
  process didn't exit successfully: `/rust/target/debug/build/cfasttext-sys-34b28a9c9dd21f71/build-script-build` (exit status: 101)
  --- stdout
  CMAKE_TOOLCHAIN_FILE_armv7-linux-androideabi = None
  CMAKE_TOOLCHAIN_FILE_armv7_linux_androideabi = None
  TARGET_CMAKE_TOOLCHAIN_FILE = None
  CMAKE_TOOLCHAIN_FILE = None
  CMAKE_GENERATOR_armv7-linux-androideabi = None
  CMAKE_GENERATOR_armv7_linux_androideabi = None
  TARGET_CMAKE_GENERATOR = None
  CMAKE_GENERATOR = None
  CMAKE_PREFIX_PATH_armv7-linux-androideabi = None
  CMAKE_PREFIX_PATH_armv7_linux_androideabi = None
  TARGET_CMAKE_PREFIX_PATH = None
  CMAKE_PREFIX_PATH = None
  CMAKE_armv7-linux-androideabi = None
  CMAKE_armv7_linux_androideabi = None
  TARGET_CMAKE = None
  CMAKE = None
  running: "cmake" "/.cargo/registry/src/github.com-1ecc6299db9ec823/cfasttext-sys-0.7.0/cfasttext" "-DCMAKE_INSTALL_PREFIX=/IdeaProjects/rust/target/armv7-linux-androideabi/debug/build/cfasttext-sys-97389a1d85d6c5c7/out" "-DCMAKE_C_FLAGS= -DANDROID -ffunction-sections -fdata-sections -fPIC" "-DCMAKE_C_COMPILER=/Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang" "-DCMAKE_CXX_FLAGS= -DANDROID -ffunction-sections -fdata-sections -fPIC" "-DCMAKE_CXX_COMPILER=/Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang++" "-DCMAKE_ASM_FLAGS= -DANDROID -ffunction-sections -fdata-sections -fPIC" "-DCMAKE_ASM_COMPILER=/Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang" "-DCMAKE_BUILD_TYPE=Debug"
  -- The C compiler identification is Clang 11.0.5
  -- The CXX compiler identification is Clang 11.0.5
  -- Check for working C compiler: /Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang
  -- Check for working C compiler: /Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang -- works
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Check for working CXX compiler: /Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang++
  -- Check for working CXX compiler: /Android/Sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/armv7a-linux-androideabi21-clang++ -- works
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Configuring done
  -- Generating done
  -- Build files have been written to: /IdeaProjects/rust/target/armv7-linux-androideabi/debug/build/cfasttext-sys-97389a1d85d6c5c7/out/build
  running: "cmake" "--build" "." "--target" "cfasttext_static" "--config" "Debug" "--parallel" "8"
  Scanning dependencies of target objlib
  Scanning dependencies of target fasttext-static
  [ 35%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/args.cc.o
  [ 35%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/main.cc.o
  [  5%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/autotune.cc.o
  [ 35%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/dictionary.cc.o
  [ 35%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/densematrix.cc.o
  [ 41%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/fasttext.cc.o
  [ 41%] Building CXX object fasttext/CMakeFiles/fasttext-static.dir/src/loss.cc.o
  [ 47%] Building CXX object CMakeFiles/objlib.dir/lib/cfasttext.cc.o
  [ 47%] Built target objlib

  --- stderr
  CMake Warning:
    Manually-specified variables were not used by the project:

      CMAKE_ASM_COMPILER
      CMAKE_ASM_FLAGS


  make: warning: -j8 forced in submake: resetting jobserver mode.
  clang++clang++clang++clang++clang++clang++: clang++error: : : : : : errorerrorerrorerror: : the clang compiler does not support '-march=native'the clang compiler does not support '-march=native': : 
  the clang compiler does not support '-march=native'
  the clang compiler does not support '-march=native'
  the clang compiler does not support '-march=native'

  error: the clang compiler does not support '-march=native'
  : error: the clang compiler does not support '-march=native'
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:141: fasttext/CMakeFiles/fasttext-static.dir/src/main.cc.o] Error 1
  make[3]: *** Waiting for unfinished jobs....
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:63: fasttext/CMakeFiles/fasttext-static.dir/src/args.cc.o] Error 1
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:76: fasttext/CMakeFiles/fasttext-static.dir/src/autotune.cc.o] Error 1
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:115: fasttext/CMakeFiles/fasttext-static.dir/src/fasttext.cc.o] Error 1
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:128: fasttext/CMakeFiles/fasttext-static.dir/src/loss.cc.o] Error 1
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:89: fasttext/CMakeFiles/fasttext-static.dir/src/densematrix.cc.o] Error 1
  make[3]: *** [fasttext/CMakeFiles/fasttext-static.dir/build.make:102: fasttext/CMakeFiles/fasttext-static.dir/src/dictionary.cc.o] Error 1
  make[2]: *** [CMakeFiles/Makefile2:242: fasttext/CMakeFiles/fasttext-static.dir/all] Error 2
  make[2]: *** Waiting for unfinished jobs....
  make[1]: *** [CMakeFiles/Makefile2:113: CMakeFiles/cfasttext_static.dir/rule] Error 2
  make: *** [Makefile:164: cfasttext_static] Error 2
  thread 'main' panicked at '
  command did not execute successfully, got: exit status: 2

  build script failed, must exit now', /.cargo/registry/src/github.com-1ecc6299db9ec823/cmake-0.1.48/src/lib.rs:975:5
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
[2022-09-23T19:42:50Z INFO  cargo_ndk::cli] If the build failed due to a missing target, you can run this command:
[2022-09-23T19:42:50Z INFO  cargo_ndk::cli] 
[2022-09-23T19:42:50Z INFO  cargo_ndk::cli]     rustup target install armv7-linux-androideabi

Hello,

First of all, thanks a lot for your work on this crate!

Cloning doesn't play well with the custom drop logic, it's better to remove the Clone bit from derive and let users share it via Arc/Rc I think, otherwise this can easily happen:

use fasttext::FastText;

fn main() {
    let mut ft = FastText::new();
    ft.load_model("cooking.model.bin").unwrap();

    let cloned = ft.clone();
    drop(cloned);

    // boom!
    ft.is_quant();
}

Running it causes a 'cargo run' terminated by signal SIGSEGV (Address boundary error)

Hello,

I've been wondering if it could be possible to get the same functionnality as the labels method/property on the python wrapper. I see that you rely on cfasttext, and I haven't found anything that could replicate this feature. I'd be glad to try to add this in Rust, but I don't know if I'd have to touch the underlying C wrapper.