Skip to content

Infinite compilation when using setup.py #251

@TeoConan

Description

@TeoConan

Hi everyone
I got a mac M1 and I tried to build bitnet, everythings ran fine until I ran python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s

When I run it, I only got INFO:root:Compiling the code using CMake. and then... nothing for an hour
It only make my computer burn for 1 hour

I checked logs/generate_build_files.log and here what I got :

-- Accelerate framework found
-- Metal framework found
-- OpenMP found
-- BLAS found, Libraries: /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework
-- BLAS found, Includes:
-- Using llamafile
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: arm64
-- ARM detected
-- Configuring done (0.3s)
-- Generating done (0.1s)
-- Build files have been written to: /Users/teo/repo/BitNet/build

So nothing very revelant... here log/compile.log

/Users/teo/repo/BitNet/3rdparty/llama.cpp/ggml/src/../include/ggml.h:585:9: note: 'backend' has been explicitly marked deprecated here
  585 |         GGML_DEPRECATED(enum ggml_backend_type backend, "use the buffer type to find the storage location of the tensor");
      |         ^
/Users/teo/repo/BitNet/3rdparty/llama.cpp/ggml/src/../include/ggml.h:192:61: note: expanded from macro 'GGML_DEPRECATED'
  192 | #    define GGML_DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
      |                                                             ^
/Users/teo/repo/BitNet/src/ggml-bitnet-lut.cpp:74:15: warning: unused variable 'bits' [-Wunused-variable]
   74 |     const int bits = ggml_bitnet_get_type_bits(src0->type);
      |               ^~~~
/Users/teo/repo/BitNet/src/ggml-bitnet-lut.cpp:70:131: warning: unused parameter 'dst' [-Wunused-parameter]
   70 | size_t ggml_bitnet_mul_mat_get_wsize(const struct ggml_tensor * src0, const struct ggml_tensor * src1, const struct ggml_tensor * dst) {
      |

Just a bunch or warnings, no errors here
logs/codegen.log is empty

I don't really know what happened, seems to be stuck in an infinite loop when compiling, if you have some ideas...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions