search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.79k stars 135 forks source link

Can I use on Mac Os X Darwin 10.14? #117

Open andreapagliacci opened 1 year ago

andreapagliacci commented 1 year ago

I have Python 3.10, ctransformers 0.2.24 ( I tested with 0.2.24 too) The code 

llm = AutoModelForCausalLM.from_pretrained('llama-2-7b-chat.ggmlv3.q2_K.bin', model_type='llama')

Sistematically I have error 

Traceback (most recent call last):
  File "/Users/scratchless/Desktop/llm-api/.conda/bin/uvicorn", line 8, in <module>
    sys.exit(main())
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/main.py", line 416, in main
    run(
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/main.py", line 587, in run
    server.run()
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/server.py", line 61, in run
    return asyncio.run(self.serve(sockets=sockets))
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/server.py", line 68, in serve
    config.load()
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/config.py", line 467, in load
    self.loaded_app = import_from_string(self.app)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages/uvicorn/importer.py", line 21, in import_from_string
    module = importlib.import_module(module_str)
  File "/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/Users/scratchless/Desktop/llm-api/main.py", line 17, in <module>
    llm = AutoModelForCausalLM.from_pretrained('model/llama-2-7b-chat.ggmlv3.q2_K.bin', model_type='llama')
  File "lm-api/.conda/lib/python3.10/site-packages/ctransformers/hub.py", line 168, in from_pretrained
    return LLM(
  File "/llm-api/.conda/lib/python3.10/site-packages/ctransformers/llm.py", line 208, in __init__
    self._lib = load_library(lib, cuda=config.gpu_layers > 0)
  File "/llm-api/.conda/lib/python3.10/site-packages/ctransformers/llm.py", line 104, in load_library
    lib = CDLL(path)
  File "/llm-api/.conda/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: dlopen(/llm-api/.conda/lib/python3.10/site-packages/ctransformers/lib/avx2/libctransformers.dylib, 6): no suitable image found.  Did find:
        /llm-api/.conda/lib/python3.10/site-packages/ctransformers/lib/avx2/libctransformers.dylib: cannot load 'libctransformers.dylib' (load command 0x80000034 is unknown)
        /llm-api/.conda/lib/python3.10/site-packages/ctransformers/lib/avx2/libctransformers.dylib: cannot load 'libctransformers.dylib' (load command 0x80000034 is unknown)

Other people run successfully on Ubuntu 22 but never read about mac os x.

marella commented 1 year ago

Please try reinstalling from source:

pip uninstall ctransformers --yes
pip install ctransformers --no-binary ctransformers
andreapagliacci commented 1 year ago

I have errors

collecting ctransformers
  Using cached ctransformers-0.2.26.tar.gz (376 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: huggingface-hub in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from ctransformers) (0.16.4)
Requirement already satisfied: py-cpuinfo<10.0.0,>=9.0.0 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from ctransformers) (9.0.0)
Requirement already satisfied: filelock in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (3.12.2)
Requirement already satisfied: fsspec in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (2023.6.0)
Requirement already satisfied: requests in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (2.31.0)
Requirement already satisfied: tqdm>=4.42.1 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.66.1)
Requirement already satisfied: pyyaml>=5.1 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (6.0.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.7.1)
Requirement already satisfied: packaging>=20.9 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (23.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2.0.4)
Requirement already satisfied: certifi>=2017.4.17 in /Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2023.7.22)
Building wheels for collected packages: ctransformers
  Building wheel for ctransformers (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for ctransformers (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [627 lines of output]

      --------------------------------------------------------------------------------
      -- Trying 'Ninja' generator
      --------------------------------
      ---------------------------
      ----------------------
      -----------------
      ------------
      -------
      --
      CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
        Compatibility with CMake < 3.5 will be removed from a future version of
        CMake.

        Update the VERSION argument <min> value or use a ...<max> suffix to tell
        CMake that the project does not need compatibility with older versions.

      Not searching for unused variables given on the command line.

      -- The C compiler identification is AppleClang 10.0.1.10010046
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /Library/Developer/CommandLineTools/usr/bin/cc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- The CXX compiler identification is AppleClang 10.0.1.10010046
      -- Detecting CXX compiler ABI info
      -- Detecting CXX compiler ABI info - done
      -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
      -- Detecting CXX compile features
      -- Detecting CXX compile features - done
      -- Configuring done (0.7s)
      -- Generating done (0.0s)
      -- Build files have been written to: /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/_cmake_test_compile/build
      --
      -------
      ------------
      -----------------
      ----------------------
      ---------------------------
      --------------------------------
      -- Trying 'Ninja' generator - success
      --------------------------------------------------------------------------------

      Configuring Project
        Working directory:
          /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/_skbuild/macosx-10.14-x86_64-3.10/cmake-build
        Command:
          /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/cmake/data/bin/cmake /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e -G Ninja -DCMAKE_MAKE_PROGRAM:FILEPATH=/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/ninja/data/bin/ninja --no-warn-unused-cli -DCMAKE_INSTALL_PREFIX:PATH=/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/_skbuild/macosx-10.14-x86_64-3.10/cmake-install -DPYTHON_VERSION_STRING:STRING=3.10.12 -DSKBUILD:INTERNAL=TRUE -DCMAKE_MODULE_PATH:PATH=/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/skbuild/resources/cmake -DPYTHON_EXECUTABLE:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/bin/python -DPYTHON_INCLUDE_DIR:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/include/python3.10 -DPYTHON_LIBRARY:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/lib/libpython3.10.dylib -DPython_EXECUTABLE:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/bin/python -DPython_ROOT_DIR:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda -DPython_FIND_REGISTRY:STRING=NEVER -DPython_INCLUDE_DIR:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/include/python3.10 -DPython3_EXECUTABLE:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/bin/python -DPython3_ROOT_DIR:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda -DPython3_FIND_REGISTRY:STRING=NEVER -DPython3_INCLUDE_DIR:PATH=/Volumes/OrientalPhase/Programmazione/cheshire-cat-ai/llm-api/.conda/include/python3.10 -DCMAKE_MAKE_PROGRAM:FILEPATH=/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/ninja/data/bin/ninja -DCMAKE_OSX_DEPLOYMENT_TARGET:STRING=10.14 -DCMAKE_OSX_ARCHITECTURES:STRING=x86_64 -DCMAKE_BUILD_TYPE:STRING=Release

      Not searching for unused variables given on the command line.
      -- The C compiler identification is AppleClang 10.0.1.10010046
      -- The CXX compiler identification is AppleClang 10.0.1.10010046
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /Library/Developer/CommandLineTools/usr/bin/cc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Detecting CXX compiler ABI info
      -- Detecting CXX compiler ABI info - done
      -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
      -- Detecting CXX compile features
      -- Detecting CXX compile features - done
      -- CT_INSTRUCTIONS: avx2
      -- CT_CUBLAS: OFF
      -- CT_HIPBLAS: OFF
      -- CT_METAL: OFF
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
      -- Found Threads: TRUE
      -- x86 detected
      -- Accelerate framework found
      -- Configuring done (0.9s)
      -- Generating done (0.0s)
      -- Build files have been written to: /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/_skbuild/macosx-10.14-x86_64-3.10/cmake-build
      [1/7] Building C object CMakeFiles/ctransformers.dir/models/ggml/ggml-alloc.c.o
      FAILED: CMakeFiles/ctransformers.dir/models/ggml/ggml-alloc.c.o
      /Library/Developer/CommandLineTools/usr/bin/cc -DGGML_USE_ACCELERATE -DGGML_USE_K_QUANTS -Dctransformers_EXPORTS -I/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models -F/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/System/Library/Frameworks -O3 -DNDEBUG -std=gnu11 -arch arm64 -arch x86_64 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk -mmacosx-version-min=10.14 -fPIC -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -mfma -mavx2 -mf16c -mavx -MD -MT CMakeFiles/ctransformers.dir/models/ggml/ggml-alloc.c.o -MF CMakeFiles/ctransformers.dir/models/ggml/ggml-alloc.c.o.d -o CMakeFiles/ctransformers.dir/models/ggml/ggml-alloc.c.o -c /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:32:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/cdefs.h:784:2: error: Unsupported architecture
      #error Unsupported architecture
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:33:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_dev_t;         /* dev_t */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'; did you mean 'uint64_t'?
      typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types/_uint64_t.h:31:28: note: 'uint64_t' declared here
      typedef unsigned long long uint64_t;
                                 ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
      typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'
      typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:30:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/types.h:37:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:32:9: error: unknown type name '__darwin_intptr_t'
      typedef __darwin_intptr_t       intptr_t;
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml-alloc.c:5:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdio.h:64:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_stdio.h:71:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_wctype_t;
              ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      [2/7] Building C object CMakeFiles/ctransformers.dir/models/ggml/k_quants.c.o
      FAILED: CMakeFiles/ctransformers.dir/models/ggml/k_quants.c.o
      /Library/Developer/CommandLineTools/usr/bin/cc -DGGML_USE_ACCELERATE -DGGML_USE_K_QUANTS -Dctransformers_EXPORTS -I/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models -F/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/System/Library/Frameworks -O3 -DNDEBUG -std=gnu11 -arch arm64 -arch x86_64 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk -mmacosx-version-min=10.14 -fPIC -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -mfma -mavx2 -mf16c -mavx -MD -MT CMakeFiles/ctransformers.dir/models/ggml/k_quants.c.o -MF CMakeFiles/ctransformers.dir/models/ggml/k_quants.c.o.d -o CMakeFiles/ctransformers.dir/models/ggml/k_quants.c.o -c /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:32:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/cdefs.h:784:2: error: Unsupported architecture
      #error Unsupported architecture
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:33:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_dev_t;         /* dev_t */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'; did you mean 'uint64_t'?
      typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types/_uint64_t.h:31:28: note: 'uint64_t' declared here
      typedef unsigned long long uint64_t;
                                 ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
      typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'
      typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:30:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/types.h:37:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.h:3:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:32:9: error: unknown type name '__darwin_intptr_t'
      typedef __darwin_intptr_t       intptr_t;
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/k_quants.c:5:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:61:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_wctype_t;
              ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      [3/7] Building CXX object CMakeFiles/ctransformers.dir/models/ggml/cmpnct_unicode.cpp.o
      FAILED: CMakeFiles/ctransformers.dir/models/ggml/cmpnct_unicode.cpp.o
      /Library/Developer/CommandLineTools/usr/bin/c++ -DGGML_USE_ACCELERATE -DGGML_USE_K_QUANTS -Dctransformers_EXPORTS -I/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models -F/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/System/Library/Frameworks -O3 -DNDEBUG -std=gnu++11 -arch arm64 -arch x86_64 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk -mmacosx-version-min=10.14 -fPIC -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-multichar -mfma -mavx2 -mf16c -mavx -MD -MT CMakeFiles/ctransformers.dir/models/ggml/cmpnct_unicode.cpp.o -MF CMakeFiles/ctransformers.dir/models/ggml/cmpnct_unicode.cpp.o.d -o CMakeFiles/ctransformers.dir/models/ggml/cmpnct_unicode.cpp.o -c /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:70:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:32:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/cdefs.h:784:2: error: Unsupported architecture
      #error Unsupported architecture
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:70:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:33:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:70:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'; did you mean '__int128_t'?
      typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_dev_t;         /* dev_t */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'; did you mean '__uint128_t'?
      typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
      typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'; did you mean '__uint128_t'?
      typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'; did you mean '__int128_t'?
      typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
              ^
      note: '__uint128_t' declared here
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:70:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_wctype_t;
              ^
      note: '__uint128_t' declared here
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:75:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_size_t.h:31:9: error: unknown type name '__darwin_size_t'
      typedef __darwin_size_t        size_t;
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/cmpnct_unicode.cpp:7:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/vector:269:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/iosfwd:90:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/wchar.h:119:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/wchar.h:76:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_mbstate_t.h:31:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/types.h:37:2: error: architecture not supported
      #error architecture not supported
       ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      [4/7] Building CXX object CMakeFiles/ctransformers.dir/models/llm.cc.o
      FAILED: CMakeFiles/ctransformers.dir/models/llm.cc.o
      /Library/Developer/CommandLineTools/usr/bin/c++ -DGGML_USE_ACCELERATE -DGGML_USE_K_QUANTS -Dctransformers_EXPORTS -I/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models -F/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/System/Library/Frameworks -O3 -DNDEBUG -std=gnu++11 -arch arm64 -arch x86_64 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk -mmacosx-version-min=10.14 -fPIC -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-multichar -mfma -mavx2 -mf16c -mavx -MD -MT CMakeFiles/ctransformers.dir/models/llm.cc.o -MF CMakeFiles/ctransformers.dir/models/llm.cc.o.d -o CMakeFiles/ctransformers.dir/models/llm.cc.o -c /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:32:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/cdefs.h:784:2: error: Unsupported architecture
      #error Unsupported architecture
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:33:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:27:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'; did you mean '__int128_t'?
      typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_dev_t;         /* dev_t */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'; did you mean '__uint128_t'?
      typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
      typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'; did you mean '__uint128_t'?
      typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'; did you mean '__int128_t'?
      typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
      typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
              ^
      note: '__int128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
              ^
      note: '__uint128_t' declared here
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
              ^
      note: '__uint128_t' declared here
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:61:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
      typedef __uint32_t      __darwin_wctype_t;
              ^
      note: '__uint128_t' declared here
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:141:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_rsize_t.h:30:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/types.h:37:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.cc:1:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/llm.h:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/common.h:4:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/algorithm:642:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/cstring:61:
      In file included from /Library/Developer/CommandLineTools/usr/include/c++/v1/string.h:61:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/string.h:141:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_rsize_t.h:31:9: error: unknown type name '__darwin_size_t'
      typedef __darwin_size_t        rsize_t;
              ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      [5/7] Building C object CMakeFiles/ctransformers.dir/models/ggml/ggml.c.o
      FAILED: CMakeFiles/ctransformers.dir/models/ggml/ggml.c.o
      /Library/Developer/CommandLineTools/usr/bin/cc -DGGML_USE_ACCELERATE -DGGML_USE_K_QUANTS -Dctransformers_EXPORTS -I/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models -F/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/System/Library/Frameworks -O3 -DNDEBUG -std=gnu11 -arch arm64 -arch x86_64 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk -mmacosx-version-min=10.14 -fPIC -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -mfma -mavx2 -mf16c -mavx -MD -MT CMakeFiles/ctransformers.dir/models/ggml/ggml.c.o -MF CMakeFiles/ctransformers.dir/models/ggml/ggml.c.o.d -o CMakeFiles/ctransformers.dir/models/ggml/ggml.c.o -c /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:32:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/cdefs.h:784:2: error: Unsupported architecture
      #error Unsupported architecture
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:33:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_dev_t;         /* dev_t */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'; did you mean 'uint64_t'?
      typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types/_uint64_t.h:31:28: note: 'uint64_t' declared here
      typedef unsigned long long uint64_t;
                                 ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:52:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
      typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'
      typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'
      typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'
      typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
              ^
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:30:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/machine/types.h:37:2: error: architecture not supported
      #error architecture not supported
       ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:4:
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.h:198:
      In file included from /Library/Developer/CommandLineTools/usr/lib/clang/10.0.1/include/stdint.h:63:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/stdint.h:53:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_types/_intptr_t.h:32:9: error: unknown type name '__darwin_intptr_t'
      typedef __darwin_intptr_t       intptr_t;
              ^
      In file included from /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/models/ggml/ggml.c:13:
      In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/alloca.h:28:
      /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'
      typedef __uint32_t      __darwin_wctype_t;
              ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      ninja: build stopped: subcommand failed.
      Traceback (most recent call last):
        File "/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/skbuild/setuptools_wrap.py", line 674, in setup
          cmkr.make(make_args, install_target=cmake_install_target, env=env)
        File "/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 697, in make
          self.make_impl(clargs=clargs, config=config, source_dir=source_dir, install_target=install_target, env=env)
        File "/private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 742, in make_impl
          raise SKBuildError(msg)

      An error occurred while building with CMake.
        Command:
          /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-build-env-974mwak6/overlay/lib/python3.10/site-packages/cmake/data/bin/cmake --build . --target install --config Release --
        Install target:
          install
        Source directory:
          /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e
        Working directory:
          /private/var/folders/mk/9f6fbgw1611_skfr_f52h9s40000gn/T/pip-install-q_amp257/ctransformers_7105989d96cb4736b60b32ab0aa0dd6e/_skbuild/macosx-10.14-x86_64-3.10/cmake-build
      Please check the install target is valid and see CMake's output for more information.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for ctransformers
Failed to build ctransformers
ERROR: Could not build wheels for ctransformers, which is required to install pyproject.toml-based projects