Thanks for taking the time to build this! Awesome initiative.
So I'm stuck here because I did this:
mkdir build && cd build
cmake ..
cmake --build . --config Release
I go back to the root project folder and I download the weights into a weights folder and run the convert script
python convert.py --dir-model ./weights/ --out-dir ./ggml_weights
and all is well. I get the ggml_weights folder.
This is now my directory structure:
.
├── biogpt.cpp
├── biogpt.h
├── bpe.cpp
├── bpe.h
├── build
│ ├── bin
│ ├── CMakeCache.txt
│ ├── CMakeFiles
│ ├── cmake_install.cmake
│ ├── compile_commands.json
│ ├── examples
│ ├── ggml
│ └── Makefile
├── CMakeLists.txt
├── convert.py
├── data
│ ├── nonbreaking_prefixes
│ └── perluniprops
├── examples
│ ├── CMakeLists.txt
│ ├── main
│ └── quantize
├── ggml
│ ├── build.zig
│ ├── ci
│ ├── cmake
│ ├── CMakeLists.txt
│ ├── examples
│ ├── ggml.pc.in
│ ├── include
│ ├── LICENSE
│ ├── README.md
│ ├── requirements.txt
│ ├── scripts
│ ├── src
│ └── tests
├── ggml_weights
│ └── ggml-model.bin
├── mosestokenizer.cpp
├── mosestokenizer.h
├── README.md
└── weights
├── config.json
├── merges.txt
├── pytorch_model.bin
├── README.md
└── vocab.json
Then I go to
cd build/bin
./main -p "trastuzumab" 15:27:19
terminate called after throwing an instance of 'std::runtime_error'
what(): Perl Uniprops file not available.
fish: Job 1, './main -p "trastuzumab"' terminated by signal SIGABRT (Abort)
So for some reason the executable doesn't run and it's missing perl uniprops which are already located in your data folder. But it still doesn't work.
What am I doing wrong?
Thanks for taking the time to build this! Awesome initiative.
So I'm stuck here because I did this:
I go back to the root project folder and I download the weights into a
weightsfolder and run the convert scriptand all is well. I get the
ggml_weightsfolder.This is now my directory structure:
Then I go to
So for some reason the executable doesn't run and it's missing perl uniprops which are already located in your
datafolder. But it still doesn't work.What am I doing wrong?