Skip to content

Commit

Permalink
chore: remove step to compile llama.cpp when running locally
Browse files Browse the repository at this point in the history
  • Loading branch information
Avram Tudor committed Oct 10, 2024
1 parent 5f4f694 commit 25c69d6
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,6 @@
if nvcc --version
then
export CUDA_VISIBLE_DEVICES=0
else
cd llama.cpp
make llama-server
cd ..
fi

export LLAMA_N_CTX=44000
Expand Down

0 comments on commit 25c69d6

Please sign in to comment.