wzy
45a1b07e9b
flake : update flake.nix ( #2270 )
...
When `isx86_32 || isx86_64`, it will use mkl, else openblas
According to
https://discourse.nixos.org/t/rpath-of-binary-contains-a-forbidden-reference-to-build/12200/3 ,
add -DCMAKE_SKIP_BUILD_RPATH=ON
Fix #2261 , Nix doesn't provide mkl-sdl.pc.
When we build with -DBUILD_SHARED_LIBS=ON, -DLLAMA_BLAS_VENDOR=Intel10_lp64
replace mkl-sdl.pc by mkl-dynamic-lp64-iomp.pc
2023-07-19 10:01:55 +03:00
Dave Della Costa
a6803cab94
flake : add runHook preInstall/postInstall to installPhase so hooks function ( #2224 )
2023-07-14 22:13:38 +03:00
Rowan Hart
fdd1860911
flake : fix ggml-metal.metal path and run nixfmt ( #1974 )
2023-06-24 14:07:08 +03:00
Faez Shakil
fc45a81bc6
exposed modules so that they can be invoked by nix run github:ggerganov/llama.cpp#server etc ( #1863 )
2023-06-17 14:13:05 +02:00
Andrei
303f5809f1
metal : fix issue with ggml-metal.metal path. Closes #1769 ( #1782 )
...
* Fix issue with ggml-metal.metal path
* Add ggml-metal.metal as a resource for llama target
* Update flake.nix metal kernel substitution
2023-06-10 17:47:34 +03:00
jacobi petrucciani
5b57a5b726
flake : update to support metal on m1/m2 ( #1724 )
2023-06-07 07:15:31 +03:00
Pavol Rusnak
bb98e77be7
nix: use convert.py instead of legacy wrapper convert-pth-to-ggml.py ( #981 )
2023-04-25 23:19:57 +02:00
Pavol Rusnak
a32f7acc9f
py : cleanup dependencies ( #962 )
...
after #545 we do not need torch, tqdm and requests in the dependencies
2023-04-14 15:37:11 +02:00
Pavol Rusnak
c729ff730a
flake.nix: add all binaries from bin ( #848 )
2023-04-13 15:49:05 +02:00
lon
317fb12fbd
Add new binaries to flake.nix ( #847 )
2023-04-08 12:04:23 +02:00
Ben Siraphob
a18c19259a
Fix Nix build
2023-03-23 17:51:26 +01:00
Ben Siraphob
bd4b46d6ba
Nix flake: set meta.mainProgram to llama
2023-03-20 22:50:22 +01:00
Niklas Korz
a292747893
Nix flake ( #40 )
...
* Nix flake
* Nix: only add Accelerate framework on macOS
* Nix: development shel, direnv and compatibility
* Nix: use python packages supplied by withPackages
* Nix: remove channel compatibility
* Nix: fix ARM neon dotproduct on macOS
---------
Co-authored-by: Pavol Rusnak <pavol@rusnak.io>
2023-03-17 23:03:48 +01:00