aditya/llama.cpp
1
0
Fork 0
mirror of https://git.adityakumar.xyz/llama.cpp.git synced 2024-11-09 23:29:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
730 commits 1 branch 0 tags 4.1 MiB
Commit graph

53 commits

Author SHA1 Message Date
Georgi Gerganov
f5a77a629b
Introduce C-style API (#370) 
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
 2023-03-22 07:32:36 +02:00
hoangmit
6eac39ba95
Add RMS norm and use it (#187) 
* add ggml_rms_norm

* update op num
 2023-03-16 00:41:38 +02:00
Georgi Gerganov
26c0846629
Initial release 2023-03-10 20:56:40 +02:00