mirror of https://github.com/hwchase17/langchain
Add RoPE Scaling params from llamacpp (#8422)
Description: Just adding parameters from `llama-python-cpp` that support RoPE scaling. @hwchase17, @baskaryan sources: papers and explanation: https://kaiokendev.github.io/context llamacpp conversation: https://github.com/ggerganov/llama.cpp/discussions/1965 Supports models like: https://huggingface.co/conceptofmind/LLongMA-2-13bpull/7494/head
parent
2db2987b1b
commit
e0de62f6da
Loading…
Reference in New Issue