Custom context length for every model
Allow to set custom context length for every model. Like when selecting GPT-4 turbo I would like to set context length to 64k instead of default 128k.
Reason (longer context length is losing data):
Allow to set custom context length for every model. Like when selecting GPT-4 turbo I would like to set context length to 64k instead of default 128k.
Reason (longer context length is losing data):
Log in to comment and vote
Comments1
Mar 2, 2024
For this, you can simply create GPT-4 as a new custom model. Then you will be able to set any context length you want.