OpenHermes 2.5 Mistral 7B
teknium/openhermes-2.5-mistral-7b
Poids du modèleA continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite. It did however reduce BigBench benchmark score, but the net gain overall is significant.
Modalités
Contexte
4K
Publié
20 nov. 2023
Date limite des connaissances
sept. 2023
Actuellement indisponible via le routage dans la région UE. Documentation sur le routage intrarégional