Adding working combination of LLM and Embedding Model to recipes (#1315)
Co-authored-by: ishaandatta <ishaandatta50@gmail.com>
This commit is contained in:
		
							parent
							
								
									aabdb046ae
								
							
						
					
					
						commit
						28d03fdda8
					
				|  | @ -82,3 +82,14 @@ Situation: tu es au milieu d'un champ. | ||||||
| Tache: va a la rivière, en bas du champ. | Tache: va a la rivière, en bas du champ. | ||||||
| Décrit comment aller a la rivière. | Décrit comment aller a la rivière. | ||||||
| ``` | ``` | ||||||
|  | 
 | ||||||
|  | ### Optimised Models | ||||||
|  | GodziLLa2-70B LLM (English, rank 2 on HuggingFace OpenLLM Leaderboard), bge large Embedding Model (rank 1 on HuggingFace MTEB Leaderboard) | ||||||
|  | `settings-optimised.yaml`: | ||||||
|  | ```yml | ||||||
|  | local: | ||||||
|  |   llm_hf_repo_id: TheBloke/GodziLLa2-70B-GGUF | ||||||
|  |   llm_hf_model_file: godzilla2-70b.Q4_K_M.gguf | ||||||
|  |   embedding_hf_model_name: BAAI/bge-large-en | ||||||
|  |   prompt_style: "llama2" | ||||||
|  | ``` | ||||||
		Loading…
	
		Reference in New Issue