add info for tgi

README.md

@@ -32,7 +32,7 @@ Available models:
 
 Llama-7B with function calling is licensed according to the Meta Community license.
 
-Llama-13B with function calling is commercially licensed.
+Llama-13B and Code-llama-34b with function calling are commercially licensed.
 - Commercial license per user.
 - Licenses are not transferable to other users/entities.
 
@@ -42,6 +42,23 @@ Use of all Llama models with function calling is further subject to terms in the
 
 The dataset used for training this model can be found at [Trelis Function Calling Extended Dataset](https://huggingface.co/datasets/Trelis/function_calling_extended).
 
+## Inference
+
+**Quick Start in Google Colab**
+Try out this notebook [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing)
+
+**Commercial Applications**
+You can this model with [text-generation-interface](https://github.com/huggingface/text-generation-inference) and [chat-ui](https://github.com/huggingface/chat-ui)
+
+Here is the [github for setup](https://github.com/TrelisResearch/tgi-chat-ui-function-calling)
+
+And here is a video showing it working with [llama-2-7b-chat-hf-function-calling-v2](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling-v2) (note that we've now moved to v2)
+
+Note that you'll still need to code the server-side handling of making the function calls (which obviously depends on what functions you want to use).
+
+**Run on your laptop**
+Run on your laptop [video and juypter notebook](https://youtu.be/nDJMHFsBU7M)
+
 ## Syntax
 
 ### Prompt Templates
@@ -140,19 +157,6 @@ It is recommended to handle cases where:
 }
 ```
 
-## Inference
-
-**Quick Start in Google Colab**
-Try out this notebook [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing)
-
-**Commercial Applications**
-Recommend running this model with [text-generation-interface](https://github.com/huggingface/text-generation-inference) and [chat-ui](https://github.com/huggingface/chat-ui)
-
-*While the model runs with tgi, it does not respond to functions as expected. Please get in touch with ronan [at] trelis dot com if you are interested in this functionality.*
-
-**Run on your laptop**
-Run on your laptop [video and juypter notebook](https://youtu.be/nDJMHFsBU7M)
-
 ~
 
 Below follows information on the original Llama 2 model...