This commit is contained in:
Jason Liu
2023-10-25 23:22:22 -04:00
parent 9b967ee787
commit 4c9644266c
+2 -2
View File
@@ -99,8 +99,7 @@ Run a finetune like this:
instructor jobs create-from-file math_finetunes.jsonl
```
## Next Steps and Future Plans
Here's a sneak peek of what I'm planning:
Once a model is trained you can simply change `mode` to `dispatch` and it will use the model to run the function!
```python
from instructor import Instructions
@@ -111,6 +110,7 @@ instructions = Instructions(
@instructions.distil(model='gpt-3.5-turbo:finetuned-123', mode="dispatch")
def fn(a: int, b: int) -> Multiply:
# now this code will be short circuited and the model will be used instead.
resp = a + b
return Multiply(a=a, b=b, result=resp)
```