dnrops
/
sqlcoder
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

This commit is contained in:
Rishabh Srivastava 2023-08-18 14:33:00 +08:00 committed by GitHub
parent 1171755544
commit 7f812f0329
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -22,6 +22,8 @@ Defog was trained on 10,537 human-curated questions across 2 epochs. These quest
Training happened in 2 phases. The first phase was on questions that were classified as "easy" or "medium" difficulty, and the second phase was on questions that were classified as "hard" or "extra hard" difficulty. You can read more about the dataset creation and classification process [here](https://defog.ai/blog/defog-sql-coder-dataset-creation).
The results of our "easy" data were stored in a model called `defog-easy`. We found that the additional training on "hard" led to a 7 percentage point increase in performance.
## Results by question category
We classified each generated question into one of 5 categories. These are the percentage of questions that each model got correct for each category
| query_category | gpt-4 | defog-sql-coder | gpt-3.5-turbo | defog-easy | text-davinci-003 | wizard-coder | star-coder |