Commit Graph

1087 Commits

Author SHA1 Message Date
thomwolf b3caec5a56 adding save checkpoint and loading in examples 2018-12-13 12:48:13 +01:00
Thomas Wolf 91aab2a6d3
Merge pull request #116 from FDecaYed/deyuf/fp16_with_apex
Change to use apex for better fp16 and multi-gpu support
2018-12-13 12:32:37 +01:00
Thomas Wolf ffe9075f48
Merge pull request #96 from rodgzilla/multiple-choice-code
BertForMultipleChoice and Swag dataset example.
2018-12-13 12:05:11 +01:00
Deyu Fu c8ea286048 change to apex for better fp16 and multi-gpu support 2018-12-11 17:13:58 -08:00
Thomas Wolf e622790a93
Merge pull request #91 from rodgzilla/convert-examples-code-improvement
run_classifier.py improvements
2018-12-11 05:12:04 -05:00
Grégory Châtel df34f22854 Removing the dependency to pandas and using the csv module to load data. 2018-12-10 17:45:23 +01:00
Grégory Châtel d429c15f25 Removing old code from copy-paste. 2018-12-06 19:19:21 +01:00
Grégory Châtel 63c45056aa Finishing the code for the Swag task. 2018-12-06 18:53:05 +01:00
Grégory Châtel c45d8ac554 Storing the feature of each choice as a dict for readability. 2018-12-06 16:01:28 +01:00
Grégory Châtel 0812aee2c3 Fixing problems in convert_examples_to_features. 2018-12-06 15:53:07 +01:00
Grégory Châtel f2b873e995 convert_examples_to_features code and small improvements. 2018-12-06 15:40:47 +01:00
Grégory Châtel 83fdbd6043 Adding read_swag_examples to load the dataset. 2018-12-06 14:02:46 +01:00
Grégory Châtel 7183cded4e SwagExample class. 2018-12-06 13:39:44 +01:00
Grégory Châtel fa7daa247d Fixing the commentary of the `SquadExample` class. 2018-12-06 13:14:33 +01:00
Grégory Châtel a994bf4076 Fixing related to issue #83. 2018-12-05 18:16:30 +01:00
Grégory Châtel c6d9d5394e Simplifying code for easier understanding. 2018-12-05 17:53:09 +01:00
Grégory Châtel 793262e8ec Removing trailing whitespaces. 2018-12-05 17:52:39 +01:00
Davide Fiocco e60e8a6068
Correct assignement for logits in classifier example
I tried to address https://github.com/huggingface/pytorch-pretrained-BERT/issues/76
should be correct, but there's likely a more efficient way.
2018-12-02 12:38:26 +01:00
Davide Fiocco dc13e276ee
Point typo fix 2018-12-01 01:02:16 +01:00
thomwolf 89d47230d7 clean up classification model output 2018-11-30 22:54:53 +01:00
thomwolf c588453a0f fix run_squad 2018-11-30 14:22:40 +01:00
thomwolf 0541442558 add do_lower_case in examples 2018-11-30 13:47:33 +01:00
Li Li 0aaedcc02f Bug fix in examples;correct t_total for distributed training;run prediction for full dataset 2018-11-27 01:08:37 -08:00
thomwolf 32167cdf4b remove convert_to_unicode and printable_text from examples 2018-11-26 23:33:22 +01:00
thomwolf 05053d163c update cache_dir in readme and examples 2018-11-26 10:45:13 +01:00
thomwolf 6b2136a8a9 fixing weights decay in run_squad example 2018-11-20 10:12:44 +01:00
Thomas Wolf 061eeca84a
Merge pull request #32 from xiaoda99/master
Fix ineffective no_decay bug when using BERTAdam
2018-11-20 10:11:46 +01:00
thomwolf 2f21497d3e fixing param.grad is None in fp16 examples 2018-11-20 10:01:21 +01:00
xiaoda99 6c4789e4e8
Fix ineffective no_decay bug 2018-11-18 16:16:21 +08:00
thomwolf 27ee0fff3c add no_cuda args in extract_features 2018-11-17 23:04:44 +01:00
thomwolf aa50fd196f remove unused arguments in example scripts 2018-11-17 23:01:05 +01:00
thomwolf 47a7d4ec14 update examples from master 2018-11-17 12:21:35 +01:00
thomwolf c8cba67742 clean up readme and examples 2018-11-17 12:19:16 +01:00
thomwolf 757750d6f6 fix tests 2018-11-17 11:58:14 +01:00
thomwolf 4e46affc34 updating examples 2018-11-17 10:30:54 +01:00
thomwolf cba85a67b9 fix nan in optimizer_on_cpu 2018-11-15 21:47:41 +01:00
thomwolf 1de35b624b preparing for first release 2018-11-15 20:56:10 +01:00