Shijie Wu
|
ca4baf8ca1
|
Match order of casing in OSS XLM; Improve document; Clean up dependency
|
2019-08-27 20:03:18 -04:00 |
|
Shijie Wu
|
e85123d398
|
Add custom tokenizer for zh and ja
|
2019-08-23 20:27:52 -04:00 |
|
Shijie Wu
|
436ce07218
|
Tokenization behave the same as original XLM proprocessing for most languages except zh, ja and th; Change API to allow specifying language in `tokenize`
|
2019-08-23 14:40:17 -04:00 |
|
LysandreJik
|
fe02e45e48
|
Release: 1.1.0
|
2019-08-15 11:15:08 -04:00 |
|
thomwolf
|
58830807d1
|
inidicate we only support pytorch 1.0.0+ now
|
2019-08-05 14:38:59 +02:00 |
|
thomwolf
|
6b70760204
|
typos
|
2019-07-16 21:21:03 +02:00 |
|
thomwolf
|
ed7549bb1a
|
release version 1.0
|
2019-07-16 16:10:58 +02:00 |
|
thomwolf
|
eb91f6437e
|
update readme and setup
|
2019-07-05 12:30:15 +02:00 |
|
thomwolf
|
0bab55d5d5
|
[BIG] name change
|
2019-07-05 11:55:36 +02:00 |
|
thomwolf
|
32da75486b
|
add tokenizer and tests
|
2019-06-21 11:09:51 +02:00 |
|
thomwolf
|
b832d5bb8a
|
Release: 0.6.2
|
2019-04-25 21:37:47 +02:00 |
|
thomwolf
|
e0855e8929
|
forgot to add regex to requirements :(
|
2019-02-18 11:54:51 +01:00 |
|
thomwolf
|
009ee86a19
|
fix tests - bump up version
|
2019-02-17 23:57:23 +01:00 |
|
thomwolf
|
321d70a7a9
|
bump up to 0.5.1
|
2019-02-13 10:11:20 +01:00 |
|
thomwolf
|
448937c00d
|
python 2 compatibility
|
2019-02-06 00:07:46 +01:00 |
|
thomwolf
|
eed51c5bdf
|
add OpenAI GPT
|
2019-01-08 12:26:58 +01:00 |
|
Patrick Sodré
|
87c1244c7d
|
Convert scripts into entry_points
The recommended approach to create launch scripts is to use entry_points
and console_scripts.
xref: https://packaging.python.org/guides/distributing-packages-using-setuptools/#scripts
|
2018-12-19 02:26:08 +00:00 |
|
thomwolf
|
ae88eb88a4
|
set encoding to 'utf-8' in calls to open
|
2018-12-14 13:48:58 +01:00 |
|
thomwolf
|
1cbb32a542
|
include version number + comment in setup.py
|
2018-12-13 12:50:44 +01:00 |
|
thomwolf
|
ce52177638
|
added version in __init__.py
|
2018-12-13 12:50:44 +01:00 |
|
thomwolf
|
258eb50086
|
bump up version
|
2018-11-30 22:55:33 +01:00 |
|
thomwolf
|
ce37b8e481
|
bump version in setup.py
|
2018-11-26 10:45:48 +01:00 |
|
thomwolf
|
c8cba67742
|
clean up readme and examples
|
2018-11-17 12:19:16 +01:00 |
|
thomwolf
|
a99b971738
|
bump up version minor
|
2018-11-17 10:43:39 +01:00 |
|
thomwolf
|
4e46affc34
|
updating examples
|
2018-11-17 10:30:54 +01:00 |
|
thomwolf
|
f920eff8c3
|
update readme
|
2018-11-17 08:42:45 +01:00 |
|
thomwolf
|
1de35b624b
|
preparing for first release
|
2018-11-15 20:56:10 +01:00 |