Commit Graph

988 Commits

Author SHA1 Message Date
Joshua Lochner 7c7a100d61 Replace switch statement with object mapping 2023-05-10 01:02:02 +02:00
Joshua Lochner af73c17498 Update JSDoc
`object` -> `Object`
2023-05-10 00:46:01 +02:00
Joshua Lochner b54e3e02f6 Add JSDoc for `_call` methods 2023-05-09 04:10:00 +02:00
Joshua Lochner c4c458c7dd Move `toI64Tensor` function outside class 2023-05-09 02:02:39 +02:00
Joshua Lochner 45031b6e81 Remove redundant `-` char in JSDoc 2023-05-09 01:54:07 +02:00
Joshua Lochner 3d0cd78e83 Update model name in example 2023-05-08 17:16:48 +02:00
Joshua Lochner c0780804aa Add links to submodules in main module entry point 2023-05-08 05:55:13 +02:00
Joshua Lochner b25f19350f Update package.json 2023-05-08 05:44:25 +02:00
Joshua Lochner 4422adb928 Fix `TypedArray` typedef 2023-05-08 05:40:32 +02:00
Joshua Lochner 2b5073f73c Fix type issues 2023-05-08 05:37:48 +02:00
Joshua Lochner 2512693778 Implement preprocessing and postprocessing for SAM models 2023-05-08 04:05:02 +02:00
Joshua Lochner 267ea55e6c Export image utilities from transformers.js 2023-05-07 15:56:58 +02:00
Joshua Lochner 736573481f Add `SamModel` 2023-05-07 15:56:36 +02:00
Joshua Lochner 13b570ce97
Merge pull request #106 from chrislee973/fix-norm-calculation
Fix tensor normalization in EmbeddingsPipeline
2023-05-07 15:54:20 +02:00
chrislee973 d0e93c044b add initial value for reduce 2023-05-06 21:39:18 -07:00
Joshua Lochner 9665c1e2f0 Update LICENSE 2023-05-06 18:03:41 +02:00
Joshua Lochner 403d175190 Reorganize project structure 2023-05-06 16:54:28 +02:00
Joshua Lochner aa910b4098 Update JSDocs 2023-05-06 04:15:12 +02:00
Joshua Lochner 91b91e1e22 Fix failing tests 2023-05-05 00:05:03 +02:00
Joshua Lochner 20b5fdab4a Refactor test suite to fix Jest memory leaks 2023-05-04 23:47:45 +02:00
Joshua Lochner 348398e4ff Update webpack.config.js 2023-05-04 18:55:15 +02:00
Joshua Lochner f6a6519a20 Improve unit testing framework 2023-05-04 18:54:38 +02:00
Joshua Lochner 0cbfaa4bba Remove `node:` prefix for `stream/web` import 2023-05-04 00:41:14 +02:00
Joshua Lochner 81793726e4 Temporarily remove `mobilebert` tokenizer test 2023-05-04 00:01:42 +02:00
Joshua Lochner 5e1395504b Update list of converted models
These can be tracked here: https://huggingface.co/models?other=transformers.js
2023-05-03 23:41:47 +02:00
Joshua Lochner aabf5163fc Differentiate between local and remote testing
This is necessary while we wait for more models to support ONNX weights. In future, we hope to remove the need for separation.

When testing remotely (e.g., GitHub actions), we will load models from the Hugging Face Hub under the username `Xenova`. On the other hand, when testing locally, we will use the model that is exported using the conversion script.
2023-05-03 02:37:08 +02:00
Joshua Lochner b7e21ff474 Replace default models with web-ready versions
These changes will hopefully be reverted once ONNX weights are officially supported (i.e,. are present on official repos)
2023-05-03 02:11:56 +02:00
Joshua Lochner 60f0e62a3c Update versions of Node.js to test on 2023-05-02 22:36:04 +02:00
Joshua Lochner abafbeec95 Allow remote models for testing 2023-05-02 22:27:02 +02:00
Joshua Lochner e37b9e5870 Move `generate-tests` to github workflow 2023-05-02 20:04:36 +02:00
Joshua Lochner ca96c7e6c8 Generate tests before running unit tests 2023-05-02 20:01:19 +02:00
Joshua Lochner 681d291dc9 Fix `ReadableStream` import for Node 16.x 2023-05-02 18:36:15 +02:00
Joshua Lochner 626168bffd Update tests.yml 2023-05-02 18:30:02 +02:00
Joshua Lochner c8c2b35892 Update tests.yml 2023-05-02 18:29:16 +02:00
Joshua Lochner aae36e5c1b Remove test for 14.x 2023-05-02 18:29:05 +02:00
Joshua Lochner 06db0fe7fd Update package-lock.json 2023-05-02 18:27:22 +02:00
Joshua Lochner f0cba36503 Allow ci from docs branch
Will remove later
2023-05-02 18:21:10 +02:00
Joshua Lochner 216d498ab4 Create basic github actions workflow
From: https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-nodejs
2023-05-02 18:14:47 +02:00
Joshua Lochner 508f0003b4 Temporarily disable pipeline tests 2023-05-02 17:59:34 +02:00
Joshua Lochner 54ab260945 Add type acquisition include for jest 2023-05-02 17:16:29 +02:00
Joshua Lochner 4a282bf632 Use interpolation method specified in processor's config 2023-05-02 06:49:54 +02:00
Joshua Lochner 8de18bc1d5 Create hub.test.js 2023-05-02 05:37:39 +02:00
Joshua Lochner 595efc631c Export `PreTrainedModel` from transformers 2023-05-02 05:36:26 +02:00
Joshua Lochner 27c9d8d570 Fix `isDeepEqual` function 2023-05-02 05:20:07 +02:00
Joshua Lochner f67d9642be Move tokenizers test to jest module 2023-05-02 05:19:23 +02:00
Joshua Lochner c29bd79085 Move pipelines test to jest module 2023-05-02 05:18:38 +02:00
Joshua Lochner 25993e7706 Create jest.config.mjs 2023-05-02 05:16:04 +02:00
Joshua Lochner 9a5e8a954b Do not track coverage reports 2023-05-02 05:13:20 +02:00
Joshua Lochner 2e9c789023 Add `docs-preview` script to package.json 2023-05-02 05:12:46 +02:00
Joshua Lochner a861785a10 Use jest for unit testing 2023-05-02 05:12:21 +02:00