Joshua Lochner
cdbc532cf6
Update dependencies ( #702 )
...
* Bump vite from 4.5.2 to 4.5.3 in /examples/tokenizer-playground (#693 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 4.5.2 to 4.5.3.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v4.5.3/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v4.5.3/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump express from 4.18.2 to 4.19.2 (#666 )
Bumps [express](https://github.com/expressjs/express ) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2 )
---
updated-dependencies:
- dependency-name: express
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.0.12 to 5.0.13 in /examples/remove-background-client (#694 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.12 to 5.0.13.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.13/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.13/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.0.12 to 5.0.13 in /examples/zero-shot-classification (#695 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.12 to 5.0.13.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.13/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.13/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.0.12 to 5.0.13 in /examples/depth-anything-client (#696 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.12 to 5.0.13.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.13/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.13/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.0.12 to 5.0.13 in /examples/semantic-audio-search (#697 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.12 to 5.0.13.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.13/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.13/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 4.5.2 to 4.5.3 in /examples/code-completion (#698 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 4.5.2 to 4.5.3.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v4.5.3/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v4.5.3/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.1.4 to 5.1.7 in /examples/video-object-detection (#699 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.1.4 to 5.1.7.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.1.7/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.1.7/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.1.1 to 5.1.7 in /examples/cross-encoder (#700 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.1.1 to 5.1.7.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.1.7/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.1.7/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump vite from 5.1.1 to 5.1.7 in /examples/adaptive-retrieval (#701 )
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.1.1 to 5.1.7.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.1.7/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.1.7/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 16:07:58 +02:00
Jonathan Padilla
f71ee32dd9
Add binary embedding quantization support to FeatureExtraction pipeline ( #691 )
...
* Add binary embedding quantization support to FeatureExtraction pipeline
* Add JSDoc return type
* Apply suggestions from code review
* Update src/utils/tensor.js
* Update example code snippet
* Update src/pipelines.js
---------
Co-authored-by: Joshua Lochner <admin@xenova.com>
2024-04-10 15:13:36 +02:00
dependabot[bot]
8804c36591
Bump ip from 2.0.0 to 2.0.1 in /examples/electron ( #665 )
...
Bumps [ip](https://github.com/indutny/node-ip ) from 2.0.0 to 2.0.1.
- [Commits](https://github.com/indutny/node-ip/compare/v2.0.0...v2.0.1 )
---
updated-dependencies:
- dependency-name: ip
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-26 22:45:55 +02:00
dependabot[bot]
3509fc405b
Bump webpack-dev-middleware from 5.3.3 to 5.3.4 ( #661 )
...
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware ) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases )
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md )
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4 )
---
updated-dependencies:
- dependency-name: webpack-dev-middleware
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-26 15:49:41 +02:00
Joshua Lochner
d50b3193fb
[version] Update to 2.16.1
2024-03-20 16:44:39 +02:00
Joshua Lochner
4cab8eceb6
Add `image-feature-extractor` pipeline ( #650 )
...
* Add `image-feature-extractor` pipeline
* Update "Image Feature Extraction" heading
2024-03-20 15:30:27 +02:00
Joshua Lochner
f0ef2e8eee
Update tokenizer `apply_chat_template` functionality ( #647 )
...
* Allow custom kwargs in `tokenizer.apply_chat_template`
* Update jinja dependency version
* Add `tokenizer_kwargs` options
* Add support for dictionaries of chat templates in the tokenizer config
* Add `CohereTokenizer`
* `apply_chat_template` is no longer async
* Add unit test for multiple chat templates
* Update tokenizers.js
* Also update when `chat_template` is undefined
* Support setting tokenizer and text from URL
* Update Claude tokenizer display name
* Add Cohere Command-R tokenizer to playground
* Add `Grok1Tokenizer`
* Throw error if chat template object is malformed
* Improved error checking
* Remove redundant error check
* `template_dict` can be a null-prototype object
2024-03-20 15:22:01 +02:00
Joshua Lochner
40cdd36597
Fix channel format when padding non-square images for certain models ( #655 )
...
* Add tensor permute unit tests
* Rename transpose -> permute
* Fix padding for non-square images
* Add vitmatte padding unit test
* Create `RawImage.toTensor` helper function
* Add bankers rounding test case
* `.toBe()` -> `.toBeCloseTo()` for floating point numbers
2024-03-20 14:35:30 +02:00
dependabot[bot]
8c731fa54b
Bump follow-redirects from 1.15.4 to 1.15.6 ( #652 )
...
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects ) from 1.15.4 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases )
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.4...v1.15.6 )
---
updated-dependencies:
- dependency-name: follow-redirects
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-19 00:17:47 +02:00
Joshua Lochner
a51a61be22
Add support for EfficientNet ( #639 )
...
* Add support for efficientnet
* Add `EfficientNetImageProcessor`
2024-03-16 14:49:32 +02:00
Joshua Lochner
314b7f0dc4
[version] Update to 2.16.0
2024-03-07 15:45:22 +02:00
Dave
8eef154b1e
Add WavLM- & Wav2Vec2ForAudioFrameClassification support ( #611 )
...
* Add WavLMForXVector support
* fix model docs
* Add WavLMForAudioFrameClassification
* Add missing wWav2Vec2ForAudioFrameCl.
* Add doc comment
* Add doc string wav2vec2
* update comment
* make example like python
* Update src/models.js
---------
Co-authored-by: Joshua Lochner <admin@xenova.com>
2024-03-07 15:27:49 +02:00
Dave
5bb8d25337
Add StableLM support ( #616 )
...
* add stablelm model impl.
* add stablelm mapping
* Update `StableLMPreTrainedModel` class config
* Update stablelm conversion script quantization settings
* Add StableLm to list of supported models
* Remove StableLMForSequenceClassification
will be added in seperate PR
Co-authored-by: Joshua Lochner <admin@xenova.com>
* Remove SequenceClassifierOutputWithPast
will be added in seperate PR
Co-authored-by: Joshua Lochner <admin@xenova.com>
* Remove StableLMForSequenceClassification mapping
will be added in seperate pr
Co-authored-by: Joshua Lochner <admin@xenova.com>
* Update src/models.js
* Naming nit
* Naming nits
* Update scripts/convert.py
* Update src/models.js
---------
Co-authored-by: Joshua Lochner <admin@xenova.com>
2024-03-07 03:05:27 +02:00
Joshua Lochner
dab1b8139f
Remove GH-specific redirect logic ( #630 )
2024-03-07 02:47:32 +02:00
Joshua Lochner
8694a856ee
Bump `@huggingface/jinja` ( #629 )
2024-03-07 01:59:06 +02:00
Joshua Lochner
382ff3af35
Create cross-encoder demo ( #617 )
2024-03-06 17:31:57 +02:00
Joshua Lochner
e072ee6b70
Add support for starcoder2 models ( #622 )
2024-03-06 13:09:04 +02:00
Joshua Lochner
5f572241b4
Add support for `UniSpeech` and `UniSpeechSat` models ( #624 )
...
* Add support for `UniSpeech` and `UniSpeechSat` models
* Remove listed support for unispeech STT models
* Align unispeech w/ existing wav2vec logic
2024-03-06 13:08:28 +02:00
Joshua Lochner
2e53f51ce7
Update `@huggingface/jinja` -> 0.2.0 ( #627 )
2024-03-05 17:04:08 +02:00
Joshua Lochner
55a4a69491
Check for existence of `onnx_env.wasm` before updating wasmPaths ( #621 )
2024-03-05 17:03:25 +02:00
Joshua Lochner
d525c8bfd4
Add Claude 3 + Mistral to tokenizer playground
2024-03-05 00:52:12 +02:00
Joshua Lochner
ce4fd62202
Update tokenizer playground dependencies ( #599 )
...
* Update transformers.js version
* Update Token.jsx
2024-03-05 00:42:37 +02:00
Dave
b5a548fc65
Add support for `WavLMForXVector` ( #603 )
...
* Add WavLMForXVector support
* fix model docs
* fix bad naming
* Apply suggestions from code review
* Update default `wavlm` quantization settings
* Update list of supported `wavlm` models
* Update JSDoc
* Fix typo
---------
Co-authored-by: Joshua Lochner <admin@xenova.com>
2024-02-28 21:24:41 +02:00
Joshua Lochner
271c6f1744
Create video object detection demo ( #607 )
2024-02-27 19:35:12 +02:00
Joshua Lochner
7772d1db0a
[version] Update to 2.15.1
2024-02-21 16:26:05 +02:00
Joshua Lochner
68ed7f6cbb
Add Gemma Tokenizer ( #598 )
...
* Fix styling for whitespace tokens
* Add `GemmaTokenizer`
* Update minimum `@huggingface/jinja` version
* Add Gemma to tokenizer playground
* Add Gemma tokenizer unit test
* Update tokenizer names in playground
* Update Gemma tokenizer test
2024-02-21 16:22:22 +02:00
Joshua Lochner
6d2808b571
Create adaptive retrieval demo ( #587 )
...
* Create adaptive retrieval demo
* Remove waiting label
2024-02-21 15:16:51 +02:00
Joshua Lochner
d1eabaeb0b
Update tokenizer playground ( #597 )
...
* Update transformers.js version
* Remove unused images
* Remove link to placeholder image
2024-02-21 14:04:11 +02:00
Joshua Lochner
5ac17bda83
Add support for OWLv2 models ( #579 )
2024-02-19 14:57:06 +02:00
Joshua Lochner
e9092d2337
Add basic 2D `layer_norm` operator ( #588 )
2024-02-19 14:53:06 +02:00
Joshua Lochner
351dbed922
Add support for exporting custom models ( #556 )
...
* Add support for exporting custom models
* Require task to be specified
* Pass `trust_remote_code` to all `from_pretrained` calls.
* Add support for `nomic_bert`
Prevents unsupported model warnings
2024-02-19 14:23:27 +02:00
Joshua Lochner
66d59d79d4
Add remove-background demo ( #576 )
...
* Add remove-background demo
* Open links in new tab
* Add mention of running locally
2024-02-07 14:31:52 +02:00
Joshua Lochner
41f98b761f
[version] Update to 2.15.0
2024-02-06 15:06:50 +02:00
Joshua Lochner
dbeb314323
Update `jsdoc-to-markdown` dev dependency ( #574 )
2024-02-06 14:59:51 +02:00
Joshua Lochner
2bd8c78aec
Support `size_divisbility` after resizing ( #569 )
2024-02-06 13:10:12 +02:00
Joshua Lochner
ae7af0a6c2
Add support for Qwen2 models ( #570 )
...
* Add support for `Qwen2Tokenizer`
* Add qwen-specific tokenizer unit test
* Add support for qwen2 models
* Fix typo
2024-02-06 12:44:30 +02:00
Joshua Lochner
a6f3f88231
Improve unknown model warnings ( #554 )
...
Warn with model type if known
2024-02-05 17:35:49 +02:00
Joshua Lochner
2b3dcb1863
Use absolute links for example code ( #550 )
2024-02-01 17:00:56 +02:00
Joshua Lochner
9f877eea95
[version] Update to 2.14.2
2024-01-29 14:02:11 +02:00
dependabot[bot]
9f37036731
Bump vite from 5.0.11 to 5.0.12 in /examples/zero-shot-classification ( #548 )
...
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.11 to 5.0.12.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.12/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.12/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 13:45:22 +02:00
Joshua Lochner
1edf683e64
Add zero-shot classification demo ( #519 )
...
* Create zero-shot-classification demo
* Update hypothesis template
2024-01-29 12:29:33 +02:00
Joshua Lochner
b1f96a2fc9
Add support for wav2vec2-bert ( #544 )
...
* Add povey window function
* Add `SeamlessM4TFeatureExtractor`
* Add support for wav2vec2-bert models
* Add `SeamlessM4TFeatureExtractor` processor unit tests
* Add pipeline support for `wav2vec2-bert` models
* Update JSDoc
2024-01-27 17:50:03 +02:00
Joshua Lochner
03f2763a27
Add whitespace pretokenizer ( #542 )
...
* Add `WhitespacePreTokenizer`
* Add unit test for `Whitespace` pretokenizer
2024-01-27 15:13:20 +02:00
Joshua Lochner
497628ff07
Create depth anything demo ( #540 )
2024-01-25 17:58:40 +02:00
Joshua Lochner
a2fcd110a3
[version] Update to 2.14.1
2024-01-25 15:26:57 +02:00
Joshua Lochner
587adfc193
Add support for Depth Anything ( #534 )
...
* Add support for `DPTImageProcessor`
* Add support for depth anything model
* Update list of `depth_anything` models
* Update processor test model id
2024-01-25 15:21:51 +02:00
dependabot[bot]
4fb23f2fd1
Bump vite from 4.5.1 to 4.5.2 in /examples/tokenizer-playground ( #538 )
...
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 4.5.1 to 4.5.2.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v4.5.2/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v4.5.2/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-25 15:18:54 +02:00
dependabot[bot]
544c2c2f9d
Bump vite from 5.0.6 to 5.0.12 in /examples/semantic-audio-search ( #537 )
...
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 5.0.6 to 5.0.12.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v5.0.12/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v5.0.12/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-25 15:18:29 +02:00
dependabot[bot]
9d7fb85167
Bump vite from 4.5.1 to 4.5.2 in /examples/code-completion ( #536 )
...
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite ) from 4.5.1 to 4.5.2.
- [Release notes](https://github.com/vitejs/vite/releases )
- [Changelog](https://github.com/vitejs/vite/blob/v4.5.2/packages/vite/CHANGELOG.md )
- [Commits](https://github.com/vitejs/vite/commits/v4.5.2/packages/vite )
---
updated-dependencies:
- dependency-name: vite
dependency-type: direct:development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-25 15:18:18 +02:00
Joshua Lochner
4a6addab69
Return empty tokens array if text is empty after normalization ( #535 )
2024-01-25 14:40:56 +02:00