transformers.js/tests
Joshua Lochner db9250b3e8
Add sequence post processor (#771)
* Add `Sequence` PostProcessor

Required by https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/

* Support `return_token_type_ids`

* Add llama3 tokenizer to unit tests

* Add test for allowing user to request for token type ids

* Add JSDoc

* Update generate_tests.py
2024-05-23 11:42:24 +02:00
..
data Generate tests before running unit tests 2023-05-02 20:01:19 +02:00
configs.test.js Remove unnecessary imports 2023-05-31 02:06:34 +02:00
generate_tests.py Add sequence post processor (#771) 2024-05-23 11:42:24 +02:00
generation.test.js Improve support of conversational models (#658) 2024-04-11 00:58:50 +02:00
hub.test.js Fix failing tests 2023-05-05 00:05:03 +02:00
init.js Remove GH-specific redirect logic (#630) 2024-03-07 02:47:32 +02:00
maths.test.js Fix channel format when padding non-square images for certain models (#655) 2024-03-20 14:35:30 +02:00
models.test.js Add support for computing CLIP image and text embeddings separately (Closes #148) (#227) 2023-08-01 14:01:04 +02:00
pipelines.test.js Add support for Segformer (#480) 2023-12-27 15:12:07 +02:00
processors.test.js Add mobilevitv2 (#721) 2024-05-02 11:42:44 +02:00
requirements.txt Add support for RoFormer models (#464) 2023-12-26 15:49:11 +02:00
tensor.test.js Fix channel format when padding non-square images for certain models (#655) 2024-03-20 14:35:30 +02:00
test_utils.js Add support for processing non-square images w/ `ConvNextFeatureExtractor` (#503) 2024-01-10 17:04:21 +02:00
tokenizers.test.js Add sequence post processor (#771) 2024-05-23 11:42:24 +02:00
utils.test.js Support reading data from blob URI (#645) 2024-05-08 13:14:50 +02:00