transformers/templates
Tommy Chiang a2ef9c5446
Use torch.unique_consecutive to check same element (#13637)
We use `torch.unique` here only to check whether every elements have
the same value.
Therefore, we can use `torch.unique_consecutive` here.

This function eliminates all but the first element from every consecutive
group of equivalent elements.
Like, if we apply this function to `[1, 2, 2, 1]`, it will result in
`[1, 2, 1]`.

As you could see, this is enough for checking whether every elements
have the same value.

Since `torch.unique_consecutive` do less thing, it is much more faster.
On my computer, it is 25x faster on GPU and 15x faster on CPU.
2021-09-24 10:31:23 +02:00
..
adding_a_new_example_script Update namespaces inside torch.utils.data to the latest. (#13167) 2021-08-19 14:29:51 +02:00
adding_a_new_model Use torch.unique_consecutive to check same element (#13637) 2021-09-24 10:31:23 +02:00