Commit Graph

734 Commits

Author SHA1 Message Date
David Chavez f73136e3df
chore(candle): Allow enabling accelerate (#1009)
* chore(candle): Allow enabling accelerate

* Temporarily disable test for accelerate feature

* Allow enabling accelerate from upstream

* Update the README

* Have xtask also test using accelerate

* Renable failing test

* Fix matmul on candle when using accelerate

* Add additional comment to xtask method
2023-11-30 13:03:00 -05:00
Luni-4 1d4e91ad32
ci/Vulnerabilities checker (#964)
* ci: Add vulnerabilities checker

* Fix

* Fix

* Fix

* More options

* Schedule vulnerabilities

* Remove
2023-11-30 13:01:34 -05:00
Will Brickner 03af140e12
Implement Quiet Softmax (`Attention Is Off By One`) (#692)
* Added quiet_softmax

* Undid bad formatting

---------

Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2023-11-30 12:58:30 -05:00
David Chavez f0c75aa748
chore(ci): run workflow on macOS (#1010) 2023-11-29 16:19:11 -05:00
Dilshod Tadjibaev fed618b265
Add Cos, Exp, Gelu, Log and Neg unary ONNX ops (#1013)
* Add ONNX Cos OP

* Add ONNX Exp OP

* Add ONNX Gelu OP

* Add ONNX Log OP

* Allow approx_constant clippy rule in generated model code

* Add ONNX Neg OP

* Fix tests with custom imports for unary nodes

* Add scalar tests for Sqrt
2023-11-29 14:57:52 -06:00
Maksym Hazevych 87393b2070
Updated explanation to match code (#1012)
Updated the explanation at the beginning to match the actual changes to 'Cargo.toml'. Moved down the 'edition' property to match the style of the initial 'Cargo.toml' file. Removed unnecessary comment for a self-explanatory piece of code. Some rewording.
2023-11-29 09:41:07 -05:00
David Chavez fda9e5d388
feature(tensor): Add triu and tril ops (#1002) 2023-11-29 09:39:42 -05:00
Louis Fortier-Dubois aa3180d0c7
fix/docs/chunk (#1006) 2023-11-29 09:38:43 -05:00
Luni-4 3301aedcc3
Ci/Update dependabot (#1003) 2023-11-29 09:04:15 -05:00
David Chavez 60c24430c6
chore(tests): allow overriding autographics backend (#1005) 2023-11-27 13:58:43 -05:00
David Chavez 929b1786bb
feature(tensor): Add chunk op (#998) 2023-11-27 09:58:43 -05:00
David Chavez 2fdf9a3591
feature(tensor): Add Tensor::stack (#1004) 2023-11-27 09:57:31 -05:00
Granville Schmidt d0cb7205fa
fix typo in basic-workflow training (#1000) 2023-11-27 09:37:29 -05:00
David Chavez 2928657622
chore(tensors): fix narrow error messages (#997) 2023-11-24 15:13:07 -05:00
Zsombor e9f4680153
Fix handling of the dimension parameter in max_dim/min_dim (#995)
And add a couple of tests
2023-11-24 13:04:29 -05:00
David Chavez f09baadfc5
feature(tensor): Add narrow op (#996)
* Add narrow methods

* Revert "Add narrow methods"

This reverts commit 9371d87c79.

* Implement a shared version of narrow

* Correct test case

* Update book

* Improve tests
2023-11-24 08:24:06 -05:00
Louis Fortier-Dubois e5e4771d6e
Fix discord link 2023-11-24 07:26:47 -05:00
Louis Fortier-Dubois 58273a8441
Feat/fusion/cmp (#992) 2023-11-23 12:52:37 -05:00
Edmondo Porcu b86bc58761
Implementing ONNX support for sqrt (#991)
* Implementing ONNX support for sqrt

* Formatting, my bad

* Implementing feedback from pull request

* Fixing codegen

* Fixing tests

* Fixing tests
2023-11-22 16:12:35 -06:00
Louis Fortier-Dubois 17f59057d6
Feat/backend comparison/persistence (#979)
* setting up

* wip

* persistence works

* cleanup

* clippy

* run checks

* Cleanup

* reverse json order

---------

Co-authored-by: nathaniel <nathaniel.simard.42@gmail.com>
2023-11-22 11:50:27 -05:00
Nathaniel Simard 630044e96b
Fix/devices api (#990) 2023-11-22 10:24:24 -05:00
Nathaniel Simard 3d6c738776
Refactor/fusion/graph (#988) 2023-11-22 09:55:42 -05:00
Sylvain Benner 682e7bcbea
Fix SQLite tests on Windows (#989)
* Fix sqlite tests on Windows platform

Drop the connection pool so that the database can be persisted.
2023-11-22 09:55:00 -05:00
Dilshod Tadjibaev be5bb33788
Update getting-started.md (#987)
Fixes #828
2023-11-21 17:40:40 -05:00
Nathaniel Simard cabbaab0c4
Fix/constant tensors (#984)
* Generalize autodiff tensor

* Can have int const module

* Update example

* Support no-std with burn-import

* Fix typos

* Fix alloc problems

* Revert burn-import changes

* Fix examples

* Support Int and Bool Params

* Fix

* Add comment
2023-11-21 15:27:28 -06:00
Sylvain Benner 2f079e991b
Fix burn version in the Burn book snippet (#985)
The book assumes the latest version which is 0.10.0 at the time of this commit.
2023-11-21 15:59:25 -05:00
Dilshod Tadjibaev 445f41bb7b
Support count_include_pad attr in avg_pool2d ONNX (#978)
Fixes #636
2023-11-21 12:21:12 -06:00
Dilshod Tadjibaev cb616ed72c
Fix image classifier build failure by upgrading versions (#967) 2023-11-21 09:28:56 -05:00
David Chavez 88b442015d
feature(norm): Add GroupNorm (#963)
* Add GroupNorm

* Fix implemenation and add tests

* Address PR comments

* Fix formatting

* Update burn book
2023-11-21 09:22:56 -05:00
Louis Fortier-Dubois 4711db0e18
bump candle to 0.3.1 and conv_transpose_1d (#977) 2023-11-21 09:13:19 -05:00
Luni-4 cdf54d0b40
ci: Use Ubuntu 22.04 instead of latest version (#974) 2023-11-20 16:07:13 -06:00
Dilshod Tadjibaev 5845790f5c
Disable udeps checking till all unused deps are resolved (#969) 2023-11-20 16:46:26 -05:00
Dilshod Tadjibaev 8c235d6d94
Add a checklist to update book if needed (#972) 2023-11-20 11:02:48 -05:00
David Chavez 49e16b6834
feature(tensor): Add unsqueeze_dim helper (#966) 2023-11-20 10:29:40 -05:00
Rodrigo Pandini 20e9066b57
fix with_file_checkpointer use in training example (#973) 2023-11-20 09:17:29 -05:00
Jean-Gab e5c6044062
doc(burn-tensor): Add examples to slice operation to help noobs like me understand what it does (#880)
* doc(burn-tensor): Add examples to slice operation to help noobs like me understand what it does

* doc(burn-tensor): Improve slice documentation with more comments and clearer examples

* Fix formatting

* Fix typo.

---------

Co-authored-by: jeangab <jg@nationtech.io>
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2023-11-19 23:13:56 -06:00
Luni-4 445603401d
ci/Check dependencies (#895) 2023-11-19 10:35:03 -05:00
Nathaniel Simard 8f1526b9c9
Update readme (#962) 2023-11-17 13:04:41 -05:00
Luni-4 ec9df53d4c
ci/Fix `cargo clippy` action (#942) 2023-11-16 19:35:38 -05:00
Nathaniel Simard 945014b7f1
Add new backend comparison benchmark (#958)
* Add new benchmark

* Remove bad comment

* Add more gelu
2023-11-16 08:15:21 -05:00
Zsombor c0859dde59
Implement fusing for recip() (#959) 2023-11-15 17:15:01 -05:00
Nathaniel Simard 24014aca33
WGPU: Support elemwise operation fusion (#948) 2023-11-15 15:13:37 -05:00
Zsombor 4fc0c27e31
Implement tensor.recip() function to calculate elementwise reciprocals (#953) 2023-11-15 09:17:32 -05:00
Dilshod Tadjibaev e882d41f8b
Use updated serde_rusqlite version (MIT/Apache2 license) (#956)
fixes #719
2023-11-14 19:03:07 -05:00
chenkun 2614944afa
fix approximately equal precision issue in test code (#954) 2023-11-13 15:35:24 -05:00
Louis Fortier-Dubois 4d63a24e19
fix clippy (#955) 2023-11-13 15:30:07 -05:00
Ariel Cohen cb4c23b39d
add gather (#947) 2023-11-13 08:12:00 -05:00
Louis Fortier-Dubois 831335ac2e
Perf/wgpu/reduce dim (#943)
* new reduce half working

* surprisingly working

* good on elongated matrix, bad on balanced ones

* working and clean

* autotune not tested, tests fail at non contiguous

* fixed

* autotune tested

* mean dim

* some fixes

* clippy
2023-11-13 07:20:50 -05:00
Dilshod Tadjibaev f53ab06efc
Pin candle-core version to "0.3.0" version (#950)
Candle core 0.3.1 release contains a breaking changes so this is a workaround to pin to "0.3.0".
2023-11-12 17:56:30 -05:00
dengelt e255472826
Fix typos (#949) 2023-11-12 15:08:39 -05:00