1.8 KiB
1.8 KiB
Exporting 🤗 Transformers models to ONNX
🤗 Transformers provides a transformers.onnx
package that enables you to
convert model checkpoints to an ONNX graph by leveraging configuration objects.
See the guide on exporting 🤗 Transformers models for more details.
ONNX Configurations
We provide three abstract classes that you should inherit from, depending on the type of model architecture you wish to export:
- Encoder-based models inherit from [
~onnx.config.OnnxConfig
] - Decoder-based models inherit from [
~onnx.config.OnnxConfigWithPast
] - Encoder-decoder models inherit from [
~onnx.config.OnnxSeq2SeqConfigWithPast
]
OnnxConfig
autodoc onnx.config.OnnxConfig
OnnxConfigWithPast
autodoc onnx.config.OnnxConfigWithPast
OnnxSeq2SeqConfigWithPast
autodoc onnx.config.OnnxSeq2SeqConfigWithPast
ONNX Features
Each ONNX configuration is associated with a set of features that enable you to export models for different types of topologies or tasks.
FeaturesManager
autodoc onnx.features.FeaturesManager