diff --git a/.github/ISSUE_TEMPLATE/bug-report.md b/.github/ISSUE_TEMPLATE/bug-report.md
index 0d9439887b..66f7831aea 100644
--- a/.github/ISSUE_TEMPLATE/bug-report.md
+++ b/.github/ISSUE_TEMPLATE/bug-report.md
@@ -5,7 +5,19 @@ about: Submit a bug report to help us improve PyTorch Transformers
 
 ## 🐛 Bug
 
-<!-- A clear and concise description of what the bug is. -->
+<!-- Important information -->
+
+Model I am using (Bert, XLNet....):
+
+Language I am using the model on (English, Chinese....):
+
+The problem arise when using:
+* [ ] the official example scripts: (give details)
+* [ ] my own modified scripts: (give details)
+
+The tasks I am working on is:
+* [ ] an official GLUE/SQUaD task: (give the name)
+* [ ] my own task or dataset: (give details)
 
 ## To Reproduce
 
diff --git a/.github/ISSUE_TEMPLATE/migration.md b/.github/ISSUE_TEMPLATE/migration.md
index 9a8b19dffa..cf0c9a4757 100644
--- a/.github/ISSUE_TEMPLATE/migration.md
+++ b/.github/ISSUE_TEMPLATE/migration.md
@@ -5,20 +5,20 @@ about: Report a problem when migrating from PyTorch-pretrained-Bert to PyTorch-T
 
 ## 📚 Migration
 
-<!-- Give at least the following information -->
+<!-- Important information -->
 
 Model I am using (Bert, XLNet....):
 
+Language I am using the model on (English, Chinese....):
+
 The problem arise when using:
-* [ ] the official example scripts
-* [ ] my own modified scripts
+* [ ] the official example scripts: (give details)
+* [ ] my own modified scripts: (give details)
 
 The tasks I am working on is:
 * [ ] an official GLUE/SQUaD task: (give the name)
 * [ ] my own task or dataset: (give details)
 
-Language I am using the model on (English, Chinese....):
-
 Details of the issue:
 
 <!-- A clear and concise description of the migration issue. If you have code snippets, please provide it here as well. -->