SeleniumBase/README.md

647 lines
34 KiB
Markdown
Raw Normal View History

2019-01-21 08:02:50 +08:00
[<img src="https://cdn2.hubspot.net/hubfs/100006/images/super_logo_3.png" title="SeleniumBase" height="48">](https://github.com/seleniumbase/SeleniumBase/blob/master/README.md)
2018-02-27 08:40:05 +08:00
2019-04-03 05:29:04 +08:00
[<img src="https://img.shields.io/github/release/seleniumbase/SeleniumBase.svg" />](https://github.com/seleniumbase/SeleniumBase/releases) [<img src="https://dev.azure.com/seleniumbase/seleniumbase/_apis/build/status/seleniumbase.SeleniumBase?branchName=master" />](https://dev.azure.com/seleniumbase/seleniumbase/_build/latest?definitionId=1&branchName=master) [<img src="https://travis-ci.org/seleniumbase/SeleniumBase.svg?branch=master" alt="Build Status" />](https://travis-ci.org/seleniumbase/SeleniumBase) [<img src="https://badges.gitter.im/seleniumbase/SeleniumBase.svg" alt="Join the Gitter Chat" />](https://gitter.im/seleniumbase/SeleniumBase) [<img src="https://img.shields.io/badge/license-MIT-22BBCC.svg" alt="MIT License" />](https://github.com/seleniumbase/SeleniumBase/blob/master/LICENSE) [<img src="https://img.shields.io/github/stars/seleniumbase/seleniumbase.svg" alt="GitHub Stars" />](https://github.com/seleniumbase/SeleniumBase/stargazers)<br />
2017-10-25 07:23:16 +08:00
2018-12-27 15:14:24 +08:00
Reliable Browser Automation & Testing with [Selenium-WebDriver](https://www.seleniumhq.org/) and [Pytest](https://docs.pytest.org/en/latest/).
2018-03-17 07:03:26 +08:00
2018-12-29 06:33:09 +08:00
<img src="https://cdn2.hubspot.net/hubfs/100006/sb_demo_mode.gif" title="SeleniumBase" height="236"><br />
2018-12-29 14:07:51 +08:00
(<i>Above: [my_first_test.py](https://github.com/seleniumbase/SeleniumBase/blob/master/examples/my_first_test.py) from [examples/](https://github.com/seleniumbase/SeleniumBase/tree/master/examples) running in demo mode, which adds JavaScript for highlighting page actions.</i>)<br />
2018-12-29 01:08:57 +08:00
```
2018-12-29 06:23:11 +08:00
pytest my_first_test.py --demo_mode
2018-12-29 01:08:57 +08:00
```
2018-12-27 16:24:23 +08:00
2019-01-21 08:02:50 +08:00
## <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> Quick Start:
2018-08-19 15:53:31 +08:00
2019-04-14 17:05:21 +08:00
(<i>Requires **[Git and Python/Pip](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/install_python_pip_git.md)** [<img src="https://img.shields.io/badge/python-2.7,_3.x-22AADD.svg" alt="Python versions" />](https://www.python.org/downloads/). Optionally, you may want to use a [Python virtual environment](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/virtualenv_instructions.md) to isolate Python dependencies between projects.</i>)
2018-08-11 01:38:34 +08:00
2019-04-14 17:05:21 +08:00
**Make sure you're using the latest versions of Pip and Setuptools:**
2018-08-11 01:38:34 +08:00
```
2019-04-14 17:05:21 +08:00
python -m pip install -U pip setuptools
2018-08-21 13:57:33 +08:00
```
2019-04-14 17:05:21 +08:00
* (Depending on your user permissions, you may need to add ``--user`` to the command if you're not inside a [Python virtual environment](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/virtualenv_instructions.md), or use "[sudo](https://en.wikipedia.org/wiki/Sudo)" on a UNIX-based OS if you're getting errors during installation.)
2018-08-21 13:57:33 +08:00
2019-04-14 17:05:21 +08:00
#### Clone SeleniumBase from GitHub:
2018-08-21 13:57:33 +08:00
```
2019-04-14 17:05:21 +08:00
git clone https://github.com/seleniumbase/SeleniumBase.git
2018-08-21 13:57:33 +08:00
```
2019-04-14 17:05:21 +08:00
(<i>A Git GUI tool like [SourceTree](https://www.sourcetreeapp.com/) or [GitHub Desktop](https://desktop.github.com/) may help.</i>)
2018-08-10 14:51:19 +08:00
2018-10-20 03:44:16 +08:00
#### Install SeleniumBase:
2019-04-14 17:05:21 +08:00
If installing SeleniumBase from a local clone, use:
2018-08-21 13:57:33 +08:00
```
2018-08-10 12:20:44 +08:00
cd SeleniumBase
2019-04-14 17:05:21 +08:00
pip install -r requirements.txt -U
2018-10-20 03:44:16 +08:00
python setup.py install
2018-08-21 13:57:33 +08:00
```
2019-04-14 17:05:21 +08:00
* (Use ``python setup.py develop`` if inside a virtual environment.)
2018-08-10 12:20:44 +08:00
2019-04-14 17:05:21 +08:00
If installing SeleniumBase from [PyPI](https://pypi.python.org/pypi/seleniumbase) [<img src="https://img.shields.io/badge/pypi-seleniumbase-22AAEE.svg" alt="pypi" />](https://pypi.python.org/pypi/seleniumbase), use:
2018-08-21 13:57:33 +08:00
```
2019-04-14 17:05:21 +08:00
pip install seleniumbase -U --no-cache-dir
2018-08-21 13:57:33 +08:00
```
2018-08-10 12:20:44 +08:00
2019-04-14 17:05:21 +08:00
If installing SeleniumBase from GitHub, use:
```
pip install -e git+https://github.com/seleniumbase/SeleniumBase.git@master#egg=seleniumbase
```
#### Download a web driver to your System Path or to the [seleniumbase/drivers](https://github.com/seleniumbase/SeleniumBase/tree/master/seleniumbase/drivers) folder:
SeleniumBase can download a driver to the seleniumbase/drivers folder with the ``install`` command:
```
seleniumbase install chromedriver
```
2018-12-29 01:08:57 +08:00
* (You need a different web driver for each web browser you want to run automation on: ``chromedriver`` for Chrome, ``edgedriver`` for Edge, ``geckodriver`` for Firefox, ``operadriver`` for Opera, and ``iedriver`` for Internet Explorer.)
2018-12-27 15:14:24 +08:00
#### Run a test on Chrome:
2018-08-21 13:57:33 +08:00
```
2018-08-10 12:20:44 +08:00
cd examples
2018-08-08 10:25:36 +08:00
pytest my_first_test.py --browser=chrome
```
2018-12-29 01:08:57 +08:00
* (Chrome is the default browser if not specified with ``--browser``)
2018-10-20 03:44:16 +08:00
2019-04-14 17:05:21 +08:00
**Here's what [my_first_test.py](https://github.com/seleniumbase/SeleniumBase/blob/master/examples/my_first_test.py) looks like:**
2018-08-10 12:20:44 +08:00
2019-04-14 17:05:21 +08:00
```python
from seleniumbase import BaseCase
2018-08-10 12:20:44 +08:00
2019-04-14 17:05:21 +08:00
class MyTestClass(BaseCase):
2018-10-20 03:44:16 +08:00
2019-04-14 17:05:21 +08:00
def test_basic(self):
self.open("https://xkcd.com/353/")
self.assert_element('img[alt="Python"]')
self.click('a[rel="license"]')
self.assert_text("free to copy", "div center")
self.open("https://xkcd.com/1481/")
title = self.get_attribute("#comic img", "title")
self.assert_true("86,400 seconds per day" in title)
self.click("link=Blag")
self.assert_text("The blag of the webcomic", "h2")
self.update_text("input#s", "Robots!\n")
self.assert_text("Hooray robots!", "#content")
self.open("https://xkcd.com/1319/")
self.assert_exact_text("Automation", "#ctitle")
```
(<i>By default, [CSS Selectors](https://www.w3schools.com/cssref/css_selectors.asp) are used for finding page elements.</i>)
2018-08-08 10:25:36 +08:00
2019-01-21 08:02:50 +08:00
## <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> Learn More:
2018-03-10 06:42:33 +08:00
2019-04-14 17:05:21 +08:00
#### **Automatic WebDriver abilities:**<br />
SeleniumBase automatically handles common WebDriver actions such as spinning up web browsers and saving screenshots during test failures. (<i>[Read more about customizing test runs](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/customizing_test_runs.md).</i>)
2018-03-08 17:14:53 +08:00
2019-04-14 17:05:21 +08:00
#### **Simplified code:**<br />
Instead of using messy WebDriver commands such as:
```python
self.driver.find_element_by_css_selector("textarea").send_keys("text")
```
...you can do the following with SeleniumBase:
```python
self.update_text("textarea", "text")
```
(<i>You can still use ``self.driver`` in your code.</i>)
2018-04-03 12:03:25 +08:00
2018-08-15 10:08:19 +08:00
#### **Run tests with Pytest or Nose in any browser:**<br />
2018-07-25 14:15:33 +08:00
(<i>Using **Pytest** is strongly recommended</i>)
2018-08-11 01:38:34 +08:00
```
2018-03-08 17:14:53 +08:00
pytest my_first_test.py --browser=chrome
2018-03-08 17:21:19 +08:00
2018-12-11 15:01:57 +08:00
nosetests test_suite.py --browser=firefox
2018-03-08 17:14:53 +08:00
```
2018-08-08 10:25:36 +08:00
Python methods that start with ``test_`` will automatically be run when using ``pytest`` or ``nosetests`` on a Python file, (<i>or on folders containing Python files</i>).
2018-08-15 10:08:19 +08:00
#### **No more flaky tests:**<br />
2019-04-14 17:05:21 +08:00
SeleniumBase methods automatically wait for page elements to finish loading before interacting with them (*up to a timeout limit*). This means you no longer need random ``time.sleep()`` statements in your scripts.
2018-03-09 06:47:00 +08:00
2019-04-14 17:05:21 +08:00
#### **Automated/manual hybrid mode:**<br />
SeleniumBase includes a solution called **[MasterQA](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/masterqa/ReadMe.md)**, which speeds up manual testing by having automation perform all the browser actions while the manual tester handles validatation.
2017-10-31 10:45:09 +08:00
2018-08-15 10:08:19 +08:00
#### **Feature-Rich:**<br />
2019-04-14 17:05:21 +08:00
For a full list of SeleniumBase features, [Click Here](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/features_list.md).
2015-12-05 05:11:53 +08:00
2018-03-19 10:26:26 +08:00
<a id="seleniumbase_installation"></a>
2018-08-15 16:44:02 +08:00
<img src="https://cdn2.hubspot.net/hubfs/100006/images/logo_base_4b.png" title="SeleniumBase" height="100">
2016-02-13 15:59:34 +08:00
2019-01-21 08:02:50 +08:00
## <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> Detailed Instructions:
2016-02-14 03:59:16 +08:00
2017-10-31 09:59:24 +08:00
**Here's how to run the example script on various web browsers:**
2017-04-25 12:17:26 +08:00
2018-07-25 14:15:33 +08:00
(NOTE: You can interchange **pytest** with **nosetests** at anytime.)
2018-08-11 01:38:34 +08:00
```
2016-02-21 09:42:21 +08:00
cd examples/
2018-02-09 04:21:59 +08:00
pytest my_first_test.py --browser=chrome
2016-05-21 12:05:15 +08:00
2018-02-09 04:21:59 +08:00
nosetests my_first_test.py --browser=firefox
2015-12-05 05:11:53 +08:00
```
2017-10-31 09:59:24 +08:00
(<i>If no browser is specified, Chrome is used by default.</i>)
2016-01-17 07:33:14 +08:00
2017-04-25 12:17:26 +08:00
<a id="seleniumbase_demo_mode"></a>
2019-04-14 17:05:21 +08:00
If the example test is moving too fast for your eyes, you can run it in **Demo Mode** by adding ``--demo_mode`` on the command line, which pauses the browser briefly between actions, highlights page elements being acted on, and lets you know what test assertions are happening in real time:
2016-01-17 07:33:14 +08:00
2018-08-11 01:38:34 +08:00
```
2018-07-27 03:34:17 +08:00
pytest my_first_test.py --demo_mode
2016-01-17 07:33:14 +08:00
```
2018-08-15 10:41:22 +08:00
You can use the following in your scripts to help you debug issues:
2015-12-05 05:11:53 +08:00
```python
2016-01-17 07:33:14 +08:00
import time; time.sleep(5) # sleep for 5 seconds (add this after the line you want to pause on)
import ipdb; ipdb.set_trace() # waits for your command. n = next line of current method, c = continue, s = step / next executed line (will jump)
2018-08-01 02:47:10 +08:00
import pytest; pytest.set_trace() # similar to ipdb, but specific to pytest
2015-12-05 05:11:53 +08:00
```
2018-11-06 06:58:24 +08:00
**To pause an active test that throws an exception or error, add ``--pdb -s``:**
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2018-11-06 06:58:24 +08:00
pytest my_first_test.py --browser=chrome --pdb -s
2015-12-05 05:11:53 +08:00
```
2018-08-01 02:47:10 +08:00
The code above will leave your browser window open in case there's a failure. (ipdb commands: 'c', 's', 'n' => continue, step, next).
2015-12-05 05:11:53 +08:00
2018-08-01 02:47:10 +08:00
Here are some other useful **nosetest**-specific arguments:
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2015-12-05 05:11:53 +08:00
--logging-level=INFO # Hide DEBUG messages, which can be overwhelming.
-x # Stop running the tests after the first failure is reached.
-v # Prints the full test name rather than a dot for each test.
--with-id # If -v is also used, will number the tests for easy counting.
```
2018-12-11 15:01:57 +08:00
During test failures, logs and screenshots from the most recent test run will get saved to the ``latest_logs/`` folder. Those logs will get moved to ``archived_logs/`` if you have ARCHIVE_EXISTING_LOGS set to True in [settings.py](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/config/settings.py), otherwise log files with be cleaned up at the start of the next test run. The ``test_suite.py`` collection contains tests that fail on purpose so that you can see how logging works.
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2017-04-25 12:17:26 +08:00
cd examples/
2016-05-21 12:05:15 +08:00
2018-12-11 15:01:57 +08:00
pytest test_suite.py --browser=chrome
2018-02-14 14:43:13 +08:00
2018-12-11 15:01:57 +08:00
pytest test_suite.py --browser=firefox
2015-12-05 05:11:53 +08:00
```
2017-04-25 12:17:26 +08:00
2018-02-14 14:43:13 +08:00
If you want to run tests headlessly, use ``--headless``, which you'll need to do if your system lacks a GUI interface. Even if your system does have a GUI interface, it may still support headless browser automation.
2018-08-10 12:20:44 +08:00
To run Pytest multithreaded on multiple CPUs at the same time, add ``-n=NUM`` or ``-n NUM`` on the command line, where NUM is the number of CPUs you want to use.
If you want to pass additional data from the command line to your tests, you can use ``--data=STRING``. Now inside your tests, you can use ``self.data`` to access that.
2019-04-14 17:05:21 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Test Directory Customization:**
2018-08-10 12:20:44 +08:00
2018-08-21 13:57:33 +08:00
For running tests outside of the SeleniumBase repo with **Pytest**, you'll want a copy of **[pytest.ini](https://github.com/seleniumbase/SeleniumBase/blob/master/pytest.ini)** on the root folder. For running tests outside of the SeleniumBase repo with **Nosetests**, you'll want a copy of **[setup.cfg](https://github.com/seleniumbase/SeleniumBase/blob/master/setup.cfg)** on the root folder. (Subfolders should include a blank ``__init__.py`` file.)
2018-02-02 06:05:54 +08:00
2018-08-10 12:20:44 +08:00
As a shortcut, you'll be able to run ``seleniumbase mkdir [DIRECTORY_NAME]`` to create a new folder that already contains necessary files and some example tests that you can run. Example:
2018-08-11 01:38:34 +08:00
```
2018-08-10 12:20:44 +08:00
seleniumbase mkdir browser_tests
cd browser_tests
pytest my_first_test.py --browser=chrome
```
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
<a id="creating_visual_reports"></a>
2019-01-21 08:02:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Creating Visual Test Suite Reports:**
2017-04-28 08:40:22 +08:00
2018-08-01 02:47:10 +08:00
(NOTE: Several command line args are different for Pytest vs Nosetests)
2017-04-28 08:40:22 +08:00
2017-10-26 08:57:02 +08:00
#### **Pytest Reports:**
2017-04-25 12:17:26 +08:00
2017-10-26 08:57:02 +08:00
Using ``--html=report.html`` gives you a fancy report of the name specified after your test suite completes.
2016-05-09 06:38:32 +08:00
2018-08-11 01:38:34 +08:00
```
2018-12-11 15:01:57 +08:00
pytest test_suite.py --html=report.html
2016-05-09 06:38:32 +08:00
```
2016-05-23 04:41:30 +08:00
2018-11-09 00:15:00 +08:00
![](https://cdn2.hubspot.net/hubfs/100006/images/PytestReport.png "Example Pytest Report")
You can also use ``--junitxml=report.xml`` to get an xml report instead. Jenkins can use this file to display better reporting for your tests.
2018-08-11 01:38:34 +08:00
```
2018-12-11 15:01:57 +08:00
pytest test_suite.py --junitxml=report.xml
```
2017-10-26 08:57:02 +08:00
#### **Nosetest Reports:**
2017-04-28 08:40:22 +08:00
2018-03-05 06:55:00 +08:00
The ``--report`` option gives you a fancy report after your test suite completes.
2017-04-28 08:40:22 +08:00
2018-08-11 01:38:34 +08:00
```
2018-12-11 15:01:57 +08:00
nosetests test_suite.py --report
2017-04-28 08:40:22 +08:00
```
2018-03-09 00:41:50 +08:00
<img src="https://cdn2.hubspot.net/hubfs/100006/images/Test_Report_2.png" title="Example Nosetest Report" height="420">
2017-04-28 08:40:22 +08:00
2017-10-26 08:57:02 +08:00
(NOTE: You can add ``--show_report`` to immediately display Nosetest reports after the test suite completes. Only use ``--show_report`` when running tests locally because it pauses the test run.)
2015-12-05 05:11:53 +08:00
2017-10-25 08:13:55 +08:00
2019-01-21 08:02:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Using a Proxy Server:**
If you wish to use a proxy server for your browser tests (Chrome and Firefox only), you can add ``--proxy=IP_ADDRESS:PORT`` as an argument on the command line.
2018-08-11 01:38:34 +08:00
```
pytest proxy_test.py --proxy=IP_ADDRESS:PORT
```
2018-10-18 06:22:34 +08:00
If the proxy server that you wish to use requires authentication, you can do the following (Chrome only):
```
pytest proxy_test.py --proxy=USERNAME:PASSWORD@IP_ADDRESS:PORT
```
2018-03-05 06:55:00 +08:00
To make things easier, you can add your frequently-used proxies to PROXY_LIST in [proxy_list.py](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/config/proxy_list.py), and then use ``--proxy=KEY_FROM_PROXY_LIST`` to use the IP_ADDRESS:PORT of that key.
2018-08-11 01:38:34 +08:00
```
pytest proxy_test.py --proxy=proxy1
```
2019-02-28 17:52:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Changing the User-Agent:**
If you wish to change the User-Agent for your browser tests (Chrome and Firefox only), you can add ``--agent="USER AGENT STRING"`` as an argument on the command line.
```bash
pytest user_agent_test.py --agent="Mozilla/5.0 (Nintendo 3DS; U; ; en) Version/1.7412.EU"
```
2017-04-25 12:17:26 +08:00
<a id="utilizing_advanced_features"></a>
2019-01-21 08:02:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Production Environments & Integrations:**
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
Here are some things you can do to setup a production environment for your testing:
2015-12-05 05:11:53 +08:00
2019-03-08 14:27:12 +08:00
* You can setup a [Jenkins](https://jenkins.io/) build server for running tests at regular intervals. Jenkins has many plugins available, such as [the Xvfb headless browser plugin](https://wiki.jenkins-ci.org/display/JENKINS/Xvfb+Plugin) for running tests on a machine with no GUI. If you have Xvfb running in the background, you can add ``--headless`` to your run command in order to utilize it. For more info about the Xvfb plugin, [read this](https://qxf2.com/blog/xvfb-plugin-for-jenkins-selenium/). For a real-world Jenkins example of headless browser automation in action, check out [the SeleniumBase Google Cloud ReadMe](https://github.com/seleniumbase/SeleniumBase/blob/master/integrations/google_cloud/ReadMe.md).
2015-12-05 05:11:53 +08:00
2018-08-14 13:59:17 +08:00
* You can use [the Selenium Grid](https://github.com/SeleniumHQ/selenium/wiki/Grid2) to scale your testing by distributing tests on several machines with parallel execution. To do this, check out the SeleniumBase [selenium_grid folder](https://github.com/seleniumbase/SeleniumBase/tree/master/seleniumbase/utilities/selenium_grid), which should have everything you need. The [Selenium Grid ReadMe](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/utilities/selenium_grid/ReadMe.md) will help you get started.
2015-12-05 05:11:53 +08:00
2019-03-08 14:27:12 +08:00
* If you're using the [SeleniumBase MySQL feature](https://github.com/seleniumbase/SeleniumBase/blob/master/help_docs/mysql_installation.md) to save results from tests running on a server machine, you can install [MySQL Workbench](https://dev.mysql.com/downloads/tools/workbench/) to help you read & write from your DB more easily. You'll also need to install the MySQL Python client. Depending on your system, you may need to install additional requirements for this (such as on Windows). See [Stackoverflow](https://stackoverflow.com/questions/43102442/whats-the-difference-between-mysqldb-mysqlclient-and-mysql-connector-python) for more info.
2018-08-11 01:38:34 +08:00
```
2018-12-27 15:14:24 +08:00
pip install mysqlclient==1.3.14
```
2017-04-25 12:17:26 +08:00
2015-12-05 05:11:53 +08:00
* If you use [Slack](https://slack.com), you can easily have your Jenkins jobs display results there by using the [Jenkins Slack Plugin](https://github.com/jenkinsci/slack-plugin). Another way to send messages from your tests to Slack is by using [Slack's Incoming Webhooks API](https://api.slack.com/incoming-webhooks).
2017-10-25 08:13:55 +08:00
<a id="amazon_section"></a>
2019-03-08 14:27:12 +08:00
* If you're using AWS, you can setup an [Amazon S3](https://aws.amazon.com/s3/) account for saving your log files and screenshots for future viewing. SeleniumBase already has [all the code you need to connect to S3](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/plugins/s3_logging_plugin.py). You'll need to modify [settings.py](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/config/settings.py) with connection details to your instance and the location in S3 where you want log files to be saved. You'll also need to add "``--with-s3_logging``" on the command line when you run your tests.
2015-12-05 05:11:53 +08:00
2017-10-25 08:13:55 +08:00
Here's an example of running tests with additional features enabled:
2018-08-11 01:38:34 +08:00
```
2018-07-25 14:15:33 +08:00
pytest [YOUR_TEST_FILE].py --browser=chrome --with-db_reporting --with-s3_logging -s
2015-12-05 05:11:53 +08:00
```
2017-04-25 12:17:26 +08:00
(NOTE: If you haven't configured your MySQL or S3 connections in [settings.py](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/config/settings.py), don't use ``--with-db_reporting`` or ``--with-s3_logging``.)
2016-02-19 08:01:45 +08:00
When the testing_base plugin is used, if there's a test failure, the basic_test_info plugin records test logs, the page_source plugin records the page source of the last web page seen by the test, and the screen_shots plugin records the image of the last page seen by the test where the failure occurred. Make sure you always include testing_base whenever you include a plugin that logs test data. The db_reporting plugin records the status of all tests run into your MySQL DB. The s3_logging plugin uploads basic test info, screenshots, and page source into your S3 storage folder.
2015-12-05 05:11:53 +08:00
2018-11-27 12:45:46 +08:00
To simplify that long run command, you can create a ``*.cfg`` file, such as the one provided in the example, and enter your plugins there so that you can run everything by typing:
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2017-10-26 10:07:50 +08:00
nosetests [YOUR_TEST_FILE].py --config=[MY_CONFIG_FILE].cfg
2015-12-05 05:11:53 +08:00
```
You can simplify that even more by using a setup.cfg file, such as the one provided for you in the examples folder. If you kick off a test run from within the folder that setup.cfg is location in, that file will automatically be used as your configuration, meaning that you wouldn't have to type out all the plugins that you want to use (or include a config file) everytime you run tests.
2018-07-25 14:15:33 +08:00
If you tell pytest/nosetests to run an entire file, it will run every method in that python file that starts with "test". You can be more specific on what to run by doing something like the following: (<i>Note that the syntax is different for pytest vs nosetests.</i>)
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2018-07-25 14:15:33 +08:00
pytest [YOUR_TEST_FILE].py::[SOME_CLASS_NAME]::test_[SOME_TEST_NAME]
nosetests [YOUR_TEST_FILE].py:[SOME_CLASS_NAME].test_[SOME_TEST_NAME]
2015-12-05 05:11:53 +08:00
```
2018-03-05 06:55:00 +08:00
Let's try an example of a test that fails:
2015-12-05 05:11:53 +08:00
```python
""" test_fail.py """
from seleniumbase import BaseCase
class MyTestClass(BaseCase):
def test_find_army_of_robots_on_xkcd_desert_island(self):
self.open("https://xkcd.com/731/")
2018-03-05 06:55:00 +08:00
self.assert_element("div#ARMY_OF_ROBOTS", timeout=1) # This should fail
2015-12-05 05:11:53 +08:00
```
2018-03-05 06:55:00 +08:00
You can run it from the ``examples`` folder like this:
2015-12-05 05:11:53 +08:00
2018-08-11 01:38:34 +08:00
```
2018-07-25 14:15:33 +08:00
pytest test_fail.py
2015-12-05 05:11:53 +08:00
```
2016-07-18 04:11:09 +08:00
You'll notice that a logs folder, "latest_logs", was created to hold information about the failing test, and screenshots. Take a look at what you get. Remember, this data can be saved in your MySQL DB and in S3 if you include the necessary plugins in your run command (and if you set up the neccessary connections properly). For future test runs, past test results will get stored in the archived_logs folder if you have ARCHIVE_EXISTING_LOGS set to True in [settings.py](https://github.com/seleniumbase/SeleniumBase/blob/master/seleniumbase/config/settings.py).
2015-12-05 05:11:53 +08:00
2018-08-15 16:44:02 +08:00
<img src="https://cdn2.hubspot.net/hubfs/100006/images/logo_base_4b.png" title="SeleniumBase" height="100">
2018-03-09 11:47:13 +08:00
2017-04-25 12:17:26 +08:00
<a id="detailed_method_specifications"></a>
2019-01-21 08:02:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> **Detailed Method Specifications and Examples:**
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
#### Navigating to a web page (and related commands)
2015-12-05 05:11:53 +08:00
```python
2017-04-25 12:17:26 +08:00
self.open("https://xkcd.com/378/") # This method opens the specified page.
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
self.go_back() # This method navigates the browser to the previous page.
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
self.go_forward() # This method navigates the browser forward in history.
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
self.refresh_page() # This method reloads the current page.
self.get_current_url() # This method returns the current page URL.
self.get_page_source() # This method returns the current page source.
2015-12-05 05:11:53 +08:00
```
2017-04-25 12:17:26 +08:00
**ProTip™:** You may need to use the get_page_source() method along with Python's find() command to parse through the source to find something that Selenium wouldn't be able to. (You may want to brush up on your Python programming skills for that.)
2015-12-05 05:11:53 +08:00
Ex:
```python
2017-04-25 12:17:26 +08:00
source = self.get_page_source()
2019-03-12 12:53:01 +08:00
head_open_tag = source.find('<head>')
head_close_tag = source.find('</head>', head_open_tag)
everything_inside_head = source[head_open_tag+len('<head>'):head_close_tag]
2015-12-05 05:11:53 +08:00
```
#### Clicking
To click an element on the page:
```python
self.click("div#my_id")
```
2017-04-25 12:17:26 +08:00
**ProTip™:** In most web browsers, you can right-click on a page and select ``Inspect Element`` to see the CSS selector details that you'll need to create your own scripts.
2016-04-29 09:16:12 +08:00
#### Typing Text
self.update_text(selector, text) # updates the text from the specified element with the specified value. An exception is raised if the element is missing or if the text field is not editable. Example:
```python
self.update_text("input#id_value", "2012")
```
You can also use self.add_text() or the WebDriver .send_keys() command, but those won't clear the text box first if there's already text inside.
If you want to type in special keys, that's easy too. Here's an example:
```python
from selenium.webdriver.common.keys import Keys
self.find_element("textarea").send_keys(Keys.SPACE + Keys.BACK_SPACE + '\n') # the backspace should cancel out the space, leaving you with the newline
```
#### Getting the text from an element on a page
```python
2017-04-25 12:17:26 +08:00
text = self.get_text("header h2")
```
#### Getting the attribute value from an element on a page
```python
attribute = self.get_attribute("#comic img", "title")
2016-04-29 09:16:12 +08:00
```
2015-12-05 05:11:53 +08:00
#### Asserting existance of an element on a page within some number of seconds:
```python
self.wait_for_element_present("div.my_class", timeout=10)
```
(NOTE: You can also use: ``self.assert_element_present(ELEMENT)``)
2015-12-05 05:11:53 +08:00
#### Asserting visibility of an element on a page within some number of seconds:
```python
self.wait_for_element_visible("a.my_class", timeout=5)
```
(NOTE: The short versions of this are ``self.find_element(ELEMENT)`` and ``self.assert_element(ELEMENT)``. The find_element() version returns the element)
2015-12-05 05:11:53 +08:00
2016-01-12 09:48:50 +08:00
Since the line above returns the element, you can combine that with .click() as shown below:
2015-12-05 05:11:53 +08:00
```python
2016-04-29 09:16:12 +08:00
self.find_element("a.my_class", timeout=5).click()
2016-01-12 09:48:50 +08:00
# But you're better off using the following statement, which does the same thing:
self.click("a.my_class") # DO IT THIS WAY!
2015-12-05 05:11:53 +08:00
```
2017-07-21 09:16:57 +08:00
**ProTip™:** You can use dots to signify class names (Ex: ``div.class_name``) as a simplified version of ``div[class="class_name"]`` within a CSS selector.
You can also use ``*=`` to search for any partial value in a CSS selector as shown below:
2017-04-25 12:17:26 +08:00
```python
2017-07-21 09:16:57 +08:00
self.click('a[name*="partial_name"]')
2017-04-25 12:17:26 +08:00
```
2015-12-05 05:11:53 +08:00
#### Asserting visibility of text inside an element on a page within some number of seconds:
```python
2018-02-02 06:05:54 +08:00
self.assert_text("Make it so!", "div#trek div.picard div.quotes")
self.assert_text("Tea. Earl Grey. Hot.", "div#trek div.picard div.quotes", timeout=3)
2015-12-05 05:11:53 +08:00
```
2018-02-02 06:05:54 +08:00
(NOTE: ``self.find_text(TEXT, ELEMENT)`` and ``self.wait_for_text(TEXT, ELEMENT)`` also do this. For backwords compatibility, older method names were kept, but the default timeout may be different.)
2015-12-05 05:11:53 +08:00
#### Asserting Anything
```python
self.assert_true(myvar1 == something)
2015-12-05 05:11:53 +08:00
self.assert_equal(var1, var2)
2015-12-05 05:11:53 +08:00
```
#### Useful Conditional Statements (with creative examples in action)
is_element_visible(selector) # is an element visible on a page
```python
import logging
if self.is_element_visible('div#warning'):
logging.debug("Red Alert: Something bad might be happening!")
```
is_element_present(selector) # is an element present on a page
```python
if self.is_element_present('div#top_secret img.tracking_cookie'):
self.contact_cookie_monster() # Not a real method unless you define it somewhere
else:
2017-04-25 12:17:26 +08:00
current_url = self.get_current_url()
2015-12-05 05:11:53 +08:00
self.contact_the_nsa(url=current_url, message="Dark Zone Found") # Not a real method unless you define it somewhere
```
Another example:
```python
def is_there_a_cloaked_klingon_ship_on_this_page():
if self.is_element_present("div.ships div.klingon"):
return not self.is_element_visible("div.ships div.klingon")
return False
```
is_text_visible(text, selector) # is text visible on a page
```python
def get_mirror_universe_captain_picard_superbowl_ad(superbowl_year):
selector = "div.superbowl_%s div.commercials div.transcript div.picard" % superbowl_year
if self.is_text_visible("For the Love of Marketing and Earl Grey Tea!", selector):
return "Picard HubSpot Superbowl Ad 2015"
elif self.is_text_visible("Delivery Drones... Engage", selector):
return "Picard Amazon Superbowl Ad 2015"
elif self.is_text_visible("Bing it on Screen!", selector):
return "Picard Microsoft Superbowl Ad 2015"
elif self.is_text_visible("OK Glass, Make it So!", selector):
return "Picard Google Superbowl Ad 2015"
elif self.is_text_visible("Number One, I've Never Seen Anything Like It.", selector):
return "Picard Tesla Superbowl Ad 2015"
elif self.is_text_visible("""With the first link, the chain is forged.
The first speech censored, the first thought forbidden,
the first freedom denied, chains us all irrevocably.""", selector):
return "Picard Wikimedia Superbowl Ad 2015"
elif self.is_text_visible("Let us make sure history never forgets the name ... Facebook", selector):
return "Picard Facebook Superbowl Ad 2015"
else:
raise Exception("Reports of my assimilation are greatly exaggerated.")
```
#### Switching Tabs
What if your test opens up a new tab/window and now you have more than one page? No problem. You need to specify which one you currently want Selenium to use. Switching between tabs/windows is easy:
Ex:
```python
2017-04-25 12:17:26 +08:00
self.switch_to_window(1) # this switches to the new tab (0 is the first one)
2015-12-05 05:11:53 +08:00
```
**ProTip™:** iFrames follow the same principle as new windows - you need to specify the iFrame if you want to take action on something in there
Ex:
```python
2017-04-25 12:17:26 +08:00
self.switch_to_frame('ContentManagerTextBody_ifr')
2015-12-05 05:11:53 +08:00
# Now you can act inside the iFrame
2017-04-25 12:17:26 +08:00
# .... Do something cool (here)
self.switch_to_default_content() # exit the iFrame when you're done
2015-12-05 05:11:53 +08:00
```
#### Handle Pop-Up Alerts
What if your test makes an alert pop up in your browser? No problem. You need to switch to it and either accept it or dismiss it:
Ex:
```python
self.wait_for_and_accept_alert()
2015-12-05 05:11:53 +08:00
self.wait_for_and_dismiss_alert()
2015-12-05 05:11:53 +08:00
```
If you're not sure whether there's an alert before trying to accept or dismiss it, one way to handle that is to wrap your alert-handling code in a try/except block. Other methods such as .text and .send_keys() will also work with alerts.
#### Executing Custom jQuery Scripts:
jQuery is a powerful JavaScript library that allows you to perform advanced actions in a web browser.
If the web page you're on already has jQuery loaded, you can start executing jQuery scripts immediately.
You'd know this because the web page would contain something like the following in the HTML:
```html
2018-11-09 00:15:00 +08:00
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.3.1/jquery.min.js"></script>
2015-12-05 05:11:53 +08:00
```
It's OK if you want to use jQuery on a page that doesn't have it loaded yet. To do so, run the following command first:
```python
self.activate_jquery()
```
2018-11-09 00:15:00 +08:00
Some websites have a restrictive [Content Security Policy](https://developer.mozilla.org/en-US/docs/Web/HTTP/CSP) to prevent users from loading jQuery and other external libraries onto their websites. If you need to use jQuery or another JS library on such a website, use Firefox with SeleniumBase, which overrides the CSP to allow loading of any JS library.
2015-12-05 05:11:53 +08:00
Here are some examples of using jQuery in your scripts:
```python
self.execute_script('jQuery, window.scrollTo(0, 600)') # Scrolling the page
self.execute_script("jQuery('#annoying-widget').hide()") # Hiding elements on a page
self.execute_script("jQuery('#hidden-widget').show(0)") # Showing hidden elements on a page
2015-12-05 05:11:53 +08:00
self.execute_script("jQuery('#annoying-button a').remove()") # Removing elements on a page
self.execute_script("jQuery('%s').mouseover()" % (mouse_over_item)) # Mouse-over elements on a page
self.execute_script("jQuery('input#the_id').val('my_text')") # Fast text input on a page
self.execute_script("jQuery('div#dropdown a.link').click()") # Click elements on a page
self.execute_script("return jQuery('div#amazing')[0].text") # Returns the css "text" of the element given
self.execute_script("return jQuery('textarea')[2].value") # Returns the css "value" of the 3rd textarea element on the page
```
2018-02-13 01:35:25 +08:00
In the following example, JavaScript is used to plant code on a page that Selenium can then touch after that:
2015-12-05 05:11:53 +08:00
```python
2018-02-13 01:35:25 +08:00
start_page = "https://xkcd.com/465/"
destination_page = "https://github.com/seleniumbase/SeleniumBase"
self.open(start_page)
referral_link = '''<a class='analytics test' href='%s'>Free-Referral Button!</a>''' % destination_page
self.execute_script('''document.body.innerHTML = \"%s\"''' % referral_link)
2015-12-05 05:11:53 +08:00
self.click("a.analytics") # Clicks the generated button
```
2018-02-22 11:46:47 +08:00
(Due to popular demand, this traffic generation example has been baked into SeleniumBase with the ``self.generate_referral(start_page, end_page)`` and the ``self.generate_traffic(start_page, end_page, loops)`` methods.)
2015-12-05 05:11:53 +08:00
2018-03-04 23:27:41 +08:00
#### Using delayed asserts:
Let's say you want to verify multiple different elements on a web page in a single test, but you don't want the test to fail until you verified several elements at once so that you don't have to rerun the test to find more missing elements on the same page. That's where delayed asserts come in. Here's the example:
```python
from seleniumbase import BaseCase
class MyTestClass(BaseCase):
2018-03-04 23:27:41 +08:00
def test_delayed_asserts(self):
self.open('https://xkcd.com/993/')
self.wait_for_element('#comic')
self.delayed_assert_element('img[alt="Brand Identity"]')
self.delayed_assert_element('img[alt="Rocket Ship"]') # Will Fail
self.delayed_assert_element('#comicmap')
self.delayed_assert_text('Fake Item', '#middleContainer') # Will Fail
self.delayed_assert_text('Random', '#middleContainer')
self.delayed_assert_element('a[name="Super Fake !!!"]') # Will Fail
self.process_delayed_asserts()
```
``delayed_assert_element()`` and ``delayed_assert_text()`` will save any exceptions that would be raised.
To flush out all the failed delayed asserts into a single exception, make sure to call ``self.process_delayed_asserts()`` at the end of your test method. If your test hits multiple pages, you can call ``self.process_delayed_asserts()`` at the end of all your delayed asserts for a single page. This way, the screenshot from your log file will have the location where the delayed asserts were made.
2017-04-25 12:17:26 +08:00
#### Accessing raw WebDriver
2015-12-05 05:11:53 +08:00
2017-04-25 12:17:26 +08:00
If you need access to any commands that come with standard WebDriver, you can call them directly like this:
2015-12-05 05:11:53 +08:00
```python
2017-04-25 12:17:26 +08:00
self.driver.delete_all_cookies()
capabilities = self.driver.capabilities
self.driver.find_elements_by_partial_link_text("GitHub")
2015-12-05 05:11:53 +08:00
```
2017-04-25 12:17:26 +08:00
(In general, you'll want to use the SeleniumBase versions of methods when available.)
2015-12-05 05:11:53 +08:00
2019-01-05 08:01:18 +08:00
#### Retrying failing tests automatically
2019-01-05 08:01:18 +08:00
You can use ``--reruns NUM`` to retry failing tests that many times. Use ``--reruns-delay SECONDS`` to wait that many seconds between retries. Example:
```
pytest --reruns 5 --reruns-delay 1
```
Additionally, you can use the ``@retry_on_exception()`` decorator to specifically retry failing methods. (First import: ``from seleniumbase import decorators``) To learn more about SeleniumBase decorators, [click here](https://github.com/seleniumbase/SeleniumBase/tree/master/seleniumbase/common).
2015-12-05 05:11:53 +08:00
#### Checking Email:
Let's say you have a test that sends an email, and now you want to check that the email was received:
```python
from seleniumbase.fixtures.email_manager import EmailManager, EmailException
num_email_results = 0
email_subject = "This is the subject to search for (maybe include a timestamp)"
2018-04-17 14:58:53 +08:00
email_manager = EmailManager("{YOUR SELENIUM GMAIL ACCOUNT EMAIL ADDRESS}") # the password for this would be stored in seleniumbase/config/settings.py
2015-12-05 05:11:53 +08:00
try:
html_text = email_manager.search(SUBJECT="%s" % email_subject, timeout=300)
num_email_results = len(html_text)
except EmailException:
num_email_results = 0
self.assert_true(num_email_results) # true if not zero
2015-12-05 05:11:53 +08:00
```
Now you can parse through the email if you're looking for specific text or want to navigate to a link listed there.
2019-01-21 08:02:50 +08:00
### <img src="https://cdn2.hubspot.net/hubfs/100006/images/super_square_logo_3a.png" title="SeleniumBase" height="32"> Wrap-Up
2015-12-05 05:11:53 +08:00
2018-12-15 09:29:30 +08:00
#### Congratulations on getting started with SeleniumBase!
2017-04-25 12:17:26 +08:00
2018-08-08 10:25:36 +08:00
<i>**Questions or Comments?**</i><br />
2018-08-11 01:38:34 +08:00
[![Join the chat at https://gitter.im/seleniumbase/SeleniumBase](https://badges.gitter.im/seleniumbase/SeleniumBase.svg)](https://gitter.im/seleniumbase/SeleniumBase?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)<br />
2018-03-09 12:00:22 +08:00
2018-12-15 09:29:30 +08:00
If you see something, say something! We are very active in resolving issues. [<img src="https://img.shields.io/github/issues-closed-raw/seleniumbase/SeleniumBase.svg" alt="Closed Issues" />](https://github.com/seleniumbase/SeleniumBase/issues?q=is%3Aissue+is%3Aclosed)
2018-08-11 01:38:34 +08:00
[https://github.com/mdmintz](https://github.com/mdmintz)<br />
2018-03-09 11:52:43 +08:00
2019-03-08 14:27:12 +08:00
[<img src="https://cdn2.hubspot.net/hubfs/100006/images/SB_Logo3g4.png" title="SeleniumBase" height="45">](https://github.com/seleniumbase/SeleniumBase/blob/master/README.md) <br /> <img src="https://cdn2.hubspot.net/hubfs/100006/images/logo_base_4b.png" title="SeleniumBase" height="150"> <br /> [<img src="https://img.shields.io/badge/license-MIT-22BBCC.svg" alt="MIT License" />](https://github.com/seleniumbase/SeleniumBase/blob/master/LICENSE)