Python import src modules when running tests

Question

My source files are located under src and my test files are located under tests. When I want to run a test file, say python myTest.py, I get an import error: "No module named ASourceModule.py".

How do I import all the modules from source needed to run my tests?

score 42 · Accepted Answer · answered Jan 21 '11 at 16:17

42

You need to add that directory to the path:

import sys
sys.path.append('../src')

Maybe put this into a module if you are using it a lot.

answered Jan 21 '11 at 16:17

Thomas

174,939
50
355
478

6

This is not OS agnostic. See [the answer](https://stackoverflow.com/a/34938623/1509695) for having the same code work on both linux and Windows. – matanster Jan 30 '18 at 07:06

Anderson Vieira · Answer 2 · 2016-06-06T12:59:39.120

If you don't want to add the source path to each test file or change your PYTHONPATH, you can use nose to run the tests.

Suppose your directory structure is like this:

project
    package
        __init__.py
        module.py
    tests
        __init__.py
        test_module.py

You should import the module normally in the test_module.py (e.g. from package import module). Then run the tests by running nosetests in the project folder. You can also run specific tests by doing nosetests tests/test_module.py.

The __init__.py in the tests directory is necessary if you want to run the tests from inside it.

You can install nose easily with easy_install or pip:

easy_install nose

or

pip install nose

nose extends unittest in a lot more ways, to learn more about it you can check their website: https://nose.readthedocs.org/en/latest/

+1 for "The `__init__.py` in the tests directory is necessary if you want to run the tests from inside it." — Farkas István, Feb 14 '18 at 15:13

Frank Bryce · Answer 3 · 2016-01-24T02:04:15.103

20

On my system (Windows 10), I was required to do something like this:

import sys
import os
sys.path.append(os.path.dirname(os.path.realpath(__file__)) + "/../src")

Appending the relative directory directly to sys.path did not work

edited Jan 24 '16 at 02:04

answered Jan 22 '16 at 03:41

Frank Bryce

8,076
4
38
56

score 14 · Answer 4 · edited Jul 01 '21 at 14:31

14

The best (most manageable) solution appears to be using a virtualenv and setuptools/distribute to install a development copy of your (src) package. That way your tests execute against a fully "installed" system.

In the pystest docs there is a section on "good practices" explaining this approach, see here.

edited Jul 01 '21 at 14:31

Sjoerd

74,049
16
131
175

answered Jan 24 '11 at 09:45

Barry Wark

107,306
24
181
206

2

This is the best solution. The other two work, but are not as clean. The thing is for a beginner it might be simpler to just use the hacks above rather than spending hours understanding Python Packaging. If you have the time, go with this one. – nonameable Nov 14 '20 at 06:12
3

Link in the answer is broken, this is correct one - https://docs.pytest.org/en/latest/explanation/goodpractices.html#test-discovery – Aleksei Semidotskii Apr 14 '21 at 21:41
I found using both solutions has its benefits. If I am iterating quickly and want to test my code in my src directory without building and standing up a virtual environment then using the sys.path trick is helpful. Then using tox for a full end-to-end test with an installed package when things are in a "good" state. I control this by setting an environment variable locally (LOCAL_PYTEST=true) and then checking that in tests/__init__.py and conditionally adding to sys.path. – thomas Feb 08 '22 at 19:55

Joooeey · Answer 5 · 2023-08-14T08:11:23.490

3

For those using Pytest:

You should not call your package src. That's meaningless and leads to confusing import statements such as from src import module. Rename the src folder to the name of your package (mypackage for the sake of this example)!
Make sure mypackage is recognized as a package by putting an empty__init__.py inside.
Put an empty conftest.py in the project folder.
Make sure there is no __init__.py in the test directory.

Looks like this:

myproject
    conftest.py
    mypackage
        __init__.py
        mymodule.py
    test
        test_mymodule.py

And make sure test_module.py contains the line:

from mypackage import mymodule

Source: Pytest docs

edited Aug 14 '23 at 08:11

answered Sep 29 '22 at 14:26

Joooeey

3,394
1
35
49

1

Really unlikely anyone would actually want to make "src" a module? – CptPicard Mar 22 '23 at 14:42
Indeed but that's what the OP asked for and it works. The "src" folder is quite nonstandard in Python. Just using the package name would be better. – Joooeey Mar 22 '23 at 14:51

Python import src modules when running tests

5 Answers5

Linked