How to apply integration tests to a Flask RESTful API

Question

[As per https://stackoverflow.com/a/46369945/1021819, the title should refer to integration tests rather than unit tests]

Suppose I'd like to test the following Flask API (from here):

import flask
import flask_restful

app = flask.Flask(__name__)
api = flask_restful.Api(app)

class HelloWorld(flask_restful.Resource):
    def get(self):
        return {'hello': 'world'}

api.add_resource(HelloWorld, '/')

if __name__ == "__main__":
    app.run(debug=True)

Having saved this as flaskapi.py and run it, in the same directory I run the script test_flaskapi.py:

import unittest
import flaskapi
import requests

class TestFlaskApiUsingRequests(unittest.TestCase):
    def test_hello_world(self):
        response = requests.get('http://localhost:5000')
        self.assertEqual(response.json(), {'hello': 'world'})


class TestFlaskApi(unittest.TestCase):
    def setUp(self):
        self.app = flaskapi.app.test_client()

    def test_hello_world(self):
        response = self.app.get('/')

if __name__ == "__main__":
    unittest.main()

Both the tests pass, but for the second test (defined in the TestFlaskApi) class I haven't yet figured out how to assert that the JSON response is as expected (namely, {'hello': 'world'}). This is because it is an instance of flask.wrappers.Response (which is probably essentially a Werkzeug Response object (cf. http://werkzeug.pocoo.org/docs/0.11/wrappers/)), and I haven't been able to find an equivalent of the json() method for requests Response object.

How can I make assertions on the JSON content of the second response?

What about functional tests, you don't expect to run a service separately for running your tests in separate process do you? How will you mock the database, I believe this should be functional tests which just mock request by passing object directly to flask. — holms, Oct 13 '18 at 13:09
Possible duplicate of [Flask Unittest for Post Method](https://stackoverflow.com/questions/44892061/flask-unittest-for-post-method) — jtlz2, Nov 29 '18 at 09:26

TheGrimmScientist · Answer 1 · 2019-08-14T01:33:00.740

41

Flask provides a test_client you can use in your tests:

from source.api import app
from unittest import TestCase

class TestIntegrations(TestCase):
    def setUp(self):
        self.app = app.test_client()

    def test_thing(self):
        response = self.app.get('/')
        assert <make your assertion here>

Flask Testing Docs

edited Aug 14 '19 at 01:33

answered Aug 13 '17 at 23:03

TheGrimmScientist

2,812
1
27
25

3

(Posted as an answer to help others landing here see a cleaner way to write these tests) – TheGrimmScientist Aug 13 '17 at 23:12
2

Clean and consice. – Prakhar Jan 13 '18 at 19:16
1

@TheGrimmScientist The provided link to the docs is outdated. Maybe you want to update it to https://flask.palletsprojects.com/en/1.1.x/testing/#the-first-test ? – colidyre Aug 13 '19 at 14:07

score 33 · Accepted Answer · edited Aug 15 '18 at 09:43

I've found that I can get the JSON data by applying json.loads() to the output of the get_data() method:

import unittest
import flaskapi
import requests
import json
import sys

class TestFlaskApiUsingRequests(unittest.TestCase):
    def test_hello_world(self):
        response = requests.get('http://localhost:5000')
        self.assertEqual(response.json(), {'hello': 'world'})


class TestFlaskApi(unittest.TestCase):
    def setUp(self):
        self.app = flaskapi.app.test_client()

    def test_hello_world(self):
        response = self.app.get('/')
        self.assertEqual(
            json.loads(response.get_data().decode(sys.getdefaultencoding())), 
            {'hello': 'world'}
        )


if __name__ == "__main__":
    unittest.main()

Both tests pass as desired:

..
----------------------------------------------------------------------
Ran 2 tests in 0.019s

OK
[Finished in 0.3s]

"Status: Flask API is not currently under active development." from https://github.com/flask-api/flask-api — TheGrimmScientist, Aug 13 '17 at 22:52
@TheGrimmScientist The OP is using flask-restful, not flask-api — Prince Odame, Jun 07 '18 at 16:26

score 24 · Answer 3 · answered Sep 22 '17 at 17:13

What you're doing there is not unit testing. In every case, when using the requests library or the flask client, you're doing integration testing as you make actual http calls to the endpoints and test the interaction.

Either the title of the question or the approach is not accurate.

score 2 · Answer 4 · answered Jul 03 '17 at 08:56

With Python3, I got the error TypeError: the JSON object must be str, not bytes. It is required to decode:

# in TestFlaskApi.test_hello_world
self.assertEqual(json.loads(response.get_data().decode()), {'hello': 'world'})

This question gives an explanation.

score 0 · Answer 5 · answered Aug 11 '21 at 14:09

The response object from test_client has a get_json method.

There's no need for converting the response to json with json.loads.

class TestFlaskApi(unittest.TestCase):
    def setUp(self):
        self.app = flaskapi.app.test_client()

    def test_hello_world(self):
        response = self.app.get("/")
        self.assertEqual(
            response.get_json(),
            {"hello": "world"},
        )

How to apply integration tests to a Flask RESTful API

5 Answers5

Linked

Related