Upgrade Datasette Docker to Python 3.11

[simonw]

Related:

• Upgrade to 3.10.6-slim-bullseye Docker base image #1768

I think this base image looks right: 3.11.0-slim-bullseye

[simonw]

I ran a very crude benchmark on my laptop using Locust (against the official macOS packages from www.python.org for Python 3.10 and Python 3.11) and saw a substantial speed increase:

533.89 requests/second on 3.11
413.56 requests/second on 3.10

That was from running Locust against this locustfile.py:

from locust import HttpUser, task

class CounterOne(HttpUser):
    @task
    def hello(self):
        self.client.get("/-/static/app.css")

Using:

locust --headless --users 4 --spawn-rate 4 -H http://127.0.0.1:8001

[simonw]

Ran the upgrade on the Datasette Cloud image first, works fine there.

https://simon.datasette.cloud/-/versions shows me:

{
    "python": {
        "version": "3.11.0",
        "full": "3.11.0 (main, Oct 25 2022, 05:00:36) [GCC 10.2.1 20210110]"
    },

[simonw]

Also tested by running this locally:

datasette publish cloudrun fixtures.db --service issue-1853

https://issue-1853-j7hipcg4aq-uc.a.run.app/-/versions now shows Python 3.11.0.

[simonw]

And tested datasette package like this:

datasette package fixtures.db -t datasette-package-python-upgrade-3-11

Then:

docker run -p 8081:8001 datasette-package-python-upgrade-3-11

And tested it like this:

curl http://localhost:8081/-/versions.json | jq

Output:

{
  "python": {
    "version": "3.11.0",
    "full": "3.11.0 (main, Oct 25 2022, 05:00:36) [GCC 10.2.1 20210110]"
  },

[simonw]

This broke the deploy of https://latest.datasette.io/ - because it tries to install pysqlite3-binary which doesn't have a 3.11 release yet:

datasette/.github/workflows/deploy-latest.yml

Line 77 in 2e97516

--install=pysqlite3-binary \

I started using that for the latest.datasette.io demo in a970276 because I wanted a version of SQLite that supported generated columns.

Those were added in SQLite 3.31.0 - and the SQLite version in the new base image is 3.34.1 - so I don't actually need pysqlite3-binary any more.

[simonw]

https://latest.datasette.io/-/versions now shows 3.11.

[simonw]

Opened an issue here:

• pysqlite3-binary package for Python 3.11 coleifer/pysqlite3#43