Community Stacks

We love to see the community create and share new Jupyter Docker images. We've put together a cookiecutter project and the documentation below to help you get started defining, building, and sharing your Jupyter environments in Docker. Following these steps will:

  1. Setup a project on GitHub containing a Dockerfile based on either the jupyter/base-notebook or jupyter/minimal-notebook image.

  2. Configure GitHub Actions to build and test your image when users submit pull requests to your repository.

  3. Configure Docker Hub to build and host your images for others to use.

  4. Update the list of community stacks in this documentation to include your image.

This approach mirrors how we build and share the core stack images. Feel free to follow it or pave your own path using alternative services and build tools.

Creating a Project

First, install cookiecutter using pip or conda:

pip install cookiecutter  # or mamba install cookiecutter

Run the cookiecutter command pointing to the jupyter/cookiecutter-docker-stacks project on GitHub.

cookiecutter https://github.com/jupyter/cookiecutter-docker-stacks.git

Enter a name for your new stack image. This will serve as both the git repository name and the part of the Docker image name after the slash.

stack_name [my-jupyter-stack]:

Enter the user or organization name under which this stack will reside on Docker Hub. You must have access to manage this Docker Hub organization to push images here and set up automated builds.

stack_org [my-project]:

Select an image from the jupyter/docker-stacks project that will serve as the base for your new image.

stack_base_image [jupyter/base-notebook]:

Enter a longer description of the stack for your README.

stack_description [my-jupyter-stack is a community maintained Jupyter Docker Stack image]:

Initialize your project as a Git repository and push it to GitHub.

cd <stack_name you chose>

git init
git add .
git commit -m 'Seed repo'
git remote add origin <url from github>
git push -u origin master

Configuring GitHub actions

The cookiecutter template comes with a .github/workflows/docker.yml file, which allows you to use GitHub actions to build your Docker image whenever you or someone else submits a pull request.

  1. By default the .github/workflows/docker.yaml file has the following triggers configuration:

    on:
    pull_request:
      paths-ignore:
        - "*.md"
    push:
      branches:
        - main
        - master
      paths-ignore:
        - "*.md"
    

    This will trigger the CI pipeline whenever you push to your main or master branch and when any Pull Requests are made to your repository. For more details on this configuration, visit the GitHub actions documentation on triggers.

  2. Commit your changes and push to GitHub.

  3. Head back to your repository and click on the Actions tab. GitHub actions tab screenshot From there, you can click on the workflows on the left-hand side of the screen.

  4. In the next screen, you will be able to see information about the workflow run and duration. If you click again on the button with the workflow name, you will see the logs for the workflow steps. Github actions workflow run screenshot

Configuring Docker Hub

Now, configure Docker Hub to build your stack image and push it to Docker Hub repository whenever you merge a GitHub pull request to the master branch of your project.

  1. Visit https://hub.docker.com/ and log in.

  2. Select the account or organization matching the one you entered when prompted with stack_org by the cookiecutter. Docker account selection screenshot

  3. Scroll to the bottom of the page and click Create repository.

  4. Enter the name of the image matching the one you entered when prompted with stack_name by the cookiecutter. Docker image name and description screenshot

  5. Enter a description for your image.

  6. Click GitHub under the Build Settings and follow the prompts to connect your account if it is not already connected.

  7. Select the GitHub organization and repository containing your image definition from the dropdowns. Docker from GitHub automated build screenshot

  8. Click the Create and Build button.

  9. Click on your avatar on the top-right corner and select Account settings. Docker account selection screenshot

  10. Click on Security and then click on the New Access Token button. Docker account Security settings screenshot

  11. Enter a meaningful name for your token and click on Create Docker account create new token screenshot

  12. Copy the personal access token displayed on the next screen. Note that you will not be able to see it again after you close the pop-up window.

  13. Head back to your GitHub repository and click on the Settings tab. Github repository settings tab screenshot

  14. Click on the Secrets section and then on the New repository secret button on the top right corner (see image above).

  15. Create a DOCKERHUB_TOKEN secret and paste the Personal Access Token from DockerHub in the value field. GitHub create secret token screenshot

  16. Repeat the above step but creating a DOCKERHUB_USERNAME and replacing the value field with your DockerHub username. Once you have completed these steps, your repository secrets section should look something like this: GitHub repository secrets created screenshot

Defining Your Image

Make edits to the Dockerfile in your project to add third-party libraries and configure Jupyter applications. Refer to the Dockerfiles for the core stacks (e.g., jupyter/datascience-notebook) to get a feel for what's possible and best practices.

Submit pull requests to your project repository on GitHub. Ensure your image builds correctly on GitHub actions before merging to master or main. Refer to Docker Hub to build your master or main branch that you can docker pull.

Sharing Your Image

Finally, if you'd like to add a link to your project to this documentation site, please do the following:

  1. Clone the jupyter/docker-stacks GitHub repository.

  2. Open the docs/using/selecting.md source file and locate the Community Stacks section.

  3. Add a bullet with a link to your project and a short description of what your Docker image contains.

  4. Submit a pull request(PR) with your changes. Maintainers will respond and work with you to address any formatting or content issues.