Docker Labs: GenAI | No. 3

As we learn how to work more effectively with generative AI, one of the tasks we return to is Dockerfile generation. Since we can equip our AI assistants with tools, does this allow us to reframe the problem of content generation as an interaction between LLMs and tools?

If you ask ChatGPT to write a Dockerfile for your project, it will initiate a conversation with you and ask you to extract some details from your project.

However, we can also equip our assistant with a tool to extract this information from the project directly.? Instead of asking the user, an assistant can ask for a tool instead.

Using Tools

Here’s an alternative framing. Let’s prompt the assistant with two high-level instructions whenever it is asked to create a Dockerfile.

* First, analyze the project to determine how it should be built.?
* Once the analysis is complete, create a Dockerfile to build that project.        

In addition to these new prompts, we will also supply the LLM with two function definitions.

[{"name": "analyze_project",
?"description": "Analyze a project to determine how it should be built"},
?{"name": "write_files",
  "description": "write a set of files to my project",
??"parameters": {...}}]        

With these two functions, the assistant will have enough agency that it can write a Dockerfile directly to a user’s project.? Unfortunately, without best practices, the actual Dockerfile content is never very good.? Here’s an example of the kind of Dockerfile that gets generated when the assistant knows the kind of project but not much else.

# Use the official Node.js image from the Docker Hub
FROM node:14

# Create and change to the app directory
WORKDIR /usr/src/app

# Copy the package.json and package-lock.json files
COPY package*.json ./

# Install dependencies
RUN npm install

# Copy the rest of the application code
COPY . .

# Expose the port your app runs on
EXPOSE 3000

# Define the command to run your app
CMD ["npm", "start"]        

This example shows quite a few standard Dockerfile authoring problems.

• uses out of date base images
• does not employ multi-stage builds
• skips newer Docker features such as cache mounts

So what can we do about this? Let’s extract some best practices for authoring NPM project Dockerfiles.

Write Dockerfiles for NPM projects using three stages.? Do these three steps sequentially.
* the first node dependencies stage should be called "deps"?
 ?and it should fetch the runtime dependencies using npm ci
??with the --omit=dev flag.
* The second Dockerfile stage should be called build??and it should be based on the deps stage.?
??It should run npm ci and then npm build
* The third Dockerfile stage should select a base image?
??that is recommended by Scout and use that in the FROM line.
??This stage should do then do three things.
??? 1. it copies the node_modules directory from the deps stage.
????2. it copies the dist directory from the build stage.
????3. it then runs npm start

If you need to use a RUN statement containing npm ci always?
add the argument --mount=type=cache,target=/root/.npm to the RUN instruction.??
The --mount argument should be placed between the word RUN and the npm command.
This will cache the npm packages in the docker build cache and speed up the build process.
After selecting a base image, get a recommended tag. This recommendation will change over time but start with what is recommended now.        

We’ll include this content in any conversation occurring in the context of an NPM project.? We’ll also add a third function.

[{"name": "docker_scout_tag_recommendation",
??"description": "get a recommended tag",
??"parameters": {...}}]        

At the time of writing, here’s the output from our assistant.? In this example, the assistant is using the gpt-4 model, but we are seeing the same results with other local models.

# Stage 1 - Downloading dependencies
FROM node:22-slim AS deps
WORKDIR /usr/src/app
COPY package*.json ./
RUN --mount=type=cache,target=/root/.npm npm ci --omit=dev

# Stage 2 - Building application
FROM deps AS build
RUN --mount=type=cache,target=/root/.npm npm ci && npm build

# Stage 3 - Using a recommended base image from Scout
FROM node:22-slim
WORKDIR /usr/src/app
COPY --from=deps /usr/src/app/node_modules ./node_modules
COPY --from=build /usr/src/app/dist ./dist
CMD [ "npm", "start" ]        

This is a big improvement.? The three inputs that underlie this improvement are listed below.

• the two top-level instructions that anchor the process our assistant should use

First, analyze the project to determine how it should be built.?
Once the analysis is complete, create a Dockerfile to build that project.        

• the markdown content that summarizes our Docker specific best practices
• the functions (`analyze_project`, write_files, and docker_scout_tag_recommendation)

Distilling best practices is certainly not easy, but a little can go a long way.? Still, it is still hard to know whether this can be considered an improvement over just using code templates.? Our continuing investigation centers around whether generative AI will help us to more easily adapt these models to new knowledge, new features, and new project types.?

The Conversation Loop

It’s instructive to go through the actual messages passed between agents here.? It’s particularly interesting to look at the interplay between the Assistant and the Tool agents.? Near the end of the exchange, there is an unexpected twist where the write_files Tool complains that it was passed an invalid JSON file.? In this case, the assistant actually did generate invalid json and the tool was right to complain.? However, the assistant also responded to this error by fixing the json and calling the tool a second time!? That was unscripted.

Another interesting example of an unscripted moment is the last message from the assistant.? The assistant correctly determines that the task is now complete and generates a summary of the work that was done and why.

Transcript

System:

You are an assistant who specializes in authoring Dockerfiles for projects. Since you are an expert and know about their project, be definitive about recommendations.

User:?

* First, analyze the project to determine how it should be built.?

* Once the analysis is complete, create a Dockerfile to build that project.

Assistant:

[{:function {:arguments "{}" :name "analyze_project"}}]        

Tool (analyze_project):

This is an NPM project.

System:

Write Dockerfiles for NPM projects using three stages.? Do these three steps sequentially …

…

… (all of the best practices but for brevity) ..

…

Assistant:

[{:function {:arguments "{
??\"repository\": \"node\"
}"
?????????????:name "docker_scout_tag_recommendation"}}]        

Tool (docker_scout_tag_recommendation):

22-slim

Assistant:

[{:function {:arguments "{
??\"files\": [
????{
??????\"path\": \"Dockerfile\",
??????\"content\": `
# Stage 1 - the build process
FROM node:22-slim AS deps
WORKDIR /usr/src/app
COPY package*.json ./
RUN --mount=type=cache,target=/root/.npm npm ci --omit=dev
# Stage 2 - the production environment
FROM deps AS build
RUN npm ci && npm run build
# Stage 3 - the production environment
FROM node:22-slim
WORKDIR /usr/src/app
COPY --from=deps /usr/src/app/node_modules ./node_modules
COPY --from=build /usr/src/app/dist ./dist
CMD [ \"npm\", \"start\" ]`,
??????\"executable\": false
????}
??]
}"
?????????????:name "write_files"}
??:id "call_6VVCLiXcIBNyEGPQwftR7xEV"}]        

Tool:

function call write_files failed call exited with non-zero code (1):? call exited with non-zero code (1): #error {\r\n :cause Unexpected character ('`’)

Assistant:

I apologize for the error. Let me try that again.

[{:function {:arguments "{
??\"files\": [
????{
??????\"path\": \"Dockerfile\",
??????\"content\": \"FROM node:22-slim AS deps\\nWORKDIR /usr/src/app\\nCOPY package*.json ./\\nRUN --mount=type=cache,target=/root/.npm npm ci --omit=dev\\n\\nFROM deps AS build\\nRUN npm ci && npm run build\\n\\nFROM node:22-slim\\nWORKDIR /usr/src/app\\nCOPY --from=deps /usr/src/app/node_modules ./node_modules\\nCOPY --from=build /usr/src/app/dist ./dist\\nCMD [ \\\"npm\\\", \\\"start\\\" ]\",
??????\"executable\": false
????}
??]
}"
?????????????:name "write_files"}}]        

Tool (write_files):

wrote 1 files: Dockerfile

Assistant:

I have written the Dockerfile for your NPM project. You can find it in your project folder. This Dockerfile uses a multi-stage build process to efficiently build and run your application within a Docker container. The first stage fetches the runtime dependencies, the second stage builds the application, and the final stage runs the application. Please let me know if you need further assistance.

Summary

For a generative AI assistant to improve its ability to generate Dockerfile content, we have identified both tools and stack specific best practice content as key enablers.? Incorporating these elements into a generative AI based assistant can serve as an alternative to code templates.? We continue to evaluate whether this approach allows us to more easily adapt to new project types.

As always, feel free to follow along in our public repo and please reach out.? Everything we’ve discussed in this blog post is available for you to try out on your own projects.

For more on what we're doing at Docker, subscribe to our newsletter.