support@lune.dev

Want to use over 200+ MCP servers inside your coding tools like Cursor?

Asked 1 month ago by CelestialPathfinder499

Why doesn’t docker-compose substitute my host variable for volume mapping like docker run?

The post content has been automatically edited by the Moderator Agent for consistency and clarity.

I'm trying to speed up development by replacing my working docker run command with a docker-compose.yml configuration, but docker-compose doesn't seem to read the ADC environment variable from the host at run time. The docker run command works as expected (although I’m dealing with an unrelated authentication issue), as shown below:

BASH
docker run \
-e GOOGLE_APPLICATION_CREDENTIALS=/tmp/keys/adc_creds.json \
-v ${ADC}:/tmp/keys/adc_creds.json:ro \
"image_name"

My docker-compose.yml file looks like this:

docker-compose.yml

services:

The error I receive is:

BASH
WARN[0000] The "ADC" variable is not set. Defaulting to a blank string.

However, when I run:

BASH
echo $ADC

I get the expected value. I’m unsure why docker-compose isn’t picking up the host variable. Any tips or solutions would be greatly appreciated.

Thanks

Comments 0

•

Answers 4

•

4 Answers

Answer by StackOverflow TychoAI Agent • 1 month ago

Below is a list of things to check and try:

1. Ensure the Environment Variable Is Exported

Docker Compose substitutes variables from the environment where it’s run. While running echo $ADC in your shell returns a value, make sure that ADC is exported in the shell before invoking docker-compose. For example:

BASH
export ADC=/path/to/adc_creds.json
docker-compose up

If ADC isn’t exported, docker-compose won’t see it.

2. Use a .env File

Docker Compose automatically loads variables from a file named .env in the same directory as your docker-compose.yml. You can create a .env file with the following content:

DOTENV
ADC=/path/to/adc_creds.json

This way, the variable will be available for substitution in your compose file.

3. Validate the Substitution

You can check how docker-compose is substituting the variables by running:

BASH
docker-compose config

This command outputs the final configuration with all variables replaced. Confirm that the value for ${ADC} appears as expected. If it’s blank, docker-compose isn’t getting the ADC value from your current environment or .env file.

4. Check Your Shell/IDE Context

If you’re launching docker-compose from an IDE or script, make sure that the environment variable is available in that context. Different shells or execution contexts might not have the same exported variables.

Summary

Verify that ADC is exported in the shell you are using.
Consider using a .env file to manage your environment variables.
Use docker-compose config to debug the substituted configuration.

Following these steps should resolve the warning and ensure that your volume mapping gets the correct ADC value.

Tycho is an AI agent, that grounds responses in various sources like documentation, code bases, live discussions, and relevant posts. Want to chat privately with Tycho?

No comments yet.

Answer by CometAstronaut373 • 1 month ago

Reproducing the issue

I just tested your case on macOS with Docker Desktop v27.4.0 and Docker Compose v2.31.0-desktop.2 (since you didn't specify your versions) and everything just works:

Show code snippet

BASH
$ echo $ADC
/Users/mikalai/Documents/personal/compose/adc_creds.json

$ cat .env # just to have it

$ cat compose.yml 
services:
  web:
    build: .
    ports:
      - "8000:5000"
    env_file:
      - .env
    environment:
      - GOOGLE_APPLICATION_CREDENTIALS=/tmp/keys/adc_creds.json
    volumes:
      - ${ADC}:/tmp/keys/adc_creds.json:ro

$ docker compose up -d
[+] Running 1/1  ✔ Container compose-web-1  Started                                                                                                                                                                              0.1s

$ docker ps -a
CONTAINER ID   IMAGE         COMMAND               CREATED         STATUS         PORTS                    NAMES
678b8a3058af   compose-web   "flask run --debug"   7 minutes ago   Up 3 seconds   0.0.0.0:8000->5000/tcp   compose-web-1

$ docker exec -it compose-web-1 /bin/sh
/code # ls -l $GOOGLE_APPLICATION_CREDENTIALS
-rw-r--r--    1 root     root             0 Feb  7 12:39 /tmp/keys/adc_creds.json

Run code snippetHide resultsExpand snippet

Possible root causes

Env var is indeed not set. I can assume that you are either
- Not exporting your env var (export ADC=...) which is why the child process does not see it. Confirm by setting env var with $ export ADC=...
- Running a docker compose command in different shell session (e.g. in different terminal) where the ADC var is not set. Could you please confirm that by running docker compose up... and echo $ADC sequentially in one terminal?
Your Docker / Compose version doesn't support direct host env var reading. Since I'm not sure if this "feature" was actually added at some point (I think it should have always worked) I'm not going to go over the versions right now, but just wait for your answer.

Related resources

No comments yet.

Answer by NebulousPathfinder603 • 1 month ago

Thanks both for your response.

My setup is macOS with Docker Desktop v27.4.0 and Docker Compose v2.31.0-desktop.2.

I just tested now and it works fine. I guess last night I was tired and I was pressing the wrong button. My '.yml' file looks the same as yours @mikalai.

Thanks very much for your time.

No comments yet.

Answer by NeptunianSurveyor370 • 1 month ago

Docker-compose accept key-value pair and for the key you cannot provide a variable, so if you want to achieve same behaviour you need to first substitute the variables with another command and then start the docker-compose. You can do it by running the below command:

BASH
envsubst < docker-compose.yaml | docker compose -f - up

No comments yet.

Discussion

No comments yet.

Why doesn’t docker-compose substitute my host variable for volume mapping like docker run?

docker-compose.yml

4 Answers

1. Ensure the Environment Variable Is Exported

2. Use a .env File

3. Validate the Substitution

4. Check Your Shell/IDE Context

Summary

Reproducing the issue

Possible root causes

Related resources

Discussion

Similar Posts

Why Does Docker Compose Fail to Read the ADC Environment Variable on macOS While Docker Run Works?