GPU ISSUES

Help! torch library is not compatible with My NVIDIA/ROCm/XPU/Jetson GPU!

Note

This Wiki is useful in case of the normal installation from "[./]ebook2audiobook.[sh/cmd]" fails. Using DEVICE_TAG=[XXX] is a temporary way to possibly solve your issue, however for a long term and stable solution please report your issue to the issues section.

Check if the toolkit and which version is installed

# CUDA
nvcc --version

# ROCm
rocminfo

# XPU
sycl-ls

• Check if your version is compatible with the min/max version of ebook2audiobook in lib/conf.py.
  Once your toolkit version is compatible, you can go to the next step.

Note

Replace [XXX] in the commands below by your gpu and version.
example: cu128 for cuda 12.8, rocm6.2 for rocm 6.2 etc.
xpu, mps and cpu don't need a version.

Native mode

First of all delete completely any previous ebook2audiobook folder. Then clone again the ebook2audiobook git repo or the last version and make a first run to create the python virtual environment.

cd ebook2audiobook

# Windows
    # Hardware autodetection
    ebook2audiobook.cmd
    # Hardware tagged
    set DEVICE_TAG=[XXX] && ebook2audiobook.cmd

# Linux/MacOS
    # Hardware autodetection
    ./ebook2audiobook.sh
    # Hardware tagged
    DEVICE_TAG=[XXX] ./ebook2audiobook.sh

Container mode

1. Build

# for All CPU/GPU/MPS

# Windows
    # Hardware autodetection
        # Docker:
        ebook2audiobook.cmd --script_mode build_docker
        # Docker Compose:
        ebook2audiobook.cmd --script_mode build_docker --docker_mode compose
        # Podman Compose:
        ebook2audiobook.cmd --script_mode build_docker --docker_mode podman
    # Hardware tagged
        set DEVICE_TAG=[XXX] && ebook2audiobook.cmd ...

# Linux/MacOS
    # Hardware autodetection
        # Docker:
        DEVICE_TAG=[XXX] ./ebook2audiobook.sh --script_mode build_docker
        # Docker Compose:
        DEVICE_TAG=[XXX] ./ebook2audiobook.sh --script_mode build_docker --script_mode compose
        # Docker Podman:
        DEVICE_TAG=[XXX] ./ebook2audiobook.sh --script_mode build_docker --script_mode podman
    # Hardware tagged
        DEVICE_TAG=[XXX] ./ebook2audiobook.sh ...

2. Run

# Container
    # Gradio/GUI:
        # CPU:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "./voices:/app/voices" --rm -it -p 7860:7860 athomasson2/ebook2audiobook:cpu
        # CUDA:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "./voices:/app/voices" --gpus all --rm -it -p 7860:7860 athomasson2/ebook2audiobook:cu[118/122/124/126 etc..]
        # ROCM:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "./voices:/app/voices" --device=/dev/kfd --device=/dev/dri --rm -it -p 7860:7860 athomasson2/ebook2audiobook:rocm[6.0/6.1/6.4 etc..]
        # XPU:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "./voices:/app/voices" --device=/dev/dri --rm -it -p 7860:7860 athomasson2/ebook2audiobook:xpu
        # JETSON:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "./voices:/app/voices" --runtime nvidia  --rm -it -p 7860:7860 athomasson2/ebook2audiobook:jetson[51/60/61 etc...]
    Headless mode:
        # CPU:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" "./tmp:/app/tmp" -v "/my/real/ebooks/folder/absolute/path:/app/another_ebook_folder" --rm -it -p 7860:7860 ebook2audiobook:cpu --headless --ebook "/app/another_ebook_folder/myfile.pdf" [--voice /app/my/voicepath/voice.mp3 etc..]
        # CUDA:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" "./tmp:/app/tmp" -v "/my/real/ebooks/folder/absolute/path:/app/another_ebook_folder" --gpus all --rm -it -p 7860:7860 ebook2audiobook:cu[118/122/124/126 etc..] --headless --ebook "/app/another_ebook_folder/myfile.pdf" [--voice /app/my/voicepath/voice.mp3 etc..]
        # ROCM:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" "./tmp:/app/tmp" -v "/my/real/ebooks/folder/absolute/path:/app/another_ebook_folder" --device=/dev/kfd --device=/dev/dri --rm -it -p 7860:7860 ebook2audiobook:rocm[6.0/6.1/6.4 etc.] --headless --ebook "/app/another_ebook_folder/myfile.pdf" [--voice /app/my/voicepath/voice.mp3 etc..]
        # XPU:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" "./tmp:/app/tmp" -v "/my/real/ebooks/folder/absolute/path:/app/another_ebook_folder" --device=/dev/dri --rm -it -p 7860:7860 ebook2audiobook:xpu --headless --ebook "/app/another_ebook_folder/myfile.pdf" [--voice /app/my/voicepath/voice.mp3 etc..]
        # JETSON:
          docker run -v "./ebooks:/app/ebooks" -v "./audiobooks:/app/audiobooks" -v "./models:/app/models" -v "./voices:/app/voices" -v "/my/real/ebooks/folder/absolute/path:/app/another_ebook_folder" --runtime nvidia --rm -it -p 7860:7860 ebook2audiobook:jetson[51/60/61 etc.] --headless --ebook "/app/another_ebook_folder/myfile.pdf" [--voice /app/my/voicepath/voice.mp3 etc..]
# Docker Compose (i.e. cuda 12.8:
        # Run Gradio GUI:
          DEVICE_TAG=cu128 docker compose --profile gpu up --no-log-prefix
        # Run Headless mode:
          DEVICE_TAG=cu128 docker compose --profile gpu run --rm ebook2audiobook --headless --ebook "/app/ebooks/myfile.pdf" --voice /app/voices/eng/adult/female/some_voice.wav etc..
# Podman Compose (i.e. cuda 12.8:
        # Run Gradio GUI:
          DEVICE_TAG=cu128 podman-compose -f podman-compose.yml --profile gpu up
        # Run Headless mode:
          DEVICE_TAG=cu128 podman-compose -f podman-compose.yml --profile gpu run --rm ebook2audiobook-gpu --headless --ebook "/app/ebooks/myfile.pdf" --voice /app/voices/eng/adult/female/some_voice.wav etc..