Installing Oobabooga(Gradio) UI on local environment. (MacOS-Apple Silicon)

Pre-requisites

You need to have a package management software installed on your mac to easily install python and few other essential packages such as pip, zlib. Let’s install Miniconda; a light-weight and opensource platform.

Open your terminal (Lanuchpad > Terminal) and run the following commands in the given order.

Installing Miniconda

1. Download the ARM version of Miniconda.

curl -O https://repo.anaconda.com/miniconda/Miniconda3-latest-MacOSX-arm64.sh

2. Run the Miniconda installer. (Follow the prompts to review and accept the license agreement, and specify the installation location if needed)

curl -O https://repo.anaconda.com/miniconda/Miniconda3-latest-MacOSX-arm64.sh

3. Activate conda.

conda init zsh source ~/.zshrc

Running source ~/.zshrc is a convenient way to refresh your terminal environment instantly, without having to close and re-open the terminal.

4. Verify the installed conda version.

conda — version

Now let’s get started.

Creating a conda environment with the desired python version.

conda create — name <conda_environment_name> python=3.10

With the above command, a conda environment is created, with python version 3.10. If you want to create a conda environment by the name ‘myenv’, you can replace <conda_environment_name> with ‘myenv’. You can also choose a desired python version based on your requirements.

Activating the conda environment.

conda activate <conda_environment_name>

Now the environment is ready, and you can install additional packages using Conda or pip.

Installing Pytorch in your conda environment.

pip3 install torch==2.4.1 torchvision==0.19.1 torchaudio==2.4.1

PyTorch is supported on macOS 10.15 (Catalina) or above. It is recommended that you use Python 3.9–3.12.

Installing Oobabooga UI.

Run the following comand in your terminal.

git clone https://github.com/oobabooga/text-generation-webui <foldername>

Go to the Oobabooga github repository and copy the URL.

You can create a new folder and install the web UI to that. In such a case, specify the folder name after the github URL. If you do not plan to perform the installation into a new folder, just run the above command without a folder name.

Installing the requirements_apple_silicon.txt file.

Navigate to the folder where the web UI is installed. If you’ve installed the UI to a custom folder as described in the previous step, you need to run the change directory command with that folder name.

pip3 install -r requirements_apple_silicon.txt

Launch the UI

Navigate to the folder where you’ve installed the web UI package. Run the following command in the terminal.

python server.py

Copy the local URL appearing on the terminal and paste it on a browser window. Ta Da ! 🎉. You will see the UI loading.

References : https://github.com/oobabooga/text-generation-webui