Integrated Calculator and Volume Controller with OpenCV

Hello People,

“I’m here with an article that will walk you through Open CV and provide a clear, step-by-step understanding.”

What is OpenCV?

OpenCV (Open Source Computer Vision Library) is a popular open-source library for computer vision and machine learning. It has a large and active user community of over 47,000 people, with more than 18 million downloads to date. OpenCV is widely used in various sectors, including companies, research groups, and government organizations.

The library was developed to create a standard infrastructure for computer vision applications and to speed up the integration of machine perception in commercial products.

About the Project?

This project combines a calculator and a volume controller using the OpenCV library. The application uses computer vision to create an easy-to-use interface, allowing users to perform calculations and control the system volume through simple gestures or visual inputs.

The calculator handles basic math operations, while the volume controller lets users adjust audio levels effortlessly. This project demonstrates how OpenCV can be used to create practical applications that integrate machine vision with everyday tasks.

How to Implement the Project?

First thing I have made this project using jupyter notebook . I have Installed libraries cv2 this is the OpenCV library used for various computer vision tasks, such as processing images and videos , HandDetector from cvzone.HandTrackingModule this module helps detect and track hand movements in real-time, allowing the program to recognize gestures , time a built-in Python module used for handling time-related functions, such as delays or timestamps , frame rates.

In the Volume Controller applications I have used the AudioTitles and IAudioEndpouintVolume from pycaw.pycaw for controlling system audio settings and I have imported it from github.

“Exploring the Functions: Key Components of the Hand Tracking , Computer Vision and Volume Control”

• **cv2.rectangle**: This function is used to draw a rectangle on an image. The parameters specify the image, coordinates of the rectangle, color (e.g., (0, 255, 0) for green), and border thickness.
• **cv2.putText**: This function is used to draw text on an image.
• **cv2.circle**: This function is used to draw a circle at specified coordinates on the image.
• **findDistance**: This function calculates the distance between two fingers.
• **cv2.VideoCapture**: Initializes video capture from the default camera (index 0). For an external camera, index 1 would be used.
• **detector = HandDetector(detectionCon=0.8, maxHands=1)**: Creates a HandDetector object with a detection confidence of 80% and a maximum of one hand detected.
• **fingersUp**: This function returns a list of 5 values where 1 indicates the finger is open and 0 indicates the finger is closed.

Calculator Block :

Creating Buttons : The Button class helps create and manage buttons on a screen. When you create a button, you set its position, size, and what it says. The draw method is used to display the button on the screen, drawing its shape and text. The checkClicks method checks if a user clicks on the button by looking at where they clicked and comparing it to the button's location. If the click is on the button, it changes the button's appearance to show it’s been clicked and returns True. This class makes it easy to add and interact with buttons in your application.

Evaluating of the Expression : This code section checks if a hand is detected and processes the hand's landmarks to determine if a button has been clicked. It gets the positions of the landmarks on the hand and measures the distance between the thumb and index finger. If this distance is less than 20 pixels, it assumes a button click has occurred. It then loops through the list of buttons, checking if the click happened on any button. If a button is clicked, it retrieves the button's value and updates the displayed equation. If the button's value is "=", it evaluates the equation; otherwise, it adds the button's value to the equation. There's a short delay after each click to ensure smooth operation.

Volume Controller Block :

Controlling the System’s Audio : This code initializes the audio settings for controlling the system volume. It first retrieves the audio device’s speaker settings. Then, it activates the audio endpoint interface to control the volume. The code gets the volume range, which provides the minimum and maximum volume levels. It sets the initial volume to 0 and stores these minimum and maximum values for later use, allowing the program to adjust the system volume accordingly.

Implementing the Volume Controller : This code section processes had gestures to control the system volume. It first checks if a hand is detected. If so, it retrieves the hand's landmark positions and measures the distance between the thumb and index finger. It draws circles around these landmarks on the image for visual feedback. The distance between the thumb and index finger is then used to calculate the volume level. This volume level is mapped from a range of 50 to 300 (representing finger distances) to the system's minimum and maximum volume levels. Finally, it sets the system volume to this calculated level.

Sample Pictures of My Project :

Volume Contoller :

calculator :

*(45*6 indicates 45 power 6)

In conclusion, this project shows how OpenCV can be used in real-life applications. By using hand gestures to control both a calculator and the volume, we’ve created a useful tool that’s easy to use. OpenCV’s technology helps make these controls intuitive, and other libraries add extra features. Overall, this project highlights how modern tech can make daily tasks easier and more interactive.