Hey guys in this blog we will build a Drowsiness Detection app that will detect if the person in the video is getting Drowsy or not.
This is a very interesting yet easy project with even less than 80 lines of code, so without any further due, let’s do it…
Sneak at our Output
Code for Drowsiness Detection
from imutils import face_utils import dlib import cv2 from pygame import mixer thres = 6 mixer.init() sound = mixer.Sound('alarm.wav') dlist =  detector = dlib.get_frontal_face_detector() predictor = dlib.shape_predictor("shape_predictor_68_face_landmarks.dat") cap = cv2.VideoCapture(0) def dist(a,b): x1,y1 = a x2,y2 = b return ((x1-x2)**2 + (y1-y2)**2)**0.5 while True: # Getting out image by webcam _, image = cap.read() # Converting the image to gray scale gray = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY) # Get faces into webcam's image rects = detector(gray, 0) # For each detected face, find the landmark. for (i, rect) in enumerate(rects): # Make the prediction and transfom it to numpy array shape = predictor(gray, rect) shape = face_utils.shape_to_np(shape) # Draw on our image, all the finded cordinate points (x,y) for (x, y) in shape: cv2.circle(image, (x, y), 2, (0, 255, 0), -1) le_38 = shape le_39 = shape le_41 = shape le_42 = shape re_44 = shape re_45 = shape re_47 = shape re_48 = shape dlist.append((dist(le_38,le_42)+dist(le_39,le_41)+dist(re_44,re_48)+dist(re_45,re_47))/4<thres) if len(dlist)>10:dlist.pop(0) # Drowsiness detected if sum(dlist)>=4: try: sound.play() except: pass else: try: sound.stop() except: pass # Show the image cv2.imshow("Output", image) if cv2.waitKey(5) & 0xFF == 27: break cv2.destroyAllWindows() cap.release()
- Line 1-4: Importing required libraries.
- Line 6: Setting a threshold (will see in the code ahead).
- Line 8-9: Creating alarm sound using the pygame module to use it further in the app.
- Line 11: An empty list that we will use ahead.
- Line 13: Using dlib face detector.
- Line 14: Using dlib landmarks detector to detect eye points.
- Line 16: Initializing cap object to use Webcam later.
- Line 18-21: A simple distance function that calculates the distance between two coordinates.
- Line 25: Reading images from the webcam.
- Line 27: Converting them to Grayscale.
- Line 30: Detecting faces.
- Line 33: Start traversing in those faces.
- Lin 35-36: Get the 68 face landmarks and convert them to a NumPy array.
- Line 39-40: Draw all the landmarks.
- Line 42-50: Extract required eye landmarks.
- For the left eye, we will extract 38, 39, 42, and 41.
- For the right eye, we will extract 44, 45, 48, and 47.
- Read the algo below once before reading further steps.
- Line 54: This line is responsible for keeping the size of dlist=10.
- Deletion is done from the front and addition is done in end.
- It’s like a queue system.
- Line 57-66: Play the alarm, when there are at least 4 Trues in the dlist. Stop it when they are less than 4.
- Line 69 – Show the Image.
- Line 71-72: Stop the app when the user hits the ESC key.
- Line 74-75: Close all cv2 windows and release the webcam.
Algo for detecting Drowsiness:
- Find the distances between 38-42, 39-41, 44-48, and 45-47 landmarks and find the average of those 4.
- If this average is greater than thres we defined initially, append/add a True in our dlist.
- If our dlist contains 4 or more Trues, it means in continuous 4 frames, drowsiness is detected so play the alarm.
- We have kept this concept of 4 or more because if we don’t do so, our program will play an alarm even when we blink which is False Positive.
Other Ideas for performing Drowsiness Detection:
- One way is what we performed above.
- The second way can be to train a Neural Network on face images.
- The third way can be to train a Neural Network on the eyes images.
So this is how you can perform Drowsiness Detection in python using cv2 and dlib.