CUSTOMER-EXPERIENCE ENHANCEMENT SYSTEM

Introduction

Hello, We are Team Penn Dinosaurs!

Here, You can take a tour of our project named "Customer-experience enhancement system!"
that we developed while working on final project for ESE 5190 Embedded Systems at University of Pennsylvania.
Introduction
Inspiration
narrative

Introduction


The inconvenience of taking care of the children has bothered the customers who go for service or business for a long time, and few ways are efficient enough to help the customer take care of the children. One possible option is to hire people for children-care services, which is expensive and may not be feasible for most general service institutions since they may not have much extra budget. Inspired by the idea of the chrome dino game, a design of the customer-experience enhancement system is proposed to provide a feasible and reliable way to take care of the children of customers when they come for service to improve customer experience further. The system combines the dino game, face tracking pan-tilt camera, and the LCD & Speaker arrangement for customer interaction for playing music. In the paper, we will introduce the project's background(problem statement) first, then discuss the source of inspiration. Next, we will illustrate the system architecture and objects of this system. After giving this basic information about the project, we will show the technical details, such as the component lists, the connection diagram, the troubleshooting process, and the result.

Project Architecture


Introduction

Circuit Diagram of the elements of our Project


Dino Game


Introduction

Pan - Tilt Person Decting & Following Camera


Introduction

Customer Interaction - LCD & Speaker for Playing


Introduction

Operations/Functionalities:


1. Dino Game:


Our aim in this game was to develop Google's Dino game using the Raspberry Pi Pico board, which has an RP2040 microcontroller.

The following features are included in this game:

  1. It has three levels (level1 - easy, Level 2 - Medium, Level 3 - Hard). The difficulty at each level would rise in proportion to the increasing score.

  2. The game has two sounds, one for the humping dino and the other when the “Game is Over” (Dinosaur crashes with the cactus and dies), signifying that the user input of button press supplied by the Game player was successfully executed. Moreover, make the game more interactive. A speaker was employed for this reason.

  3. It employs a VGA display to display all visuals on the monitor. We leveraged the PIO functionality of RP2040 to achieve this feat of running the VGA display using the tiny and cheap Pico. We used bitmaps to draw the shape of a dinosaur and different types of cacti.

  4. For user interaction, we used a “glowing” big push button, for an interactive user experience.

  5. We also created different high-score buffers for different levels. The aim was to keep track of the highest score achieved at each level. Moreover, to create a competition during the demo day to beat the highest score. This makes the game more user interactive and fun.

2. Person Detection:


This element of our project was utilized to recognize faces and shift the pan tilt to that direction dependent on the movement of the individual. This enables face tracking feature.

This work includes the following features:

  1. It has three levels (level1 - easy, Level 2 - Medium, Level 3 - Hard). The difficulty at each level would rise in proportion to the increasing score.

  2. It houses the Raspberry Pi Camera Module V2 on the Arducam Pan Tilt arrangement. This coordinated movement of servos and cameras enables the functionality of face tracking.

  3. Its pan tilt camera would move up/down and left/right based on the person's movement measuring the relative movement of the frame and trying to reduce the positional error by moving the servos and hence the camera.

3. Human Interaction Interface:


This portion of our project was leveraged to construct a user interactive interface like "Google Assistant".

This work includes the following features:

  1. It asks the person's name.

  2. It greets the user by name, asks if they want to listen to music, and suggests some songs.

  3. It plays the music based on various interest filters.

Components


Components

Photos of our final model:


Dino Game


Introduction

Pan - Tilt Person Decting & Following Camera


Introduction

Customer Interaction - LCD & Speaker for Playing


Introduction

GIFs from our projects:


Dino - Game: Level - 1


Introduction

Dino - Game: Level - 2


Introduction

Dino - Game: Level - 3


Introduction

Pan - Tilt Person Decting & Following Camera


Introduction

Customer Interaction - LCD & Speaker for Playing


Introduction

Videos from our projects:


Dino - Game: Level - 1


Dino - Game: Level - 2


Dino - Game: Level - 3


Pan - Tilt Person Decting & Following Camera


Customer Interaction - LCD & Speaker for Playing


Setup Guide
Troubleshootings
PIO
Team
Final Project
Project Code

Future Scope


Although improving the customer experience and providing an exciting experience has always been an aim of society. This is a large project with a lot of room for growth in the future. We've just mentioned a handful of them here.

  1. In the Dino Game section, visitors can select the game they wish to play. So, instead of just one option for playing the Dino Game, we'll provide you with a range of fun to play.

  2. Face tracking pan tilt will notify the parent of the child who will be playing if it does not identify the child for more than 5 minutes. It would serve as a surveillance device, tracking children while they played.

  3. For human interaction, we can upgrade it to make it behave like a "Google Assistant," which can display real-time statistics such as temperature and pressure and chat with the user as a virtual assistant.

Our Accomplishments


  • Fully functional chrome dino game with multiple levels, PWM audio, PIO based VGA Display, bitmaps for cactus and dinosaur, And a high score buffer for each level to initiate the competitive motive among the users.

  • A functional face tracking pan-tilt.

  • An user interactive Interface that operates like a Virtual Assistant like "Google Assistant"

Thank You!