MD R. Islam
Published © LGPL

Alexa Doorman: Who Is at My Door?

Ask Alexa to see if someone's at the door or if a package has arrived at your doorstep! Build a smart camera skill using a webcam!

IntermediateFull instructions provided8,437

Things used in this project

Hardware components

UVC-compatible Camera
Only needed for Intel Edison setup
×1
SD Card
Only needed if your device doesn't have enough space to install the repositories.
×1
Intel® Edison and Arduino Breakout Kit
Only one Wi-Fi and camera stream device required.
×1
Raspberry Pi 2 Model B
Raspberry Pi 2 Model B
Only one Wi-Fi and camera stream device required.
×1
Camera Module
Raspberry Pi Camera Module
Only needed for Raspberry Pi setup
×1
Arduino UNO & Genuino UNO
Arduino UNO & Genuino UNO
Needed for ArduCam setup
×1
ArduCam Mini 2MP
Only one Wi-Fi and camera stream device required
×1
ESP8266 ESP-01
Everything ESP ESP8266 ESP-01
(Optional) If you want to send detection requests to a different server. You do not need a computation device locally with Arduino if you set this up.
×1

Software apps and online services

Alexa Skills Kit
Amazon Alexa Alexa Skills Kit
For the Alexa skill if you want to host it yourself
OpenCV
OpenCV
TensorFlow
TensorFlow
AWS Lambda
Amazon Web Services AWS Lambda
jubilinux
For Intel Edison setup
Arduino IDE
Arduino IDE
For Arduino setup

Story

Read more

Schematics

Arduino Uno R3 + ArduCAM Connections

Screen shot 2018 01 20 at 2 56 26 pm jyslhzjvbe

VUI diagram

How the Alexa Skills work
Vui 5vx6mbh77m

Architecture Diagram

High level diagram of how all the software components work
Doorman (2) qryveyr9ue

Code

Pre-trained TINY YOLO VOC model

Python
This is the tiny version of the detection model that does less than than the full one but some limited memory devices like the Edison/Raspberry Pi require this.
No preview (download only).

Pre-trained model

Python
Download and place in the yolo-detection-api project folder
No preview (download only).

YOLO Object Detection

Uses Darkflow YOLO to detect objects in a frame.

Arduino Sketch

Flash ArduCAM/examples/mini/ArduCAM_Mini_LowPowerMode/ArduCAM_Mini_LowPowerMode.ino

Device Stream Client

This client needs to be installed on the device that will capture images.

Smart Home Skill

Zip the contents of sample_lambda/python and upload to AWS Lambda

Link with Amazon App

This is the app that authenticates with the Alexa skill and manages user data and also hosts endpoints for the Custom Skill

Credits

MD R. Islam

MD R. Islam

6 projects • 6 followers
software engineer

Comments

Add projectSign up / Login