www.ecs.umass.edu

www.ecs.umass.edu

Comprehensive Design Review SDP Team 6 Sanghoon Lee David Meschisen Jori Platt Minwo Wang Department of Electrical and Computer Engineering 1 The Team

Sanghoon Lee Microcontroller Camera IOIO David Meschisen

Projector/Display PCB Power System Department of Electrical and Computer Engineering Jori Platt

Wink Detector Camera Casing Minwo Wang Phone App IOIO PCB 2

HUDware Description A heads-up-display (HUD) attachment that connects a skier to their mobile device Uses wink detection to allow hands-free manipulation of the device to view data like messages or the weather within their ski goggles Department of Electrical and Computer Engineering 3 Block Diagram

Department of Electrical and Computer Engineering 4 Specifications - General Lightweight attachment to your ski goggles (less than 100g) Operational temperature range:-20C to 30C Low power consumption (less than 4 watts) Duration (~4 hours) Unobstructed view Department of Electrical and Computer Engineering

5 Phone Functionality GPS functionality(Speed) Message Sensor Data Department of Electrical and Computer Engineering 6 Phone Functionality-GPS GPS functionality

Integrating Google Play Service Using LocationManager Current working functionality Getting longitude and latitude accurately Being able to send out these data throughout IOIO Can be used to calculate the speed Department of Electrical and Computer Engineering 7 Phone Functionality-SMS Short-Message-Service functionality

Using Broadcast Receiver Testing it on Virtual Device using emulator Current functionality Message can be detected & received Department of Electrical and Computer Engineering 8 Text Image Generator Update Since MDR Able to get phones data Able to send out data vias IOIO UART

Current State Change data into String Using Java Inputstream and Outstream Department of Electrical and Computer Engineering 9 Microcontroller Facilitates serial text data from IOIO to OLED Display Sends Wink Detections GPIO signals to IOIO Connected Subsystems

Pi Camera - camera cable OLED Display - SPI cable IOIO - GPIO wires & Serial cable Department of Electrical and Computer Engineering 10 Microcontroller Requirements Maintain communication link between phone app and OLED display Drive PiCamera Support Wink Detection & OLED Display codes MCU Temperature: less than 80C

Operating temperature range: -20C to 30C Power consumption: less than 1 W Size: less than 80mm x 80mm x 10mm Department of Electrical and Computer Engineering 11 Microcontroller Update Since MDR Code imported from B+ to Zero Current State

Simultaneously supports OLED Display & Wink Detector codes Future Work Securely place in goggles (OPTIONAL): Add another Zero to distribute work Department of Electrical and Computer Engineering 12 IOIO Interface between Android phone and RPi

Connected Subsystems Android phone/App - Micro-USB B to USB Cable RPi Wink Detector - GPIO Ports/Wires Text Image Generator - Serial Ports/Wires Department of Electrical and Computer Engineering 13 IOIO Requirements Provide Serial Data Transmission Stable USB Connection

AOA Protocol over ADB Protocol Read GPIO input and Analog Input Write GPIO Output Department of Electrical and Computer Engineering 14 IOIO Update Since MDR Demonstrated simple GPIO output tests Current State

Receives GPIO signals from RPi Sends serial signals to RPi Future Work PCB Placement Department of Electrical and Computer Engineering 15 Augmented Reality Display SSD1351 OLED Display (128x128)

Utilizes Peppers Ghost Effect 5 Pins connected to the PI Zero 4 SPI pins 1 GPIO pin Uses SPI Bus on PI Zero Department of Electrical and Computer Engineering 16 Augmented Reality Display Update:

Integrated into PI Zero Displays Text generated from the phone Mirrored for accurate reflected display Still need to focus the reflected display more for the users viewing Requirements:

Focused & legible display (Image & Text) Minimum: 90 nits = 90 cd/m2 Target Range: 100 - 200 nits = 100 - 200 cd/m2 Operating temperature range: -20C to 30C Size: less than 50mm x 50mm Power Consumption: less than 1W *The candela per square metre (cd/m2) is the derived SI unit of luminance. The unit is based on the candela,

the SI unit of luminous intensity, and the square metre, the SI unit of area. Nit (nt) is a non-SI name also used for this unit (1 nt = 1 cd/m2). (Wikipedia) Department of Electrical and Computer Engineering 17 Casing Department of Electrical and Computer Engineering 18 Casing

Houses several subsystems Fits between the users goggles and their face Connected Subsystems Display - Housed Wink Detector - Affects Calibration Camera - Housed Raspberry Pi - Attached Externally Power System - Attached Externally

Department of Electrical and Computer Engineering 19 Casing Requirements Lightweight (less than 100g when combined with components) Houses relevant HUDWare components Camera, OLED, Reflector Screen, MCU, Power System Desired operational temperature range (-20C to 30C) Unobstructed view

Department of Electrical and Computer Engineering 20 Casing Update Since MDR Designed Assembled Integrated Current State Printed out Assembled

Future Work Improving Ergonomics Housing Power System and MCU internally Reduce Visual Obstruction Department of Electrical and Computer Engineering 21 Power System Supplies power to MCU, IOIO, Camera, and OLED Connected Subsystems

MCU, IOIO - wired OLED, Camera - indirectly via MCU Department of Electrical and Computer Engineering 22 Power System Requirements Supplies whole system with power for 4 hours (Active Mode) Estimates 4Wh or 800mAh Idle Mode: 33.6 mA to IOIO 140 mA to RPi Active Mode:

60 mA to IOIO 140 mA to RPi Department of Electrical and Computer Engineering 23 Power System Update Battery can successfully power all systems at once Supplies 2200 mAh Required 800 mAh for 4 hours Future Work

Testing Department of Electrical and Computer Engineering 24 Wink Detector Uses the camera and image processing to detect winks by the user Connected subsystems MCU - Located inside IOIO - GPIO connections Camera - Wired connection

Department of Electrical and Computer Engineering 25 Wink Detector Requirements Accurate - Reads at least 90% of frames correctly Quick - Reads frame in 0.25 seconds or less Min 2FPS - Total time between image capture and analysis less than .5 seconds Output control signals to the phone Department of Electrical and Computer Engineering

26 Wink Detector Update Since MDR GPIO signals to IOIO generated Current State Detects circles and generates appropriate control signals Averages 6.5 fps reduced to half to reduce jitter Future Work

Calibration in final setup Testing Streamlining Department of Electrical and Computer Engineering 27 PCB Layout (Preliminary) Department of Electrical and Computer Engineering 28

PCB Future Considerations: Adding a power button Fabricated Department of Electrical and Computer Engineering 29 Deliverables For CDR Full app functionality Communication to and from phone Controls to the phone

Text from the phone Power system setup Prototype setup Goggles setup with camera and display Microcontroller switched to RPi Zero PCB board layout Department of Electrical and Computer Engineering 30

Proposed Deliverables For FDR PCB fabricated Full product assembled All parts integrated in casing Phone App Projection clearly visible Wink Detection allows for easy control Department of Electrical and Computer Engineering

31 Demonstration Department of Electrical and Computer Engineering 32 Backup Slides Department of Electrical and Computer Engineering 33

Gantt Chart Department of Electrical and Computer Engineering 34 Budget Spent so far $49.49 Upcoming costs PCB - $100 Fisheye lens - $15

Breathing Room $335.51 Department of Electrical and Computer Engineering 35 Sample control system Right wink: select item Left wink: change item Data Speed Gravity Back

Message Display Back Music Pause/play Skip Back Department of Electrical and Computer Engineering 36 Phone GPS Test Video

Department of Electrical and Computer Engineering 37 Display Code Test Video Department of Electrical and Computer Engineering 38

Recently Viewed Presentations

  • Exploiting System Diversity in Peer-to-Peer Publish-Subscribe ...

    Exploiting System Diversity in Peer-to-Peer Publish-Subscribe ...

    Exploiting System Diversity in Peer-to-Peer Publish-Subscribe Systems. Final Exam of Jay A. Patel (April 1, 2009)
  • Biooinformatic tools for detecting regulatory elements shared ...

    Biooinformatic tools for detecting regulatory elements shared ...

    A pattern is a sequence of simple pattern units. A simple pattern unit is either a named pattern unit, a complementation rule pattern unit or a basic pattern unit. In pattern definition, upper and lower case can be used interchangeably.
  • 4. Atmospheric transport Forces in the atmosphere:  Gravity

    4. Atmospheric transport Forces in the atmosphere: Gravity

    4. Atmospheric transport * Summary of where we will end up in this lecture * Consider the way mass is moved here—then discuss MASS FLOW: convergence and divergence / lows and highs / at the surface and aloft.
  • Determining McKinney-Vento Eligibility under ESSA - NCHE

    Determining McKinney-Vento Eligibility under ESSA - NCHE

    The Preventive Value of Education. Children in quality preschool programs are more likely to graduate from high school and own homes. High school graduation is associated with an array of positive live outcomes ( unemployment, criminal justice involvement, income, health...
  • Year 3 Parent Information Night

    Year 3 Parent Information Night

    I dreamed I stood in a studio and watched two sculptors there. The clay they used was a young child's mind and they fashioned it with care. One was a teacher, the tools she used were books and music and...
  • Australias Vocational Education & Training System and its

    Australias Vocational Education & Training System and its

    Queanbeyan Lismore/Ballina Darwin Perth Adelaide Gosford Hunter Illawarra Dubbo Western Sydney Port Macquarie Northern Tasmania North Brisbane Gladstone Townsville Gold Coast Pilbara Whyalla/Port Augusta Geelong Warrnambool Bairnsdale/Sale Eastern Melbourne Bendigo Sunshine New technical ...
  • Hvac Equipment

    Hvac Equipment

    Static Regain Method Refers to increase or regain of static pressure in the ductwork when the air velocity decreases. Ducts are sized calculating air velocity for all sections where changes in air velocity takes place. Static regain calculations help to...
  • Retos des los profesionales de la gestión de la información ...

    Retos des los profesionales de la gestión de la información ...

    International Perspectivesin Health Information Management. Angelika Händel, M.A. President of IFHIMA 2013 - 2016. Madam president, thank you very much for your kind introduction.