Homework 1 - Computer Action Team

Homework 1 - Computer Action Team

Homework 1 (with additional explanations) Intelligent Robotics 1, ECE 478/578 Deadline, October 15 This Homework is Group Project Will be incorporated into your final project About Homework 1 for all students 1. 2. Students who work with Richard Armstrong on Mr. Jeeves are not required to do these homeworks. You discuss all your mini-projects with Rick. 1. 2. 3. 4. Two homeworks are mandatory for all other students. Because of additional Intel Projects, the homework deadlines will be extended. You work in your initial teams or teams of your choice. You can use work of other students as part of your project but you must specifically mention it. 5. I am grading based on results and not good will of a student. First two phases of Homework 1 are mandatory Third first of Homework 1 is for volunteers only. In this homework 1 you will learn: 1. 2. 3. 4. 5. Use of Kinect The concept of state machine in robotics. The concept and use of fuzzy logic in robotics Using Powerpoint for scenario prototyping. Dialogs with robots.

Explanation to the first phase of Homework 1 1. Create Powerpoint presentation with effects, figures, pictures, videos, etc A) Presentation about Copernicus for those in Copernicus group B) Presentation about Frankenstein Monster and PSU for those in Monster Group and in stage design group. C) Presentation with the Quantum Debate play for those in Quantum Debate Play robots (Einstein, Newton, Marie Curie, Cat and Bohr). 2. These slides can be done with jumps and transitions, as in my PPT slides demonstrated in class, but must have better effects and be more theatrical. Record your voice we need more male voices. These voices and other sounds should be incorporated into the PPT presentation. 3. Add questions and answers in Romanian, Spanish, Russian, Chinese, Indian, etc. (we have Latin and German already). Do not spend too much time, do this only if you are familiar with these languages. 4. Use Kinect-based control of PPT slides software from my class and/or from internet. 5. See the separate files for explanation of this software. the first phase of Homework 1 Human gestures Kinect Kinect processing software (exist) Pressing PPT button slide Convert to PPT instruction (exist) PPT

effects sounds Explanation to the SECOND phase of Homework 1 1. Complete and test the first phase. 2. Create a state machine that describes the behavior of the robot, robots or/and the entire theatre presentation. 3. This machine can be deterministic, probabilistic of fuzzy. Or mixed. It can have several machine communicating with one another. It can be programmed in any language. 4. The entire system can be written in any language of your choice, or mixture of languages. It should use PPT, and Kinect software. 5. The block-diagram of the system is shown in next slide. 6. Next three slides present some variants of the state machine. You are not restricted to them. You can create arbitrary state machine. 7. Additional slides demonstrate fuzzy and other state machines for a robot. 8. Videotape your work. Write a document report.

Complete software for the second phase of the Homework 1 (minimum variant) Human gestures Kinect Kinect processing software (exist) Simulation of pressing PPT button slide Convert to PPT instruction (exist) PPT effects sounds Simulation of pressing PPT button State machine that describes the entire behavior of the robot and slides Part in pink is new. It can be written in any language, perhaps the easiest is to use the same

language in which Kinect Processing and conversion was written (color grey) Fuzzy logic, Boolean Logic, Probabilistic logic Action of the robot (signals to motors) Feedback loop Memory, fuzzy of boolean Additional explanation 1. Observe that the only input to a robot is Kinect. 2. Thus the robot is controlled by one or more of the following a. b. c. d. e. f. g. h. i. Human gestures with arms Human gestures with skeleton Human pressing buttons or using any mechanical interface Position of other robots as seen on Kinect. Position of people as seen by Kinect Quality of human motion in exercise, as evaluated by some objective criteria Any other idea taken from literature about uses of Kinect. Any of your ideas, be creative.! The robot can be physical : a. b. c.

j. any robot in the lab, Lego robot on your own, what you want. The robot can be simulated : a. b. Simple ad hoc graphics like in Robo-Logo or Lego, turtle graphics. Any existing software for simulating andvanced robots (needs some simple integration). Simplified State Machines of robot plays M2. State Machine of Regular Linear play M1. State Machine of Copernicus Initial slide with questions Question button Clear button Answer to last question Slide with answer to question 1 Slide with answer to second question This is model of simple linear play like in standard

theatre and Great Quantum Debate play Combined M1 and M2. Answer to a question is a Regular Linear play Initial slide with questions Question button This is model of simple question answering Answer to last question Slide with answer to question 1 Other combinations are of course possible Slide with last behavior Slide with behavior 3 Slide with behavior 2 Slide with behavior 1 Slide with answer to second question

This is model of simple question answering Slide with behavior 1 Slide with behavior 2 Slide with behavior 3 Slide with last behavior Simplified State Machines of robot plays M2. State Machine of Regular Linear play M1. State Machine of Copernicus Initial slide with questions Question button Clear button Answer to last question Slide with answer to question 1

Slide with answer to second question This is model of simple linear play like in standard theatre and Great Quantum Debate play Combined M1 and M2. Answer to a question is a Regular Linear play Initial slide with questions Question button This is model of simple question answering Answer to last question Slide with answer to question 1 Other combinations are of course possible Slide with last behavior Slide with behavior 3 Slide with behavior 2 Slide with behavior 1

Slide with answer to second question This is model of simple question answering Slide with behavior 1 Slide with behavior 2 Slide with behavior 3 Slide with last behavior Simplified State Machine of interactive robot play M3. State Machine with interaction (similar to one explained in class for Paradise Lost) The decision variables are inputs, for instance from sensors or from pressing PPT buttons This is equivalent to Finite State Machine or general Flowchart Slide with behavior 2

Slide with behavior 1 Slide with behavior 3 Decision Node Question A Negative answer Positive answer Behavior $r Behavior 1 Decision for input variable B Negative answer Positive answer Slide with behavior 2 Slide with behavior 3 Slide with behavior 4 Slide with

last behavior Remarks 1. There are many people working on the same part of homework (like all people from Copernicus team) 2. The homeworks for all students (Copernicus team, quantum debate teams and Monster team) in the class are quite similar. 3. Software for Kinect exists and can be also found in internet. 4. Partial credit will be given for partial solutions. 5. Creativity will be rewarded. 6. Ask me questions if not clear. Explanation of the third phase of Homework 1 (NOT MANDATORY) Additional work for people who already work on projects (not required now, but will count for the next homework and your project) 1. Assume any robot from the lab, it can be particularly your robot from your project (this would save you time later on). 2. The robot must have some input(s) other than KINECT. This can be touch sensors, sonars, light sensors, etc. Your choice. 3. The robot should have some effectors. 4. It can be a Lego robot of your design. See my slides. 5. The robots architecture can be any architecture discussed so far in our class, for instance a Braitenberg Vehicle.

6. The robot behavior is changed by gestures from KINECT. For instance, you can use your hand gestures or facial gestures to change the behavior of a Braitenberg Robot from Aggressive to Shy. 7. All your work should be videotaped. Complete software for the additional work for the Homework 1 Human gestures Kinect processing software (exist) Kinect Simulation of pressing PPT button slide Convert to PPT instruction (exist) PPT effects sounds Simulation of pressing PPT button Physical inputs of the

robot (from sensors of human controls, or gestures from Kinect) More inputs Fuzzy logic, Boolean Logic, Probabilistic logic Action of the robot (signals to motors) Feedback loop Memory, fuzzy of boolean List of useful documents on this page for Week2 1. 2. 3. 4. 5. 6. Scripts of plays and conversations. Report about KINECT to PPT interface done in our class. Other reports about KINECT to PPT interfaces. Other reports about controlling robots with KINECT. Class material about fuzzy logic. Material (PPT slides and text) about using a simple quantum(probabilistic) control of a Braitenberg robot in RobotC language.

Recently Viewed Presentations

  • The Olmec - Fleming County Schools

    The Olmec - Fleming County Schools

    The Olmec Origins. Olmeca means "people of rubber country". Rubber was a well established commodity in the region which initiated the name. Built a religious centre in San Lorenzo which was destroyed in 900 BC. Another was built in La...
  • Drug Dissolution Process - Pharmawiki.in

    Drug Dissolution Process - Pharmawiki.in

    Zero order kinetic model can be used to describe the drug dissolution of several types of modified release pharmaceutical dosage forms, as in case of some trans dermal systems ,as well as matrix tablets with low soluble drugs, coated forms...
  • Inverted vs. Natural Order of Sentence

    Inverted vs. Natural Order of Sentence

    Inverted vs. Natural Order of Sentence BY: TYNISHA ALSTON and CAMILLE HOLLINGER Authors Purpose? So, what is the author purpose behind the arrangement of sentences in his/her work? Answer! The main attribute of differentiating certain phrases and complex/ compound sentences...
  • Outreach and Engagement Inter-Agency Fare Coordination and Joint

    Outreach and Engagement Inter-Agency Fare Coordination and Joint

    HOWEVER, if you already have people sitting around talking about transit service networks and when their agencies will get money for improvements, you can trick them into also talking about fare pricing, policy, and technology. In 2016 voters approved a...
  • Decision Making Skills - Jefferson County Public Schools

    Decision Making Skills - Jefferson County Public Schools

    Decision Making Skills Counselor's Presentation Grades K-3 How to Make Good Choices What is the choice I need to make? Will my choice get me in trouble? Will my choice put me in danger? Will my choice hurt myself or...
  • Nursing Law and Liability Chapter Nine

    Nursing Law and Liability Chapter Nine

    Quasi-Intentional Tort-mix of unintentional and intentional-a voluntary act that causes injury or distress . without intent . to injure or cause distress-usually involve situations of communication with violate a person's reputation, personal privacy or civil rights
  • Digital Libraries Seminar - Columbia University Libraries

    Digital Libraries Seminar - Columbia University Libraries

    GIS at Columbia University Friday, May 6th 2005 Speakers: Doug Miller Jeremiah Trinidad What is GIS? A systems of hardware, software, data, people, organizations, and institutional arrangements for collecting, storing, analyzing, disseminating information about areas of the earth What do...
  • Climate Change - RHS Ms. Boire's Class

    Climate Change - RHS Ms. Boire's Class

    1a. WEATHER. is the atmospheric conditions, including temperature, precipitation, wind, & humidity, in a particular location over a short period of time, such as a day or week.