-
Notifications
You must be signed in to change notification settings - Fork 1
Use Cases Brainstorm
Bryce George edited this page Jan 20, 2021
·
1 revision
- Obtain writing implement
- Hold Writing Implement
- Perform actions
- Determine if writing implement present
- Determine if writing implement position correct
- Close hand
- Trigger close hand action in NAO SDK
- Generate question
- Speak question
- Await person to put writing implement in hand
- Hold Writing Implement
- Scan Environment
- Identify Writing Implement
- Change Position to get to writing implement
- Determine Writing Implement orientation
- Pick up writing implement
- Determine what is supposed to be drawn
- Identify steps to create drawing
- Execute drawing steps
- Post speech text to NAO SDK broker
- Obtain camera feed
- Pass camera feed to requesting module
- Request to Scan Environment
- Identify Drawing Surface
- Request to Scan Environment
- Identify Writing Implement
Need generic object identification process here
- Identify the writing implement's colors
- Pick a color for a writing implement
- Find drawing surface
- Detect and recognize the drawing boundaries
- Identify writing implement color as black, blue, red, green, brown, purple, yellow
-
Process environment scan
-
Repeatedly Identify writing implements until environment scan full processed
-
Orient itself with writing surface
- Listen for command to be given
- Raise Event when command heard
- Continue listening for next command
- Create event body
- Raise event on broker
- Determine how drawing surface is oriented compared to self
- Determine orientation of surface initially relative to its location
- Move until robot is in a position to draw on the surface
- Uses different colors on command
- Picks colors on own if not told otherwise
- Identifies a variety of colors
- No color is specified by user
- NAO picks colors for specific parts of image
- The user does specify a color
- NAO identifies that utensil
- NAO uses that utensil to draw
- User specifies a color
- NAO Can identify: black, blue, red, green, brown, purple, yellow
- Composing drawings made up of simple shapes
- Separate a drawing into different parts using separate colors
- Receive instructions to put one part of drawing in a different location
- Recreating line drawings
- Compose a drawing from predefined shapes
- Shapes could include square, rectangle, circle, or right triangle
Extension Use Case 8.2: Multi-Colored Drawings
Flow of Events:
Separates drawings into parts
Denotes a color for each part
Draws each part in respective color
Extension Use Case 8.3: Receiving Positioning Instructions
Flow of Events:
Robot receives instructions including a shape going to a certain location
Robot draws said shape in said location relative to drawing surface
Extension Use Case 8.4: Recreating Line Drawings
Flow of Events:
Robot looks at image
Robot learns what to draw using edge detection algorithm
Robot recreates line drawing
Extension Use Case 9: Recognizing Interaction Windows
Flow of Events:
Robot can ask qualitative questions about drawing
Robot can make contextual decisions on where to take interaction
Robot can come up with meaningful responses to questions
Extension Use Case 9.1: Asking Questions
Flow of Events:
Robot asks questions about its drawing
Robot responds to feedback from user
Extension Use Case 9.2: Pushing Conversation
Flow of Events:
Robot knows when to ask user questions
Robot knows when to interact with user based on context
Extension Use Case 9.3: Responding to questions
Flow of Events:
User asks robot a question
Robot knows what user is asking
Robot comes up with meaningful response to the question