Differences

This shows you the differences between two versions of the page.

Link to this comparison view

object_pose_representation [2013/02/12 18:41]
127.0.0.1 external edit
object_pose_representation [2014/06/05 13:38] (current)
Line 1: Line 1:
-====== Object pose representation ====== +#REDIRECT doc:object_pose_representation
-~~NOTOC~~ +
-Information about the poses and dimensions of objects is crucial for finding and manipulating them. In KnowRob, object dimensions are described as simple bounding boxes or cylinders (specifying the height, and either width and depth or the radius). While this is clearly not sufficient for grasping, we chose this description as a compromise in order not to put too many details like point clouds or meshes into the knowledge base. Such information is rather linked and stored in specialized file formats.  +
- +
-Object poses are described via homography matrices. Per default, the system assumes all poses to be in the same global coordinate system. Pose matrices can, however, be qualified with a coordinate frame identifier. The robot can then transform these local poses into the global coordinate system, for example using the [[http://​ros.org/​wiki/​tf|tf library]]. +
- +
-Since robots act in dynamic environments,​ they need to be able to represent both the current world state and past beliefs. A naive approach for describing the pose of an object would be to add a property location that links the object instance to a point in space or, more general, a homography pose matrix. However, this approach is limited to describing the current state of the world – one can express neither changes in the object locations over time nor differences between the perceived and an intended world state. This is a strong limitation: Robots would not be able to describe past and (predicted) future states, nor could they reason about the effects of actions. +
- +
-Memory, prediction, and planning, however, are central components of intelligent systems. The reason why the naive approach does not support such qualified statements is the limitation of OWL to binary relations that link exactly two entities. These relations can only express if something is related or not, but cannot qualify these statements by saying that a relation held an hour ago, or is supposed to hold with a certain probability. For this purpose, we need an additional instance in between that links e.g. the object, the location, the time, and the probability. +
- +
-===== Pose representation in KnowRob ===== +
-In KnowRob, these elements are linked by the event that created the respective belief: the perception of an object, an inference process, or the prediction of future states based on projection or simulation. The relation is thus reified, that is, transformed into a first-class object. These reified perceptions or inference results are described as instances of subclasses of MentalEvent,​ for instance VisualPerception or Reasoning.  +
-{{ :​mental-events.png?​nolink&​800 |}} +
- +
-Object recognition algorithms, for instance, are described as sub-classes in the VisualPerception tree. Multiple events can be assigned +
-to one object, describing different detections over time or differences between the current world state and the state to be achieved. The resulting internal representation is visualized below. Based on information from the vision system, KnowRob generates VisualPerception instances that link the object instance icetea2 to the different locations where it is detected over time. +
- +
-{{ :​internal-object-representation.png?​nolink&​747 |}} +
- +
-Using this representation,​ we can describe multiple “possible worlds”, for example the perceived world, a description of how the world is supposed to look like, and the world state a robot predicts as the result of some actions it performs. Since all states are represented in the same system, it becomes possible to compare them, to check for inconsistencies or to derive the required actions, which would be difficult if separate knowledge bases would be used for perceived and inferred world states. +
- +
- +
-===== Reasoning about relations between objects at different points in time ===== +
- +
-The aforementioned representation of object poses using MentalEvents forms the basis to evaluate how qualitative spatial relations between objects change over time. For example, if a robot is to recall where it has seen an object before or which objects have been detected on the table five minutes ago, it has to qualify the spatial relations with the time at which they held. We use the //​holds(rel(A,​ B), T)// predicate to express that a relation //rel// between //A// and //B// is true at time //T//. Such a temporally qualified relation requires the description of the relation //rel// between the objects //A// and //B// and the time //T//, which cannot be expressed in pure description logics. We thus have to resort to reification,​ for which we use the mental events described earlier. ​ Based on these detections of an object, the system can compute which relations hold at which points in time. +
- +
-Please refer to Section 3.2.5 in [[http://​nbn-resolving.de/​urn/​resolver.pl?​urn:​nbn:​de:​bvb:​91-diss-20111125-1079930-1-7|Tenorth,​2011]] for a detailed discussion how this representation can be used for reasoning about how the (qualitative) relations between objects change over time. +
- +
-{{ :​reason-about-object-poses.png?​nolink&​ |}} +
- +
-(Text and graphics adapted from [[http://​nbn-resolving.de/​urn/​resolver.pl?​urn:​nbn:​de:​bvb:​91-diss-20111125-1079930-1-7|Tenorth,​2011]])+