====== Define computables ====== ~~NOTOC~~ \\ ^ This page describes the 'catkinized' version of KnowRob that uses the [[http://wiki.ros.org/catkin/|catkin buildsystem]] and the pure Java-based [[http://wiki.ros.org/rosjava|rosjava]]. The documentation for the older version, which was based on the rosbuild buildsystem and rosjava_jni, can be found [[/doc/defining_computables?rev=1401968328|here]].^ \\ Computables serve for //computing// relations that would otherwise be manually //asserted// or //inferred// using logical inference. The computation can e.g. query external sources of information, or combine pieces of information in the knowledge base in order to create new statements. This concept is also known as "procedural attachments", i.e. as methods for procedurally computing a relation that are attached to the semantic relation they calculate. Currently, there are two kinds of computables in KnowRob: * computable classes, which create instances of their target class, and * computable properties, which compute relations between instances. ===== General concept ===== For computable properties to work, the following things need to be defined: * The property to be computed, including its domain and range (datatype properties, object properties and one-of enumerations are supported); * A Prolog predicate that computes the relation and that is loaded when the query is executed, and * An instance of ComputableProperty that has the property to be computed as its //target//. For including results by computable relations into the result set, use the //rdf_triple(P, S, O)// predicate instead of //rdf_has(S, P, O)//. It is defined as


 rdf_triple(Property, Frame, Value) :-
   findall(SubProp, rdfs:rdfs_subproperty_of(SubProp, Property), SubProperties),
   member(SubProperty, SubProperties),
   (rdf_has(Frame, SubProperty, Value) [...]
   ; catch( rdfs_computable_triple(SubProperty, Frame, Value), error(instantiation_error, _), fail)
   ; user:rdf_triple_hook(SubProperty, Frame, Value)
   ).

The //rdf_triple// predicate combines the results of different inference methods: It first searches for sub-properties of the current property, and for each of them, first calls //rdf_has// for reading information asserted in the knowledge base directly, then calls all computable triples defined for any subproperty, and finally creates a hook to which other modules can attach. The code for managing the computables is contained in the module //rdfs_computable.pl// in //knowrob_common//. ===== Prolog computables ===== Prolog computables computes an OWL relation by evaluating a binary Prolog predicate. ==== Prolog properties ==== For Prolog properties, we will have a look at the knowrob:after relation between two temporal events. As a rather general property, it is defined in knowrob.owl and can be computed using a Prolog computable. First, the property is defined:

Then, the property is linked to the Prolog predicate //comp_after// for computing it:


  
      
      comp_after
      [...]

Note that the target is described as a binary Prolog predicate (comp_after) that is supposed to handle the different cases of subject and/or object being bound. //comp_after// needs to be specified somewhere where it is available once knowrob.owl is loaded, which, in our case, is the module //comp_temporal//.


  % after(TimePoint, TimePoint)
  comp_after(Pre, After) :-
    rdf_has(Pre,   rdf:type, knowrob:'TemporalThing'),
    rdf_has(After, rdf:type, knowrob:'TemporalThing'),
    term_to_atom(P, Pre),
    term_to_atom(A, After),
    P

This predicate first checks if the subject and property have the correct types, then transforms the time points into numerical values using //term_to_atom//, and finally compares them to check if //Pre// is smaller than //After//.
  * Prolog computables can do more than comparing values: Using the Java interface JPL, we included the ehow.com plan import as a Prolog computable datatype property which links Strings like "set a table" to plan specifications in OWL. The same technique was used to interface Prolog to ROS and read object poses. Rule knowledge (for unary or binary predicates) can be encoded in Prolog computables if the body of the rule is checked inside the computable.
  * When trying to use rdf_assert inside a Prolog computable, you are likely to get an error "operation would deadlock". This happens when trying to modify the rdf database while rdf choicepoints are still open, e.g. not all solutions to all rdf_has have been found. Workarounds are sometimes possible by packing rdf_has inside a findall and by iterating over the results with member, or, if just one solution shall be found, by using the cut operator '!'.

==== Prolog classes ====

The definition of computable prolog classes is similar to Prolog properties. You simply need to describe the class (here: DrinkingMug) and a binary predicate (here: comp_objectsOnTable(Inst, Class) ) that computes either instances of a class of the class of an instance.

  
    comp_objectsOnTable
    cache
    unvisible
    
    



===== SQL computables =====

SQL computables used SQL queries for reading external data. They are currently deactivated, but the code is still available in the rdfs_computable module. You need to make sure that [[http://swi-prolog.org/pldoc/doc_for?object=section%28%27packages/odbc.html%27%29|ODBC is set up correctly]]. **The following paragraphs have been kept for archival reasons, but SQL computables are currently not functional.**

==== SQL properties ====

As mentioned before, the first step is to define the target to be computed. In this example, which can be found in ias_gram_human.owl, we choose to compute a property ias_human:xCoord, which is a specialisation of knowrob:xCoord (which is defined with the domain SpatialThing) for Point2D.

  
    
    
    
  


We use this property as the target for the computable that is arbitrarily named 'computeX'. If we wanted to compute knowrob:xCoord, we would have to use rdf:resource="&kitchen;#xCoord" instead.


  
    
    
          SELECT robX FROM human_places_nom WHERE CONCAT(robX,robY) = '~frame~'
    
    
          SELECT CONCAT(robX,robY) FROM human_places_nom WHERE robX = '~value~'
    
    
          SELECT CONCAT(robX,robY), robX FROM human_places_nom
    
    &db_user;
    &db_pwd;
    &db_db;
    nocache
    unvisible
  


Apart from the target and some auth information to access the database, the most important parts are the three SQL queries. Depending on which variables in the query are bound (subject, object, or none of them), the system automatically chooses the right one. If the subject is bound and the object unbound, it uses valueSelect, if the object is bound and the subject unbound, it uses the frameSelect, and if both are unbound, it uses the frameValueSelect.

The results are further processed: In the case of datatype properties, they are wrapped in the literal(...) predicate, specifying their XSD type. For object properties, the result is extended with the namespace of the property's range and, if the resp. instance does not exist yet, it is asserted according to the property's range.

The above property can then be called with

 rdf_triple(ias_human:xCoord, Obj, X).


==== SQL classes ====

The definition of computable SQL classes is rather similar to properties and will only be shortly explained. Obviously, the target class has to exist for the method to work. computeReaching reads human motion frames labeled as 'Reaching' from the database:

  
    
    
          SELECT &action_id; FROM &tab_arm_beg; WHERE GOAL="Reaching"
    
    
          SELECT &action_id; FROM &tab_arm_beg; WHERE &action_id;=~instance~
    
    &db_user;
    &db_pwd;
    &db_human_db;
    nocache
    unvisible
   

Here, we do not have the frame/value scheme, but rather one command for creating instances (command) and one for checking if an instance belongs to the respective class (testCommand).


===== Debugging =====

When something does not work, check the following. Most likely, there is a minor inconsistency in the OWL names that makes the whole process break.
  * is the right property being computed? knowrob:objectActedOn is something else than ias:objectActedOn
  * is there a typo anywhere in the namespaces or base URLs?
  * check if there is a hash sign # between the URL and the property name (if using XML entities, check if the hash is either part of the entity or written where the entity is being used in the code)
  * debug with the following calls and step through to check that the right computable is being found, that the right query is sent, or that your predicate performs the right computations.

 guitracer, spy(yourpredicate), rdf_triple(knowrob:pred, Subj, Obj). for Prolog computables
 guitracer, spy(rdfs_computable_sql_triple), rdf_triple(knowrob:pred, Subj, Obj). for SQL computables



Some general remarks:
  * Computables should be defined in their own module; the computables for temporal relations (before, after, during etc), for example, are defined in the module //comp_temporal//. This helps to resolve conflicts if there are different computables for a relation (e.g. one observes and another one predicts a relation).
  * The &bla; identifiers are XML entities that are replaced with the string specified at the beginning of the file when the file is being loaded. They are useful for making the code a bit shorter and more readable, and also for ensuring consistency.