KR 2026 homework part 1

Here is a first draft description of the task. Additional helpful details and examples will be added during February.

Task

You will have to describe the contents of an ordinary room for an intelligent robot who is going to navigate the room and is able to understand what is there, answer questions about the room, etc.

The room has to be described in a formal way. Enhanced with some rules, you should be able to formally find and derive information about the room, like what is higher, what is lower, what is above/below, find objects with some properties, etc. For example: what is above the table? is there a blue chair in the room? is there something weighing more than 100 kg in the room? what is near the blue book?

How to proceed:

• First, take a photo of an ordinary room with a reasonable number of various objects. The photo will be made public. Do not use a room somebody else is using for the same task! You will have to formalize the room information, using this photo.

• Second, formalize the contents using a conventional logic format understandable by https://logictools.org/ .

• Third, convert the contents to json-ld: the point here is to get some experience with json-ld, not that you really need it for the following steps here (although you can use it with the https://github.com/tammet/json-ld-logic extension).

• Fourth, invent and add sensible common-sense rules about the physical objects.

• Fifth, demostrate how https://logictools.org/ is able to answer (or not) various questions about the room.

Observe that logictools is able to understand a specific json format, which includes a subset of json-ld. See https://logictools.org/json.html , the "examples" selection box and the spec https://github.com/tammet/json-ld-logic for that. Under "Advanced" button you can convert between two representations. NB! This conversion does not convert conventional logic to json-ld. Also, using json-ld directly as a first format for representation might be cumbersone, and logictool has different quirks and limitations handling json-ld directly. In other words, while it makes sense to experiment with logictools with json-ld, use this combo for experimentation, and maybe not as a primary representation format, unless you are brave :)

Presentation

The results of the lab should be shown to Riina during lab time, so she can ask questions and discuss the results and the process.

LLM policy

It is OK to use an LLM, but do not yet show your room image to an LLM: we will experiment with LLM image handling in later practice tasks.

Also, please add a short information about your llm use to the overview of the results: which LLMs you used, for what and what was the experience.

Ideas and inspiration

For inspiration you may want to have a look at the following relatively complex suggestions of encoding information about rooms and things. Please do not try to use these exactly, just read them for ideas:

• https://docs.brickschema.org/modeling/collections.html
• https://w3c-lbd-cg.github.io/bot/
• https://www.w3.org/WoT/
• https://www.w3.org/TR/2025/WD-wot-thing-description-2.0-20251104/#td-basic-types-mapping