Intelligent Generation and Control of Interactive Virtual Worlds

Abstract

This thesis advocates the use of non-­‐gaming virtual worlds as a significant future technology for the domain of ``serious games’’ and in particular e-­‐* applications (e-­‐ learning, e-­‐commerce, e-­‐government) and social simulations. In such systems, a 3D virtual environment is populated by a large number of inhabitants that can be either human-­‐ controlled avatars or intelligent virtual agents who engage in complex interactions with their virtual environment and other participants. One significant problem that impedes wide adoption of the virtual worlds technology for these problem domains is that virtual worlds in general are difficult to build, and significant effort has to be put into designing the 3D virtual environment and programming virtual agents; but it is even harder to ensure the validity of participant so that unauthorized behavior can be prevented. To address this problem, we have developed a comprehensive technological solution that automates the design of such virtual worlds and its population with virtual agents. Our approach is based on the utilization of virtual institutions, which are virtual worlds with normative regulation of participant interactions. The key focus of the thesis is on explaining how existing methods of formal specification of virtual institutions can be extended to automatically translate the institutional specification into an interactive 3D environment using the shape grammars approach and automatically populating such environments with virtual agents. Shape grammars represent a powerful visual technique for creating procedural 2D and 3D designs, but existing work was not immediately suitable for our problem. Thus, we have extended existing work and developed the Shape Grammar Interpreter framework, which addresses the limitations of existing solutions. This framework was further utilized for developing the concept of Virtual World Grammar, which is a sub-­‐set of shape grammars targeting automatic generation of normative virtual worlds. As the result of this dissertation, Virtual Worlds Grammars constitute a strong formalization and a development environment not only enabling automatic generation of normative virtual worlds, but also their platform independent deployment (using the VIXEE infrastructure that has been developed as an important part of this dissertation). Another significant contribution of this thesis is developing a mechanism of automatic population of the generated environments with large numbers of software agents, which are capable of intelligent interactions with 3D objects placed in the environment. Moreover, these agents are able to collaborate with human-­‐controlled avatars, facilitate their problem-­‐solving and ensure that all their actions strictly adhere to social norms of the given institution. For this purpose, we have developed a general-­‐purpose virtual agent model that enables an agent to be situated within any normative virtual world, generate its own goals based on its current physiological and psychological needs, as well as to dynamically generate plans for satisfying these goals using the underlying institutional specification. To illustrate the usefulness of the developed technology, we have applied it to the domain of historical simulation, where we show how virtual world grammars and automatically generated virtual agents can be used for re-­‐enacting everyday life of ancient people in one of humanity's first cities, the city of Uruk. We showed how our approach allows to create a large number of visually and behaviorally diverse agents, as well as dynamically generating food, tools and other items that they can utilize to satisfy their goals, while acting in a historically correct way.

Date of Award	27 Jul 2012
Original language	English
Supervisor	Inmaculada Rodríguez (Director), Anton Bogdanovych (Director) & Josep Puyol Gruart (Tutor)