Optimal actuation strategies for sensor/actuator networks

TitleOptimal actuation strategies for sensor/actuator networks
Publication TypeConference Proceedings
Year of Publication2006
AuthorsThouin, F., R. W. Thommes, and M. J. Coates
Conference NameInternational Workshop on Advances in Sensor Networks
Date Published07/2006
Conference LocationSan Jose, CA

Wireless sensor-actuator networks (SANETs), in which nodes perform actions (actuation) in response to sensor measurements and shared information, have great potential in medical and agricultural applications. In this paper, we focus on the problem of using distributed sensed data to design
actuation strategies in order to elicit a desired response from the environment, whilst attempting to minimize the communication in the network. Our methodology is based on batch Q-learning; we describe a distributed approach for learning dyadic regression trees to estimate the Q-functions from collected data. Analysis and simulation indicate that substantial communication savings that can be achieved through distributed learning without significant performance deterioration. The simulations also reveal that the performance of our technique depends strongly on the amount of training data available.

PDF215.13 KB