Due to the rapid development of the Internet of Things (IoT) and consequently, the availability of more and more IoT data sources, mechanisms for searching and integrating IoT data sources become essential to leverage all relevant data for improving processes and services. This paper presents the IoT search framework IoTCrawler. The IoTCrawler framework is not only another IoT framework, it is a system of systems which connects existing solutions to offer interoperability and to overcome data fragmentation. In addition to its domain-independent design, IoTCrawler features a layered approach, offering solutions for crawling, indexing and searching IoT data sources, while ensuring privacy and security, adaptivity and reliability. The concept is proven by addressing a list of requirements defined for searching the IoT and an extensive evaluation. In addition, real world use cases showcase the applicability of the framework and provide examples of how it can be instantiated for new scenarios.
The rapid growth in collecting and sharing sensory observation form the urban environments provides opportunities to plan and manage the services in the cities better and allows citizens to also observe and understand the changes in their surrounding in a better way. The new urban sensory data also creates opportunities for further application and service development by creative industries and start-ups. However, as the size and diversity of this data increase, finding and accessing the right set of data in a timely manner is becoming more challenging. This paper describes a search engine designed for indexing, searching and accessing urban sensory data. We present the key feature and architecture of the system and demonstrate some of the functionalities that are provided by searching for raw sensory observations and also pattern search functions that are enabled by a pattern analysis algorithm, supported by monitoring of data streams for changes in quality of information and remediation.