391 research outputs found

    Enhancing VLAM workflow model with MapReduce operations

    Get PDF
    MapReduce frameworks proved to be a good solution for storing and processing large amounts of data. Thanks to data parallelism, they allow to move computations very close to the storage and therefore to reduce an influence of "I/O bottleneck". Workflow Management Systems, in turn, are widely used for modeling of scientific applications. Users that are willing to use MapReduce frameworks in their workflows have to run separate environment to develop Map/Reduce operations. In this paper we propose an approach that will allow to extend existing application models by MapReduce routines. Our solution bases on DSL constructed on top of Ruby programming language. It follows examples of Sawzall and Pig Latin languages and allows to define Map/Reduce operations in minimalist way. Moreover, because the language is based on Ruby, the model allows to use user defined routines and existing Ruby libraries. A particular model of the workflow management system can be extended with our DSL letting users to use one environment for developing the workflow and MapReduce application.</p

    Cookery: A Framework for Creating Data Processing Pipeline Using Online Services

    Get PDF
    With the increasing amount of data the importance of data analysis in various scientific domains has grown. A large amount of the scientific data has shifted to cloud based storage. The cloud offers storage and computation power. The Cookery framework is a tool developed to build scientific applications using cloud services. In this paper we present the Cookery systems and how they can be used to authenticate and use standard online third party services to easily create data analytic pipelines. Cookery framework is not limited to work with standard web services; it can also integrate and work with the emerging AWS Lambda which is part of a new computing paradigm, collectively, known as serverless computing. The combination of AWS Lambda and Cookery, which makes it possible for users in many scientific domains, who do not have any program experience, to create data processing pipelines using cloud services in a short time

    End-User Development of Activity-Supporting Services for Smart Homes

    Get PDF
    International audienceIndependent living often requires assistive computing support to be tailored to the specific needs of each older adult. We propose a tool-based approach to allowing caregivers to define services for in-home daily living activities, leveraging their knowledge and expertise on the older adult they care for. This approach consists of two stages: 1) a wizard allows caregivers to define an assistive service, which supports aspects of a daily activity, specific to an older adult; 2) the wizard-generated service is uploaded in an existing smart home platform and interpreted by a dedicated component, carrying out the caregiver-defined service

    Dynamic handling for cooperating scientific web services

    Get PDF
    corecore