Elastic-R Plateforme SaaS universelle et collaborative pour ...

Elastic-R Plateforme SaaS universelle et collaborative pour ...

Elastic-R, a collaborative and federative platform for scientific and statistical computing in the cloud Karim Chine [email protected] Cloud Era Ltd Cambridge UK PRISM Forum Cloud Computing SIG Meeting 18 May 2010 ,lingua franca of data analysis From: John Fox, Aspects of the Social Organization and Trajectory of the R Project, R Journal-Feb 2009 R + Elastic-R : plug & play computing environment

Computational Components R packages : CRAN, Bioconductor, Wrapped C,C++,Fortran code Scilab modules, Matlab Toolkits, etc. Open source or commercial Computational User Interfaces Computational Resources Workbench within the browser Hardware & OS agnostic computing engine : R, Scilab,.. Collaborative views Built-in views / Plugins / Spreadsheets Clusters, grids, private or public clouds

Open source or commercial free: academic grids or pay-per-use: EC2, Azure Computational Data Storage Local, NFS, FTP, Amazon S3, Amazon EBS free or commercial Elas tic Computational Scripts R / Python / Groovy On client side: interactivity.. On server side: data transfer .. Generated Computational Web Services Stateful or stateless, automatic mapping of R data objects and functions

Computational Application Programming Interfaces Java / SOAP / REST, Stateless and stateful Elastic-R on IaaS-style clouds Elastic-R portal: single facade to public/private clouds Public Clouds Private Cloud Elastic-R portal : collaborative Virtual Research Environment Decentralized collaboration : Elastic-R portal as an EC2 AMI Amazon Virtual Private Cloud

Subnet 2 Subnet 1 Subnet 3 The IaaS-style cloud as a reproducible research platform Elastic-R Amazon Machine Images Elastic-R AMI 1 Elastic-R AMI 2 R 2.10 + BioC 2.5 R 2.9 + BioC 2.3

Elastic-R AMI 2 R 2.9 + BioC 2.3 Elastic-R AMI 3 Elastic-R EBS 4 Data Set VVV R 2.8 + BioC 2.0 Amazon Elastic Block Stores Elastic-R EBS 4 Data Set VVV

Elastic-R EBS 1 Data Set XXX Elastic-R AMI 2 R 2.9 + BioC 2.3 Elastic-R EBS 2 Data Set YYY Elastic-R EBS 3 Data Set ZZZ Elastic-R EBS 4 Data Set VVV

One Amazon account and many users : Elastic-R signed tokens AWS Credentials + Private Key XXYYZZ XXYYZZ XXYYZZ XXYYZZ Generate token Launch machine instance Deliver token

Register machine instance Use token Use R console Activate token Call R Engine tful Res r SS ove WS

r ve So W ul stf Re L L SS S TP HT SSH

Elastic-R Security L r SS e v Po SOA The Elastic-R AJAX Workbench I Simplified clouds management console Private virtual machines monitor

Virtual machines launcher Session info R console + scilab console + chat + ssh console R Graphics + whiteboard + annotation + slides viewer The Elastic-R AJAX Workbench II Browsable contextual R help

Working directory browser Files upload/download to/from cloud machine instance Collaborative console Collaborative script editor The Elastic-R AJAX Workbench III Graphic device selector Graphics real coordinates Graphic tools Persistent collaborative annotators + virtual laser pointer + whiteboard + ..

Spreadsheet selector Server-side, R-enabled collaborative spreadsheet The Elastic-R Java Workbench Software + services =applications convergence +Microsoft collaboration Excel Elastic-R Java Workbench Elastic-R AJAX Workbench Elastic-R AJAX Workbench Elastic-R Spreadsheet model

The Elastic-R server-side spreadsheet models / GUI widgets The cloud applications factory Elastic-R AJAX Workbench Visual Graphic User Interface Builder Upload plugin Standalone Application Accessible From a URL Plugins Repository myPlugin myDashboard Elastic-R Java Workbench Elastic-R : user-friendly distributed computing platform

Demo Useful links Elastic-R Portal : www.elasticr.net Platform Web Site: www.elasticr.net/platform Articles : Karim Chine, "Open Science in the Cloud: Towards a Universal Platform for Scientific and Statistical Computing", Chapter 19 in Handbook of Cloud Computing, Springer, 2010 (in press) Karim Chine, "Scientific Computing Environments in the age of virtualization, toward a universal platform for the Cloud" pp. 44-48, 2009 IEEE International Workshop on Opensource Software for Scientific Computation (OSSC), 2009 Karim Chine, "Biocep, Towards a Federative, Collaborative, User-Centric, Grid-Enabled and CloudReady Computational Open Platform, escience,pp.321-322, 2008 Fourth IEEE International Conference on eScience, 2008 Linkedin Group:

http://www.linkedin.com/groups?home=&gid=2345405 Acknowledgments ACS: Madi Nassiri Amazon: Simone Brunozzi, Deepak Singh AT&T Research Labs: Simon Urbanek ATUGE: Imen Essafi, Bchir Tourki, Ilyes Gouja, HatemHachicha, Amine Elleuch Auckland Centre for eResearch: Nick Jones Banca d'Italia: Giuseppe Bruno BioIT World: Kevin Davies BNP Paribas: Ousseynou Nakoulima Cambridge Healthtech Institute: Cindy Crowninshield City University of New York: Mario Morales, Makram Talih Columbia University: Omar Besbes Dassault Systmes: Omri Ben Ayoun, Patrick Johnson Dataspora: Michael E. Driscoll EDF: Alejandro Ribes EBI: Alvis Brazma, Wolfgang Huber, Kimmo Kallio, Misha Kapushesky, Michael Kleen, Alberto Labarga, Philippe Rocca-Serra, Ugis Sarkans, Kirsten Williams, Eamonn Maguire EPFL: Darlene Goldstein ESPRIT: Farouk Kammoun, Tahar. Benlakhdar e-Taalim: Nadhir Douma ETH Zrich: Yohan Chalabi, Diethelm Wrtz, Martin Mchler European Commission: Konstantinos Glinos, Enric Mitjana, Monika Kacik, Ioannis Sagias FHCRC: Martin Morgan, Nianhua Li, Seth Falcon Google: Olivier Bosquet FVG LLC: Lisa Wood Harvard University: Tim Clark, Sudeshna Das, Douglas Burke,Paolo Ciccarese IBM: Jean-Louis Bernaudin, Pascal Sempe, Loic Simon, Lea A Deleris, Alex Fleischer, Alain Chabrier Imperial College London: Asif Akram, Vasa Curcin, John Darlington, Brian Fuchs Indiana University:Michael Grobe INRIA: David Monteau, Christian Saguez, Claude Gomez, Sylvestre Ledru JISC: John Wood, David Flanders Johnson & Johnson - Janssen Pharmaceutica: Patrick Marichal KXEN: Eric Marcade Lancaster University: Robert Crouchley, Daniel Grose Leibniz Universitt Hannover: Kornelius Rohmeier LIAMA: Baogang Hue, Kang Cai Limagrain: Zivan Karaman Mekentosj: Alexander Griekspoor, Matt Wood Microsoft: Eric Le Marois, Tony Hey Mubadala: Ghazi Ben Amor Nature Publishing Group: Ian Mulvany, Steve Scott NCeSS: Peter Halfpenny, Rob Procter, Marzieh Asgari-Targhi, Alex Voss, YuWei Lin, Mercedes Argello Casteleiro, Wei Jie, Meik Poschen, Katy Middlebrough, Pascal Ekin, June Finch,

Farzana Latif, Elisa Pieri, Frank O'Donnell New York Java User Group: Frank D Greco OeRC: Dimitrina Spencer, Matteo Turilli, David Wallom, Steven Young OMII-UK: Neil Chue Hong, Steve Brewer OpenAnalytics: Tobias Verbeke Oracle: Dominique van Deth, Andrew Bond OSS Watch: Ross Gardler Platform Computing: Christopher Smith Royal Society: James Wilsdon San Diego Supercomputer Center: Nancy R. Wilkins-Diehr Sanger Institute: Lars Jorgensen, Phil Butcher Shell: Wayne.W.Jones, Nigel Smith Socit Gnrale: Anis Maktouf Stanford University: John Chambers, Balasubramanian Narasimhan, Gunter Walther [email protected]: Karim Azoum Technische Universitt Dortmund: Uwe Ligges, Bernd Bischl Technoforge: Pierre-Antoine Durgeat Tekiano: Samy Ben Naceur Tlcom-ParisTech: Isabelle Demeure, Georges Hebrail, Nesrine Gabsi The Generations Network: Jim Porzak Total: Yannick Perigois Tunisian Ministry of Communication Technologies: Naceur Ammar, Lamia Chaffai-Sghaier, Mohamed Sad Ouerghi, Syrine Tlili Tunisian Ecole Polytechnique: Riadh Robbana UC Berkeley: Noureddine El Karoui, Terry Speed UC Davis: Rudy Beran, Debashis Paul, Duncan Temple Lang UCL: Daniel Jeffares UCLA: Ivo Dinov, Jeroen Ooms UC San Diego: Anthony Gamst UCSF: Tena Sakai Universit Catholique de Louvain: Christian Ritter University of Cambridge: Ian Roberts, Robert MacInnis Peter Murray-Rust, Jim Downing University of Manchester: Carole Goble, Len Gill, Simon Peters, Richard D Pearson, Iain Buchan, John Ainsworth University of Plymouth: Paul Hewson University of Split: Ivica Puljak UTK: Ajay Ohri World Bank Group-IFC: Oualid Ammar Yahoo: Laurent Mirguet, Rob Weltman Independant:Charles Dallas, Romain Franois Elastic-R for Clusters/Grids Elastic-R SOA Platform

Node 1: Windows XP Pool A Pool B Pool C Node 2: Mac OS Front-end host Remote Objects Registry R-HTTP R-SOAP

Node 3: 64 bits Server / Linux Parallel Computing Applications Borrow Rs Supervisor Use Rs Release Rs Node 4 : EC2 virtual machine 1 .NET Appli Perl Scripts logOn

logOn Use R Use R Generate Graphics/Data logOff logOff Release R Node 4 : EC2 virtual machine 1 Web Application Borrow R

Cloudbursting Node 5 : EC2 virtual machine 2 via Amazon Web Services Stateful Generated Web Services : Elastic-R for Workflow Workbenches Login Pwd LogOn SessionID associated with a reserved Elastic-R Engine Options ES

T1 ESon1 T2 ESon2 T3 ESon3 f ( ES ) getData Retrieve Data T1,T2,T3 : Generated Stateful Web Services for R functions T1,T2 & T3 LogOn, getData : R-SOAP methods

ES : ExpressionSet ESon1, ESon2, ESon3 : ExpressionSet Object Names f = T3 o T2 o T1 logOff remove ESonx kill Elastic-R Engine Clean Elastic-R Engine Put Elastic-R Engine back in the Pool

Recently Viewed Presentations

  • Welcome to Class 524 Curriculum Conference

    Welcome to Class 524 Curriculum Conference

    WELCOME TO MATH & SCIENCE WITH MRS. MANRIQUE, MS. RUSSO MR. WALKER OUR SCHEDULE Problem Solving / RTI / Enrich : Monday & Friday Math Core Instruction : Monday - Friday Eureka Context for Learning Science : Tues - Thursday...
  • Analysis of Algorithms - Western University

    Analysis of Algorithms - Western University

    Analysis of Algorithms Asymptotic notation Instructor: Olga Veksler * * * * * * * * * * * * * * * * Analysis of Algorithms * Prefix Averages (Linear) The following algorithm computes prefix averages in linear time...
  • Human Resource Management Human Resource Management  Different approaches

    Human Resource Management Human Resource Management Different approaches

    The role of training, management development, and compensation practices in IB Human Resource Management Activities aimed at effective use of human resources Staffing, management development, performance evaluation, compensation Process complexity increases across borders Environmental differences of: labor markets, culture, legal...
  • MBOIA September Training/Meeting Phil Saucier Ann Freeman September

    MBOIA September Training/Meeting Phil Saucier Ann Freeman September

    Recovery Facilities, Inc. v. Town of Hampden, ... The bipartisan law, PL 2015, Ch. 307, prohibits law enforcement agencies from using a weaponized drone, and from using a drone in a criminal investigation without a warrant, with certain exceptions. The...
  • Pauls Third Journey Paul wrote Romans from Corinth

    Pauls Third Journey Paul wrote Romans from Corinth

    in mighty signs and wonders, by the power of the Spirit of God, so that from Jerusalem and round about to Illyricum . I have fully preached the gospel of Christ. Rom 15:20 . And so I have made it...
  • Presentation for Vietnam… - World Bank

    Presentation for Vietnam… - World Bank

    Logical location of indicators around the clock face, learning from 9 a.m. to 6 p.m. from the most accessible learning opportunities to the most demanding and then assessing outcomes of learning in the evening, at 7-8 p.m. Show the chart...
  • Electron probe microanalysis - Electron microprobe analysis ...

    Electron probe microanalysis - Electron microprobe analysis ...

    (Reed 1993, p 158) UW- Madison Geology 777 "Harper's Index" of EPMA 1 nA of beam electrons = 10-9 coulomb/sec 1 electron's charge = 1.6x 10-19 coulomb ergo, 1 nA = 1010 electrons/sec Probability that an electron will cause an...
  • Voluntary Guidelines for Managing Food Allergies in Schools

    Voluntary Guidelines for Managing Food Allergies in Schools

    Not all allergic reactions will develop into anaphylaxis; however, early signs of anaphylaxis can resemble a mild allergic reaction. It is not easy to predict whether these initial, mild symptoms will become an anaphylactic reaction that can result in death.1...