Integrating web site services into application through user interface

• Autorzy: Opaliński A.
• Języki publikacji: EN

Abstrakty

EN

The issue of integrating applications which are only accessible through visual user interface is not thoroughly researched. Integration of web applications running remotely and controlled by separate organizations becomes even more complicated, as their user interface can display di ff erently in di ff erent browsers or change without prior notification as a result of application maintenance. While possible, it is generally not common for web sites to provide web services through standard mechanisms like SOAP, RPC, or REST, due to administrative, and especially security reasons. Programmatic use of the capabilities of numerous public sites which only provide web user interface to their services is very appealing, as they may significantly extend the functionality of other applications. This paper presents the research on employing existing software of various purpose to integrating web sites using their user interface. With selected method, some capabilities of Moodle are expanded by integrating remote Moodle server with local application, to create team-work support tools.

Słowa kluczowe

EN

browser automation; Web User Interface; application integration; web extraction

PL

automatyzacja przeglądarki; webowy interfejs użytkownika; integracja aplikacji; ekstrakcja danych

• Wydawca: Wydawnictwo Politechniki Łódzkiej
• Czasopismo: Journal of Applied Computer Science
• Rocznik: 2014
• Tom: Vol. 22, nr 1
• Strony: 137--153
• Opis fizyczny: Bibliogr. 48 poz.

Twórcy

autor

Opaliński A.

• Gdansk University of Technology, Faculty of Power and Control Engineering, Narutowicza 11/12, 80-233 Gdansk

Bibliografia

• [1] Artur Opalinski, Rozwiniecie MOODLE jako narzedzia do pracy grupowej, Materialy pokonferencyjne II Konferencji TEWI - Technologia Edukacja Wiedza Innowacja, Lodz, 27-28.06.2011
• [2] Free Moodle services for the e-learning community, available online, URLs: http://www.mdl2.com/, and http://www.gnomio.com/ (DOA: 1.06.2013)
• [3] Tim Hunt, Moodle, in The Architecture of Open Source Applications. Elegance, Evolution and a Few Fearless Hacks, ed. Grady Booch, available online, URL: http://www.aosabook.org/en/moodle.html (DOA: 1.06.2013)
• [4] Xiaorong Xiang, Madey, G., A semantic Web services enabled Web portal architecture, Proc. of IEEE International Conference on Web Services, pp.834835, 2004
• [5] Example online C/C ++ compilers, available online, URLs: http://www.onlinecompiler.net and http://codepad.org (DOA: 1.06.2013)
• [6] MOSS (Measure Of Software Similarity) plagiarism detection service, available online, URL: http://wwww.cs.berkeley.edu/ãiken/moss.html (DOA:1.06.2013)
• [7] Example online file conversion web sites: Zamzar, Free online file conversion, URL: http://www.zamzar.com/ and Convert.Files, URL: http://www.convertfiles.com/ (DOA: 1.06.2013)
• [8] Stal Michael, Web Services - Beyond Component-Based Computing - Seeking a better solution to the application integration problem, Comm. of the ACM, Vol. 45, Issue 10, 2002
• [9] Naur Peter, Randell Brian (eds.), Software Engineering, Report on NATO SCIENCE COMMITTEE conference, 7th to 11th October 1968, Garmisch, 1969
• [10] Chunhua Gu, Xueqin Zhang, An SOA Based Enterprise Application Integration Approach, In proc. of Third International Symposium on Electronic Commerce and Security, 2010
• [11] Xudong Song, Xueping Wang, Xiaobing Liu, Research on Enterprise Application Integration Architecture and Development Approach, In proc. of IITAW’08, International Symposium on Intelligent Information Technology Application Workshops, pp.215-218, 2008
• [12] Yan Du, Wuliang Peng, Li Zhou, Enterprise Application Integration: an Overview, In proc. of IITAW’08, International Symposium on Intelligent Information Technology Application Workshops, pp.953-957, 2008
• [13] Jian Meng, Jinlong Chen , A Mashup Model for Distributed Data Integration, Proc. of ICMECG ’09 , Int. Conference on Management of e-Commerce and e-Government, 2009
• [14] Roy, M., Towards end-user enabled web service consumption for Mashups, 2010 ACM / IEEE 32nd Int. Conference on Software Engineering, 2010
• [15] Google Maps API, URL: https://developers.google.com/maps/, Google Weather API, Google Gadgets API, URL: https://developers.google.com/gadgets/ (DOA: 1.06.2013)
• [16] Hasan, R., Winslett, M., Conlan, R., Slesinsky, B., Ramani, N., Please Permit Me: Stateless Delegated Authorization in Mashups, Proc. of ACSAC 2008, Annual Computer Security Applications Conference, 2008
• [17] Mata, F. Pimentel, A., Zepeda, S., Integration of Heterogeneous Data Models: A Mashup for Electronic Commerce, Proc. of CERMA: Electronics, Robotics and Automotive Mechanics Conference, 2010
• [18] Cappiello, C., Daniel, F., Matera, M., Pautasso, C., Information Quality in Mashups, IEEE Internet Computing, Vol.14, Issue 4, pp.14-22, 2010
• [19] Hua Wang, Yang Zhang, Web Data Extraction Based on Simple Tree Matching, Proc. of 2010 WASE Int. Conference on Information Engineering (ICIE), pp.15-18, 2010
• [20] Min Huang, Jian-Qing Xi, Bo Sun, A new web information extracting method based on multi-coordinate, Proc. of 2009 Int. Conference on Machine Learning and Cybernetics, pp.1488-1492, 2009
• [21] Tak-Lam Wong, Wai Lam, Learning to Adapt Web Information Extraction Knowledge and Discovering New Attributes via a Bayesian Approach, IEEE Transactions on Knowledge and Data Engineering, Vol.22, Issue: 4, pp. 523536, 2010
• [22] Qu Jubao, The Research of Automatic Extraction Dynamic Web Data, Proc. of IFITA ’09 Int. Forum on Information Technology and Applications, Vol.2, pp. 143-146, 2009
• [23] Yang Liu, Li Chunping, Gu Ming, Extracting Content from Web Pages Using the Sliding Window, Proc. of CSA ’09. 2nd Int. Conference on Computer Science and its Applications, 2009
• [24] Nakajima, D. Mitsui, Y., Samejima, M., Akiyoshi, M., An Information Extraction Method from Di ff erent Structural Web Sites by Word Distances between a User Instantiated Label and Similar Entity, Proc. of 2011 IEEE 11th Int. Conference on Data Mining Workshops (ICDMW), pp.1177-1182, 2011
• [25] Emilio Ferrara, Giacomo Fiumara, Robert Baumgartner, Web Data Extraction, Applications and Techniques: A Survey, Technical report, available online: http://www.emilio.ferrara.name/wp-content/uploads/2011/07/survey-csur.pdf (DOA: 1.06.2013)
• [26] Zhang Hengru, Cui Chun, Web Information Extraction Technology Research Based on Ajax, BCGIN 2011, Int. Conference on Business Computing and Global Informatization, pp.208-211, 2011
• [27] Wei Liu, Xiaofeng Meng, Weiyi Meng, ViDE: A Vision-Based Approach for Deep Web Data Extraction, IEEE Trans. on Knowledge and Data Engineering, Vol.22, No.3, 2010
• [28] Wook-Shin Han, Wooseong Kwak, Hwanjo Yu, On supporting e ff ective web extraction, In Proc. of 2010 IEEE 26th ICDE, International Conference on Data Engineering, pp.773-775 , 2010
• [29] Vinod Anupam, Juliana Freire, Bharat Kumar, Daniel Lieuwen, Automating Web navigation with the WebVCR, Computer Networks: The International Journal of Computer and Telecommunications Networking, Elsevier, Vol.33 Issue 1-6, pp.503-517, 2000
• [30] Michael Bolin, Matthew Webber, Philip Rha, Tom Wilson, Robert C. Miller, Automation and customization of rendered web pages, Proc. of UIST ’05 18th annual ACM symposium on User interface software and technology, pp.163-172 , 2005
• [31] Baumgartner, R., Ledermiiller, G., DeepWeb Navigation in Web Data Extraction, Proc. of Computational Intelligence for Modelling, Control and Automation, and Int. Conference on Intelligent Agents, Web Technologies and Internet Commerce, Vol.2, pp.698-703, 2005
• [32] MIT open source SIKULI project web page, available online, URL: http://sikuli.org/ (DOA: 1.06.2013)
• [33] AutoIt. Automation and scripting lanuage home page, available online, URL: http://www.autoitscript.com/site/autoit/ (DOA: 1.06.2013)
• [34] Yimin Bao, Ellis Horowitz, Integrating Through User Interface:A Flexible Integration Framework for Third-party Software, In proc. of COMPSAC ’96, 20th Computer Software and Applications Conference, ISBN: 0-8186-75799, pp.336-342, 1996
• [35] GNU wget package home page, available online, URL: http://www.gnu.org/software/wget/ (DOA: 1.06.2013)
• [36] Managing a Moodle Site. AJAX and Javascript settings. Moodle documentation, available online, URL: http://docs.moodle.org/22/en/AJAX_and_Javascript_settings (DOA: 1.06.2013)
• [37] Lynx software distribution site hosted by ISC, available online, URL: http://lynx.isc.org/ (DOA: 1.06.2013)
• [38] Wikipedia Comparison of web Browsers page, available online, URL: http://en.wikipedia.org/wiki/Comparison_of_web_browsers (DOA: 1.06.2013)
• [39] ELinks - Full-Featured Text WWW Browser home page, available online, URL: http://elinks.or.cz/ or http://www.elinks.cz/ (DOA: 1.06.2013)
• [40] Rhino project home page, available online, URL: http://www.mozilla.org/rhino/ (DOA: 1.06.2013)
• [41] Selenium - Web Browser Automation home page, available online, URL: http://seleniumhq.org/ (DOA: 1.06.2013)
• [42] Windmill Testing Framework home page, available online, URL: http://www.getwindmill.com/ (DOA: 1.06.2013)
• [43] Selenium browser automation framework. Architectural Overview. An overview of the WebDriver architecture. How the FirefoxDriver works, available online, URL: http://code.google.com/p/selenium/wiki/FirefoxDriverInternals (DOA: 1.06.2013)
• [44] Selenium browser automation framework. Architectural Overview. An overview of the WebDriver architecture. How the Internet Explorer Driver works, and how to work on it , available online, URL: http://code.google.com/p/selenium/wiki/InternetExplorerDriverInternals (DOA: 1.06.2013)
• [45] Selenium browser automation framework. Architectural Overview. A description of the protocol used by WebDriver to communicate with remote instances, available online, URL: http://code.google.com/p/selenium/wiki/JsonWireProtocol (DOA: 1.06.2013)
• [46] HtmlUnit project web page, available online, URL: http://htmlunit.sourceforge.net/ (DOA: 1.06.2013)
• [47] John Sayce, Browsers, processes, cookies and session state, in Author’s blog: Thoughts on development - SQL Server, .NET, Visual Studio and beyond, available online, URL: http://sqlblogcasts.com/blogs/jonsayce/archive/2007/11/06/Browsers_2C00_-processes_2C00_-cookies-and-session-state.aspx (DOA: 1.06.2013)
• [48] Java proof-of-concept application source code used for verification, available online, URL: https://sites.google.com/site/flecabinet/downloads/login.java (DOA: 1.06.2013)