Finnode USA 2012 - Data reduction and filtering
Short description of the topic
“Reducing, filtering and processing data streams to deliver the information or action that is relevant to you.”
The web has been expanding what we have access to. It is time for tools (our proxies or agents on the web) to start reducing the amount of information coming at us. News or article feeds, TV shows, YouTube, “must watch” emails — these can all be prioritized for us like our proxy was a virtual assistant who knows our current context and our preferences. Even serendipitous feeds will have a higher probability of being interesting. More of “do what I mean,” instead of “make me spell it out in detail” interfaces, will prevail.
The problem of too much data (text, audio, video, pictures, etc) is also affecting corporations. Gaming companies need better tools to analyze massive game logs to improve the user experience and reduce churn. Social media companies have gathered huge amounts of information which is impossible to analyze without reducting the amount of data and filering out the relevant bits.
According to an IDC paper sponsored by EMC Corporation, 161 exabytes of data were created in 2006, "3 million times the amount of information contained in all the books ever written," with the number expected to hit 988 exabytes in 2010. (one exabyte is billion gigabytes)
Siri is a start, but a great application could go much further and reduce, prioritize, and recommend my to-do list according to the time I had, instead of always making me feel I was behind and driven by external interrupts and priorities. Advertisers could approach our “proxies” directly and the proxies could decide if something is of interest to us—automatically separating “wanted advertising” from spam.
Meanwhile, the level of data reduction will be based on our specific context, our current priorities, our social networks and our interest networks. Underlying this is the evolution of A.I. and advanced machine learning and even big data analytics. (One example of big data analysis techniques is MapReduce http://en.wikipedia.org/wiki/MapReduce)
Goal and strategic compliance
The goal is to map the ‘Data reduction and filtering’ ecosystem, mechanisms and the market opportunities. This involves understanding the available tools and mechanisms for data analysis (for example MapReduce, and other), impacts and needs for higher education, possibilities for finnish companies, areas for additional study for Finnish research organizations, etc. As the amount of data is growing even more in the future and solving the data analysis problem opens a lot of opportunities this is very important for the National Innovation Strategy, Tekes, Finpro, VTT, Tivit and OSKEs related software and digital media – and for many companies in Finland – but also to many other industries (like mentioned above).
Market Opportunity Map will point to the direction what measures Finland should take in order to be competitive in the new business models.
Content
Finpro and Tekes Industry directors declaring ownership to the project: Finpro: Mika Eriksson, Hanna Marttinen-Deakins, Tekes: Hannu Nurmi, Juha Pulkkinen.
Project manager (Finpro), project manager (Tekes) & team: PM: Hartti Suomela (Finpro). Team: Pekka Parnanen (Finpro), Mirja Kaarlela (Tekes)
Main tasks:
•Who is doing and what, why, when and how? Who are the leaders? What are the technologies?
•What are the various business models and mechanisms, what kind of collobaration opportunities exist, what will dominate and when/why?
•How will data reduction and analysis influence the markets?
•What industries, applications and services could benefit from data reduction usage and how?
•Identify the key players, influencers, business models, mechanics, applications.
Schedule: The project is expected to start in June of 2012 and conclude in December 2012. (?)
Deliverables:
•Identify and explain the various data reduction/filtering technologies and usage possibilities.
•Build cases on data reduction examples in applications, services and in various industries.
•Identify collaboration opportunities for Finnish companies and how it could be applied with the Finnish industries.
•Workshop in Finland (or in the U.S.) including some U.S. market thought leaders sharing ideas with Finnish counterparts. The Workshop can be part of other dissemination events.
•Dissemination through out the project with blogs, media, webinars, presentations, and workshops. Dissemination also through print and electronic media.
Cooperation:
Finnish gaming, mobile and Internet/Digital Media players. Very important for the National Innovation Strategy, Tekes (Media Activation/OHME, Mobile Consumer/Enterprise Applications, Digital Productization Process), Finpro, VTT, Tivit and OSKEs related software and digital media, Finnish Mobile Association, NeoGames, Mobile Monday – and for all the companies in Finland having to work with large amounts of data.
Hartti Suomela
+1 408 334 1983
