On Big Data for Security and Analytics Technologies

I found an interesting report, by Enterprise Strategy Group, called “The Evolution of Big Data Security Analytics Technology” providing an overview of the market landscape.  In my view, two key areas are open to research and innovation:

 

·         Real-time big data security analytics

·         Asymmetric big data security analytics

From a security perspective, whilst an increasing number of new tools, solutions and frameworks are emerging in these areas, there are a few key challenges that need to be addressed.  They relate to the quality and effectiveness of big data analytics: how to make sense of big (security) data and provide meaningful insights in order to identify new threats and security issues; how to capture this knowledge into repeatable and simplified capabilities that can be used by a wide range of stakeholders.

 

These are going to be key R&D aspects to be addressed in the future, in addition to the well-known big data issues i.e. dealing with velocity, volume and variety of data.

 

In particular HP and HP Labs are in a unique position to make progress here, also thanks to opportunity to leverage key HP assets in the space of security and big data management i.e. HP ArcSight, HP Vertica and HP Autonomy.  

 

 

 

--- Posted by Marco Casassa Mont (here and here)  ---

--- NOTE:  use this mirror blog if you prefer posting on an external blog site  ---

--- NOTE:  my original HP blog can be found here  ---

 

 

My Tweets of the Week (22-26 July 2013)

My tweets of the week (22-26 July 2013) at https://twitter.com/MCasassaMont:

 

·         The open source job market is booming - http://www.infoworld.com/t/information-technology-careers/the-open-source-job-market-booming-223463 … #in

·         Three different roads to the 3-nanometer chip - http://www.theregister.co.uk/2013/07/25/proposed_semiconductor_transistor_possibilities/ … #in

·         With big data comes big responsibility - http://www.ft.com/cms/s/0/1c3e27ee-8b2f-11e2-8fcf-00144feabdc0.html#axzz2a58CgPqZ … #in

·         “Big Data” Is Not “Big Data” Unless It Gives You Actionable Insight - http://searchengineland.com/big-data-is-not-big-data-unless-it-gives-you-actionable-insight-167225 … #in

·         Loose lips trouble CISOs - http://www.scmagazineuk.com/loose-lips-trouble-cisos/article/304467/ … #in

·         Researchers spot new breed of infected Android apps in the wild - http://www.infoworld.com/t/android/researchers-spot-new-breed-of-infected-android-apps-in-the-wild-223400 … #in

·         Graph analysis will make big data even bigger - http://www.infoworld.com/d/big-data/graph-analysis-will-make-big-data-even-bigger-223420 … #in

·         CFOs Ignore Big Data at Their Peril - http://online.wsj.com/article/SB10001424127887323419604578571684135006800.html … #in

·         Competing businesses encouraged to share incident data as the attackers do - http://www.scmagazineuk.com/competing-businesses-encouraged-to-share-incident-data-as-the-attackers-do/article/304122/ … #in

·         FTSE 350 companies demonstrate very poor security manners - http://www.scmagazineuk.com/ftse-350-companies-demonstrate-very-poor-security-manners/article/304195/ … #in

·         Stop 80 percent of malicious attacks now - http://www.infoworld.com/d/security/stop-80-percent-of-malicious-attacks-now-223213 … #in

·         SDN 101: Software-defined networking explained in 10 easy steps - http://www.infoworld.com/slideshow/111753/sdn-101-software-defined-networking-explained-in-10-easy-steps-223225 … #in

·         Big Data Security Analytics: It Takes a Village - http://www.networkworld.com/community/node/83299 … #in

·         Software employment rises 45% in 10 years, as angst in engineering grows - http://www.computerworld.com/s/article/9240854/Software_employment_rises_45_in_10_years_as_angst_in_engineering_grows … #in

·         Happy birthday, OpenStack! Now change - http://www.networkworld.com/news/2013/072213-openstack-272063.html?hpg1=bn … #in

·         True tales of (mostly) white-hat hacking - http://www.infoworld.com/d/security/true-tales-of-mostly-white-hat-hacking-222831 … #in

·         Five Roles You Need on Your Big Data Team - http://blogs.hbr.org/cs/2013/07/five_roles_you_need_on_your_bi.html … #in

·         SIM card DES flaw could affect up to 500 million users - http://www.scmagazineuk.com/  #in

·         Are we in an enterprise startup bubble? - http://www.infoworld.com/t/startups/are-we-in-enterprise-startup-bubble-223138 … #in

 

--- Posted by Marco Casassa Mont (here and here)  ---

--- NOTE:  use this mirror blog if you prefer posting on an external blog site  ---

--- NOTE:  my original HP blog can be found here  ---

 

On Big Data for Security

I am currently focusing my R&D work in the space of “Big Data for Security”.

This is a fascinating area and, currently, a green field.

 

How to effectively leverage huge amount of collected IT information (ranging from IT logs to application and service information as well as external intelligence)  to identify new security threats, issues and provide valuable information to organisations to mitigate current and foreseeable risks?

 

HP already has core assets in the security and “Big Data” space: HP ArcSight suite (SIEM solution for event logging, storage and correlation); HP Vertica (highly parallelised, columnar database solution for storage and analytics of structured big data) and HP Autonomy (storage, indexing and retrieval of massive amount of unstructured data).

 

I am currently exploring how these capabilities could be fully leveraged in the context of big data for security, in particular in a few security verticals and types of critical security data. In addition, I am interested in exploring how the massive amount of required computation and analytics can be performed by adopting innovative solutions in the cloud (private and hybrid cloud).

 

I am looking for public use cases, case studies and requirements in this space, in particular for analytics based on big security data and anecdotes on how “big data” has been helping to address security issues.

 

 

--- Posted by Marco Casassa Mont (here and here)  ---

--- NOTE:  use this mirror blog if you prefer posting on an external blog site  ---

--- NOTE:  my original HP blog can be found here  ---

 

On Policy Decision Support for Big Data

When dealing with big data (inclusive of hybrid and unstructured one), it is very hard to understand the implications and impact of defining (security, business, sharing, privacy, etc.) policies on this data.
Which data is actually affected by the policies? Are these policies comprehensive? Are there corner cases that are not covered? Further complexity is introduced by the fact that analytics can be performed on big data, whose outcomes and implications are unknown at priori, as well.
Decision support tools are required to help policy makers to explore the implications of defining policies on big data and related analytics. In my view, these tools must provide synthetic visualization of big data as well as real-time feedback on the implications of defining specific policies and related constraints.
I am looking for:

- Tools providing synthetic, visualization of big data as well as potential analytics

- Public documentation, approaches, case studies, solutions, etc. describing how businesses currently cope with the consequences of defining (security, business, privacy, sharing, etc.) policies on big data



--- Posted by Marco Casassa Mont (here and here) ---

--- NOTE: use this mirror blog if you prefer posting on an external blog site ---

--- NOTE: my original HP blog can be found here ---