Big Data & SAP HANA...What are those again?

After the first year of SAP HANA and the constant debate around Big Data, its almost certain that you heard about it once or twice already - but are you 100% clear of what Big Data is and what SAP HANA can do for your company?

Big Data

Boosted by the evolution of mobility and advances in technology, we see new data sources emerge continually. It is forecasted that  by 2020, 50 billion Internet-enabled devices will be connected to the Web generating  44 times more data annually than we did three years ago.

This growth can be the fortune or the ruin for a company. This depends on their knowledge of Big Data and whether they see it as a challenge or opportunity.

In order to understand what can be denominated BigData, there are a number of factors to be taken into account. Recently, Adrian Simpson and Timo Elliott talked about Big Data and the ‘Four Vs’ – which stand for volume, velocity, variety and validity (see the studio discussion What is Big Data here).

There has been some discussion generated after this, with  disagreement about how many Vs there are. While some defend only three (volume, velocity and variety), others say there are more, such as veracity, virility and viscosity. As an example, read the blog  Beyond the Three V’s of Big Data and make up your own opinion about the topic.

The fact of the matter is that Big Data is already a reality. In order to stay competitive, companies will have to be able to analyze their growing data effectively, allowing for timely response and proactive actions taken after spotting trends.

SAP HANA allows companies to do just that. SAP HANA is a modern platform for real-time analytics and applications. It enables organizations to analyze business operations based on a large volume and variety of detailed data in real time. The main benefits of SAP HANA include:

• 3600x faster reporting speed
• Make business decisions in real-time
• Accelerate business performance
• Unlocks new insights
• Increase productivity and efficiency

And this is just the tip of the iceberg, SAP HANA is one of the fastest growing products SAP has launched, and the explanation for this exponential growth can be found on ten reasons customers choose SAP HANA Clariba is working with SAP HANA in conjunction with SAP BusinessObjects Business Intelligence solutions so that companies can work with real-time BI information and be on top of changing business realities as events unfold. As the first proofs-of-concept succeed   at our clients, we realize that this combination of Big Data analysis and market-leading business intelligence from SAP BusinessObjects is the way forward to unleash the insights from a company´s databases.

If you want to know more, check the  SAP HANA Blog or follow some of the top 50 Big Data Twitter Influencers.

Have any doubts or want to know more about the combination of Business Intelligence and Big Data with SAP HANA? Leave a comment below.

SAP HANA Sandbox Implementation for In-house Tests

SAP HANA gets you moving at the speed of light

It is early days, but Clariba is at the forefront here once again with our initial SAP HANA installations. Indeed, SAP HANA is positioning properly in the starting grid of the BI stack for new deployments. That is very good news for all of us who are in the SAP World. However, even though everyone is (theoretically) aware of what SAP HANA is and its main benefits, not so many consultants know what the real options for having that in-house are and therefore they are not able to start making the first tests and getting their hands dirty with the tool. This is really important as we do not usually know when a real SAP HANA project may come up in our portfolio and we want to be ready for that. The main purpose of this blog entry is to shed some light on this topic.As mentioned earlier, surely almost all of our Clariba blog readers already have heard about SAP HANA. For all those who are still late let me pinpoint the primary concepts of it. Basically SAP HANA is a Database Server taking advantage of the SAP In-Memory Computing technology. This technology empowers dramatically the entire business – from shop floor to boardroom – by giving real-time business processes and applications instantaneous access to data, enabling real-time business applications and analytics system.

Back to the point, nowadays we have 2 real options for having our own SAP HANA environment up-and-running in our office. Depending on our budget and our requirements we can go for the cheapest option which is to apply for a virtual instance of HANA in the cloud or the most expensive one which is acquiring an official hardware appliance from one of the leading hardware partners of SAP.

The first and cheapest option is to go for a SAP HANA Application located virtually in the Cloud. This is an on-demand application environment and SAP offers a range of services with that. Nowadays SAP is offering SAP HANA Database environment in Amazon Elastic Compute Cloud (aka Amazon EC2). This is a complete fully working instance which can be accessible through SAP HANA Studio with really nice performance (depending on the requirements the instance may be created with more or less HW resources).

Under this context, before creating our SAP HANA instance there are two prerequisites which have to be met. First thing is to ensure you are a member of the Sap Community Network (SCN) - you can REGISTRAR AQUÍ. This process is totally free of charge. Second is registering in Amazon Web Services (AWS). You will be requested to use your credit card because although registering is free, the charges will come up as soon as we create our SAP HANA instance. Amazon charges money from that point on. Even when the instance is stopped they will still be charging. Regarding the costs, they can be foreseen in advance using their own pricing calculator which can be found here. Just to give an idea, the smallest instance costs 50$/month with a 25h per week usage. We definitively recommend terminating the instance once the test is completed. The entire process to create the AWS instance can be found here.

The second option is absolutely the best but also the most expensive one. The idea is to purchase an actual brand new SAP HANA rack data base server. Currently SAP is in partnership with Intel, IBM, Fujitsu, Dell, Cisco and HP companies so you can contact directly with them and check their actual prices. They have a nice variety of models in order to meet all customers` needs. It is only with this sort of installation that you will get the best SAP HANA performance. Just to give you an idea of the remarkable speed in one of those machines, our consultants loaded more than 250 Million records in our sandbox system and they were achieving less than 5 seconds of average response time for any query we run against the database. Not bad at all, is it?

Finally, I would like to mention that you might find other options in forums for using a laptop with a fresh SAP HANA installation that involve altering installation code. This solution is not supported by SAP; therefore Clariba strongly discourages you to use it. The 2 options listed above will give you much better performance.

In conclusion, SAP HANA has become a reality in our BI world. As time goes by, our SAP customer datasets are exponentially growing and will eventually exceed the abilities of their commonly used tools. Transition towards SAP HANA will be a must for them, but also for us. Ensure you are ready for that by getting to know the tool. You know what options you have now, so go for it.

If you have any tips or questions, please leave a comment below.

Abran paso a SAP HANA

El mes pasado, tuve la oportunidad de asistir al campamento de entrenamiento de SAP HANA en Dubai (Emiratos Árabes Unidos). Esta fue mi primera oportunidad, después de muchas expectativas y whitepapers, de poner mis manos en una verdadera máquina de SAP HANA y la expectativa se cumplieron.

Comencemos con las impresionantes mejoras de hardware que nos han llevado a la revolución informática en memoria.

1

No es difícil entender que la parte más lenta de un acceso a la base de datos es la lectura de datos de los discos. Este problema ha sido abordado por los proveedores de bases de datos al intentar utilizar optimizaciones de almacenamiento, hardware más rápido y otras técnicas, pero en última instancia, el sistema de gestión de bases de datos necesita leer los datos del disco. Así que aquí la gran idea vino a jugar ... ¿Qué pasa si puedo almacenar todos los datos en la memoria?

No hace mucho, cuando nuestros procesadores de servidor eran 32 bits, sólo podíamos dirigir 4 GB de memoria, de modo que era la cantidad máxima de memoria que tenemos en frío en nuestro servidor. Hoy en día con las arquitecturas de 64 bits podemos acceder hasta 2 TB.

Además de la gran cantidad de memoria principal que podemos tener en el servidor, gracias a las enormes arquitecturas paralelas (actualmente podemos tener hasta 64 núcleos de CPU por servidor) podemos aplicar muchas optimizaciones que reducen el tamaño de los datos y aumentan Rendimiento de acceso. Estos son:

• Compresión de datos
• No es necesario utilizar tablas agregadas que reduzcan los requisitos de almacenamiento de datos.
• Podemos utilizar particiones de tablas para aumentar la velocidad de acceso a los datos.

Todo esto nos da un tiempo de respuesta cercano a la consulta inmediata, incluso con consultas que involucran billones en filas, y créanme, esto no es sólo un truco de Marketing ... Lo he visto;)

2

Hasta ahora hemos visto por qué es interesante usar la informática en memoria y por qué hacerlo ahora, pero, ¿cómo gestionamos SAP HANA Appliance?

El núcleo de la administración de SAP HANA Appliance es SAP HANA Studio. Usando esta herramienta podemos:

• Modelar nuestra información; Estos modelos se utilizan para crear vistas múltiples de los datos transaccionales.
• Vista previa de los datos de las tablas físicas y los modelos de información mencionados anteriormente.
• Importar y exportar datos
• Configurar el aprovisionamiento de datos (cargas de tabla iniciales y replicación)
• Administrar la seguridad del sistema

Espero que haya disfrutado de esta visión general de la aplicación SAP HANA. Muy pronto volveré con un post sobre la conectividad de SAP HANA.

Si usted tiene alguna pregunta u opinión sobre el dispositivo SAP HANA, por favor deje un comentario a continuación.

SAP Data Warehousing Solutions: an octubre 2011 Review

Independientemente de los proveedores de software o hardware, el mercado de Data Warehousing es un área de crecimiento, que se espera que aumente aproximadamente 10.1% en CAGR (tasa de crecimiento anual compuesta) en 2015 según el último estudio realizado por IDC. SAP, gracias a la adquisición de Sybase, Gartner & Forrester lo considera un líder en el Data Warehouse. Este artículo se centra en las soluciones proporcionadas por SAP para organizaciones que buscan almacenes de datos orientados a la empresa o bases de datos de alto rendimiento más ágiles y para echar un vistazo a su hoja de ruta futura.

Almacén de datos empresariales

• SAP NetWeaver Business Warehouse (BW): is nowadays a very stable product, with a large installed base and in constant growth (more than 12000 customers, more than 15000 productive systems), and what more it has not been affected by the economic downturn in 2009. If we look at its future evolution, it is intended to be running on HANA in 2012 which will be used as the underlying In-Memory database Platform (BW 7.3x SP5), this means to be based on an  already built-in Business Warehouse Accelerator.

Base de datos analíticos de alto rendimiento

• SAP HANA: is a flexible, data source agnostic, in-memory appliance that analyzes high volumes of transactional data in real-time. It includes tools for data modeling, data and lifecycle management, security and operations. It combines SAP software components which are optimized with the hardware provided by partners. The benefits are the following: make smarter business decisions supported by an increased visibility  of very large volumes of business information, react to business events more quickly through real-time analysis and reporting of operational data, a new application foundation for a new category of applications, streamline IT landscapes and finally reducetotal cost of ownership (TCO). If we look further  ahead in time, there will be a transition going from having SAP Business Objects BI 4.0 running on SAP HANA 1.0 to having the whole SAP Business Suite running on SAP HANA 2.0 in 2013.

• Sybase IQ: is a market leading, high-performance, columnar analytics server and data warehouse specifically designed for high speed data analytics, enabling high speed performance of complex queries against large datasets, with the advantage of being a low cost  maintenance when compared to row-based systems (by reducing the need for aggregates and indexes). It is a mature and proven solution with about 1900 customers and more than 3300 unique deployments. SAP will continue to support and invest on this acceleration technology, especially for non-SAP applications and data (including the possibility of placing SAP BusinessObjects BI on top).

• SAP BusinessObjects RapidMarts are preconfigured jumpstart data marts that are designed to accelerate BI. And they all come pre-packaged by subject areas and sub-areas specific to SAP modules (Finance, Manufacturing, Operations, HR, etc.) as well as for non-SAP applications (JD Edwards, PeopleSoft, Lawson, Oracle EBS, etc.). The key elements included are the following:

1. Asignaciones de ETL: asignaciones de origen a destino y transformación de datos para tablas de origen relevantes (movimientos de datos iniciales e incrementales).
2. Data Marts: conjunto de objetos y esquemas RDBMS de destino basados en las mejores prácticas para el modelado de datos dimensionales (Oracle, DB2, SQL Server, Teradata).
3. Contenido de BI: universos preconfigurados basados en las mejores prácticas y muestras de informes que muestran la gran cantidad de datos disponibles.

Si necesita más información sobre las soluciones presentadas aquí, no dude en publicar una respuesta o ponerse en contacto con Clariba.