Build your Big Data cluster in less then one day

I know, nowadays everyone is building Big Data systems in less then 30 minutes. With Cloudera software it's even faster. I tried to do it, however I finished without so spectacular speed. To be honest I've spent 3 days, 3 hours, and 33 minutes. This article describes how to install Cloudera based Hadoop cluster in a universal way, making it able to run it in any type of environment including enterprise. With the instruction installation will take less then one day.

WebLogic JDBC monitor

WebLogic provides rich JDBC monitoring and diagnostics capabilities (debug, WLDF), however does not provide lightweight facility to report executed SQL statements lasting longer than predefined time. Moreover available out of the box subsystems are little too heavy, in area of configuration and generate too much information. Practical use case is to be informed only about SQL executions which consumed too much time. Presented solution delivers such lightweight SQL monitoring functionality. 

Identity generation in Hibernate (3of3)

Hibernate may be configured to assign unique identifiers to newly created entities. This feature is easy to use and does not need any tuning in single threaded, and single node environment. On the other hand, providing efficient configuration in distributed system requires careful analysis, design, and some of development effort. This note is Hibernate extension of documents "Maximize insert throughput in Oracle RAC system", and "Identity generation in load balanced WebLogic/RAC environment".

Identity generation in load balanced WebLogic/RAC environment (2of3)

This note specifies technical aspects of identity generation adjusted to multi node environment utilizing load balanced channels to Oracle RAC database. It's detailed extension of document "Maximize insert throughput in Oracle RAC system".

Maximize insert throughput in Oracle RAC system (1of3)

Many systems use surrogate primary keys generated by a sequence generator. It's simple, easy, and guarantees unique values. Unfortunately in a multithreaded environment it leads to issues with concurrent memory structures updates. The problem is additionally magnified in distributed environment with cache coherency. This analysis presents the problem and aims to find solutions.

File based Coherence configuration for Oracle SOA Suite

Oracle SOA Suite comes with embedded Oracle Coherence - data grid software used to improve communication in the cluster. Customer is not intended to change configured internal caches, and cannot use this Coherence software for his own purposes. On the other hand, customer may need to update cluster layer technical parameters to adjust them to the environment. One of recommended configuration steps is switching from default multicast, UDP based, cluster discovery and communication protocol, to TCP based, unicast mode. Enabling Well Known Addresses (WKA) is a technical activity that does the switch. This document describes how to do this with receipt of moving configuration to files. 

Linux memory management configuration

Linux by default uses up to half of available memory for disk caches, uses swap, and 4k pages to manage memory. In the case of in-memory processing system, the data handling is truly bound to physical RAM, and all typical memory management is not necessary (at least to some extend).