ACID Theorem

While technology was advancing in 1970–80s, for the first time users started to work together with the same data on a single or multiple machines. Working on a shared place could easily lead us to problems, data could overwritten while other user were doing a calculations with the exact same data. In the other hand, …

ACID Theorem Read More »

Kafka Explained

Components of Kafka Producers: This component is responsible for forwarding messages to the related Kafka component. which is following component. Topics: This is where producers persist messages. Topics are responsible for storing data inside of Kafka. Consumers: When you want to read data from one or multiple topics consumers perform read operations from Topics. Consumer Groups: There is Consumer …

Kafka Explained Read More »

HADOOP Ecosystem

Hadoop came into stage almost 15(13 actually) years ago, promising integrated data storage and multiprocessing infrastructure. With Hadoop, you can create clusters consists of multiple computers(servers) called nodes. Nodes can form a cluster together. In an Hadoop cluster, every node communicate with others to share their states and information. This communication ensures availability and consistency …

HADOOP Ecosystem Read More »

Real Time User Activity Tracking w/ Divolte Collector and Kafka

This article is aiming to help Data Engineering professionals and other individuals which are with previous experience of software development and IT. If you don’t have any prior knowledge about IT and Big Data in general then this content may be hard for you to grasp. Table Of Contents: Idea Technologies to be used Building …

Real Time User Activity Tracking w/ Divolte Collector and Kafka Read More »

Some Great Resources About Data Warehousing #1

When I does my research about Data Warehousing and Big Data , I found some course notes of Dr. Andreas Geppert from University of Zurich. They are really great and easy to understand. If you are new at data warehousing I strongly recommend to check them out. Part 1 ; [flipbook pdf=”https://techbros.com.tr/wp-content/uploads/2020/03/dwh-01.pdf”] https://www.ifi.uzh.ch/dbtg/teaching/courses/DataWarehousing/Unterlagen/dwh-01.pdf Part 2 …

Some Great Resources About Data Warehousing #1 Read More »

KVKK Vazgeçilmezi : IBM OPTIM

IBM Optim ile veri arşivlemede kullanılacak bir Archive Request oluşturmak için aşağıdaki adımlar izlenebilir. 1- DB Alias: DB Alias Optim için bağlantı bilgilerini temsil etmektedir. Hangi DB ye hangi kullanıcı ve şifre ile bağlandığınızı DB Alias oluşturarak Optim e bildirirsiniz. Bunun için Optim Configuration’ı açıp Tasks sekmesinden Create/Update DB Alias butonunu tıklamak yeterli. Açılacak olan …

KVKK Vazgeçilmezi : IBM OPTIM Read More »